I am trying to extract company names and their locations from this website:
https://www.scienceexchange.com/marketplace/experimental-services?page=1
I read that in order to have pagination, the pagination must be recursive, so it must be it's own parent element as well as parent to the company info. However, the sitemap simply loads the first page then immediately exits the program. I believe the issue is with the pagination, but not entirely sure.
Sitemap:
{"_id":"sxc_2","startUrl":["https://www.scienceexchange.com/marketplace/experimental-services?page=1"],"selectors":[{"id":"pagination","type":"SelectorLink","parentSelectors":["_root","pagination"],"selector":"li:nth-of-type(n+5) a.page-link","multiple":true,"delay":0},{"id":"comp_link","type":"SelectorElement","parentSelectors":["_root","pagination"],"selector":"span[itemprop='name'], span[itemprop='address']","multiple":true,"delay":0},{"id":"name","type":"SelectorText","parentSelectors":["comp_link"],"selector":"parent","multiple":false,"regex":"","delay":0}]}
I'm not sure exactly what I am doing wrong. Any help would be greatly appreciated!