Hi all!
Im having a hard time scrapping this site.
Im not sure what im doing wrong. I already scrap some sites without any problem, but in this case, the pagination is not working as intended.
For example, in this case, starts in page 1, and then goes to page 25, and get in a loop where is the only page its keep visiting.
https://www.walmart.com/browse/snacks-cookies-chips/cookies/976759_976787_1001391
Sitemap:
{"_id":"walmart_cookies","startUrl":["https://www.walmart.com/browse/snacks-cookies-chips/cookies/976759_976787_1001391"],"selectors":[{"id":"pagination","type":"SelectorLink","parentSelectors":["_root","pagination"],"selector":".paginator-list a","multiple":true,"delay":0},{"id":"elementos","type":"SelectorElement","parentSelectors":["_root","pagination"],"selector":"li.Grid-col","multiple":true,"delay":0},{"id":"titulo","type":"SelectorText","parentSelectors":["elementos"],"selector":".product-title-link span","multiple":false,"regex":"","delay":0},{"id":"precio","type":"SelectorText","parentSelectors":["elementos"],"selector":"span.price-group","multiple":false,"regex":"","delay":0}]}
Thanks a lot in advance and regards!