Hello, I have a pretty easy site to scrape, but cannot figure out how to get to the next page. The site is paginated with a next button, but every time I run it, the browser closes after the first page and does not go to the second. I've tried link pagination, as well as element click and even though I am not sure if I am doing it right it still will not load the second page. Any help on getting me past the first page will be appreciated. Thank you.
Sitemap:
{id:"sitemap code"}
Hey, sound like your pagination link selector has not it's multiple checkbox checked.
Here is a simple sitemap skeleton on how the selector should look like:
{"_id":"test","startUrl":["https://www.toynk.com/collections/figures-collectibles/products/indiana-jones-adventurers-fertility-idol"],"selectors":[{"id":"title","type":"SelectorText","parentSelectors":["element"],"selector":"h1.product_name","multiple":false,"regex":"","delay":0},{"id":"pagination","type":"SelectorLink","parentSelectors":["_root","pagination"],"selector":"div.nav_arrows a.breadcrumb_link:contains('Next')","multiple":true,"delay":0},{"id":"element","type":"SelectorElement","parentSelectors":["_root","pagination"],"selector":"div.section","multiple":true,"delay":0},{"id":"sku","type":"SelectorText","parentSelectors":["element"],"selector":"p.sku span","multiple":false,"regex":"","delay":0},{"id":"price","type":"SelectorText","parentSelectors":["element"],"selector":"span.money","multiple":false,"regex":"","delay":0}]}
Hello, seems to working great. Thank you for your answer, it is much appreciated.