Hi, I'm trying to scrape the description of various ads. I got it working fine until I tried to make it work with pagination.
I've been following this guide here https://www.webscraper.io/documentation/selectors/link-selector and my selector graph looks exactly like the one on the very bottom of the page yet it does not collect any text descriptions. It merely passes on the 'link' selector completely and goes into a never ending loop loading the next page.
What did I do wrong, any help would be much appreciated. Thanks!
Url: https://www.bestadsontv.com/search.php
Sitemap:
{"_id":"newbest","startUrl":["https://www.bestadsontv.com/search.php"],"selectors":[{"id":"link","type":"SelectorLink","parentSelectors":["_root","next"],"selector":".best_div a","multiple":true,"delay":0},{"id":"text","type":"SelectorText","parentSelectors":["link"],"selector":"read-more a, div.ad-description","multiple":false,"regex":"","delay":0},{"id":"next","type":"SelectorLink","parentSelectors":["_root","next"],"selector":"a:nth-of-type(10)","multiple":false,"delay":0}]}