The website has 13 pages, but doesn't have a 'Next' Button. So the Webscraper Extension only reads pages 1,2,3,4,5,6, and 13. It gathers no data from 7,8,9,10,11, nor 12. Is there a way to address this?
In this case, it will be easier, if you use "{}" in your URL to scrape all sites
https://myurl.com/?page={1-13}
This will find and scrape all available sites.
hello @daspatte, I'm interesting by your reply but I'm not sure to have understood. Where can I add this URL ? In the Start URL or in the selector created for pagination ?
Thanks a lot
@kjacomet Hi,
The active button probably has an additional indication that it is active, therefore you could use a selector like a.active + a
Of course, without knowing the HTML structure of this page there might be other solutions.