Scraping from url with increments : https://mysite.com/product/431

#1

Hello all,
I'm new here but I already really like https://webscraper.io/.
I'm looking for a way to scrape pages that have no pagination, but just a series of id in the URL such as :
https://mysite.com/product/431
https://mysite.com/product/432
https://mysite.com/product/433
https://mysite.com/product/434
...

Do you know a way to do that with https://webscraper.io/?

Thanks for your answer!

Best,
Antoine

#2

Hey, you will have to set a range in your start URL by using brackets. In your case, It would look like https://mysite.com/product/[431-434]

More information about how to use pagination is available in https://webscraper.io/ documentation section - Installation | Web Scraper Documentation

#3

Thanks for your answer.
I'll try that now.