Scraping from url with increments : https://mysite.com/product/431

#1

Hello all,
I'm new here but I already really like WebScraper.io.
I'm looking for a way to scrape pages that have no pagination, but just a series of id in the URL such as :
https://mysite.com/product/431
https://mysite.com/product/432
https://mysite.com/product/433
https://mysite.com/product/434
...

Do you know a way to do that with WebScraper.io?

Thanks for your answer!

Best,
Antoine

#2

Hey, you will have to set a range in your start URL by using brackets. In your case, It would look like https://mysite.com/product/[431-434]

More information about how to use pagination is available in webscraper.io documentation section - https://www.webscraper.io/documentation#scraping-a-site

#3

Thanks for your answer.
I'll try that now.