How to create irregular ranges for url date format

How to?
#1

Hi, I'm trying to scrape tables from url's ending in dates in format /yyyymmdd

Of course for the range of one month this works [20170101-20170131], but is there any way I can create a range that includes multiple months along the lines of [20170101-20170131...20170201-20170228]??

url: https://www.ovtijden.com/avtdag/SWK/20170101

#2

I have the same question. How?

#4

Hi!

I've tried to experiment with the brackets, seems that it's not supported to have more than one pair of brackets within a single url, so the only option left is to create a sitemap with multiple URLs with brackets.

I've tested it and it's working.

Here's a working test example:

{"_id":"test","startUrl":["https://www.ovtijden.com/avtdag/SWK/2017010[1-5]","https://www.ovtijden.com/avtdag/SWK/2017010[6-9]"],"selectors":[]}