Hello guys! Is it possible to use 2+ range definitions in 1 start url? Only first works, other stay as plain text. Thank you!
Url: http://example.com/search=4[0-4].[0-9]14304081346245,+-7[1-9].[0-9]4322349305877
You can generate those URLs with this Python code. Just modify as needed.
f = open("output.txt", "w")
for i in range(0, 5):
for j in range(0, 10):
for k in range(1, 10):
for m in range(0, 10):
url = "https://somesite4" + str(i) + "." + str(j) + "chunk_a" + str(k) + "." + str(m) + "chunk_b"
print(url)
f.write(url + "\n")
f.close()
Code can also be run on this Online IDE. Note: It will generate thousands of URLs.
This was a helpful way around a nested pagination.
Sometimes it's the simple solutions.
I generated the links with the pattern (Quick ChatGPT work) and then inputed into the "Export code" then imported as a new sitemap. Worked like a charm.
{
"_id": "Sample",
"startUrl": [
"https://www.RANDOM.com/rand/?date=01.01.2016",
"https://www.RANDOM.com/rand/?date=02.01.2016",
"https://www.RANDOM.com/rand/?date=03.01.2016",
... ] cont...