How to import multiple start url

I use Element attribute scraping some urls,but it can't have a child selector。

so I have to set multiple urls as start url manual,

Is there any ways to import multiple urls as start url for one sitemap?

Either when you are first making your scraper or go to Edit Metadata if you look closely to the right of your Start URL you'll notice some +/- buttons. You can add up to 10,000 Start URLs. If you have more than a couple to add I find it handy to paste them a temp text file, do a couple of search and replaces to to encase them in double quotes and separate them by commas and then delete any newlines so that it is one giant chunk of text. I then export my scraper, find the Start URL and replace it with the chunk of URLS and then re-import it. If the devs are reading, it would be nice to be able to just insert a chunk of URLs without all of that work.

2 Likes

Thanks, I konw the +/- buttons, I just write a python script to auto add multiple urls for one Sitemap。

I will share it later

Hi there!

You can always use a macro :wink:

share the python code. I have the same need.