Scrape the same datas but from 4600 totally differents pages

How to?
#1

Hello team,

I have a map with 4600 points on it, there are local shops.

Datas are not available directly when you click on one shop on the map, it opens another specific page for the shop with mail, phone, etc...

I already scraped the 4600 links for specific pages, so now I "only" need to launch a scrap on these 4600 links by putting it as "Start URL" BUT I can't do it for 4600 URLs, it's too long ahah.

So do you know a method to scrape these all without putting it in "Start URL" manually ? Can I use an Excel sheet that I can upload?

There is the map : Recherche - Bienvenue à la ferme

Thanks a lot !

#2

Hi, you can use a tool like Add text to each line online

Copy your list of URLs and append " to the beginning of each link and ", to the end.

Then copy your sitemap into https://jsonlint.com/

Click validate and you should see clearly where to copy the URLs. Just remove the comma from the last line and click validate.

Hope this helps!

#3

You can use something like https://pastelink.net/

Just paste your list of URLs there and you'll get a new page with clickable links. You can use that page as your Start URL

Example: Datacenters - Pastelink.net