How to make scrapping process fast

#1

Hi there!!! I am a new member of this group. I am using excel for the scraping process. I have curated around 2,00,000 unique links for web pages. Now, I want to curate a single piece of information (a value) from each page. Each page is taking around 20 seconds to load. So, mathematically it seems it will take forever to complete the process. How can I retrieve the data as fast as possible?
Can anyone please help me?

Many thanks in advance,
DC7

#2

@DC7

Hello, if you are using the Web Scraper Cloud, i'd suggest using the "Fast(NoJS)" driver and experiment with different page load delay and request interval values.

Learn more about the difference between Full JS and Fast (NoJS) drivers here: