Is it possible to run multiple web scraper sessions at once?

#1

I have a few websites I need to scrape and each takes 2 hours, can I run the scraper on multiple websites with different sitemaps at once?

Thanks a lot

#2

Hello

did you try to open the extension in different tabs and to lauch in each tab a different scraping ?

#3

i also interested in this point, so is there any official reply for this question?

#4

Yes, it is possible but you need to create a separate Chrome profile. This basically acts like a separate copy of Chrome so you'd need to install WS on it too (it is like launching Chrome for first time).

You can run both Chrome profiles at the same time, and thus also run two WS sessions at once. I do this quite often. In fact, I run the standard Web Scraper extension in one profile and Web Scraper Dev extension in the other.

#5

Is it possible for same site, to use proxy in one chrome window and regular in another chrome window to avoid ip getting blacklisted? (concurrent scraping in same site to reduce time)