Manually Retrieve Data From Local Storage?

#1

I've ran a webscrape that took twelve plus hours to complete. When I choose to export to CSV I get the "Generating..." message that never generates a downloadable CSV file and when I choose to browse data I get a "Loading..." message that also hangs. Nothing is ever generated. Is there a way to manually retrieve the data (providing that the data was indeed successfully scraped)?

It's probably a large file, but I have no idea of how to calculate how large it might be. It's a collection of two values (zip code and city) from tables scraped from roughly 7,000 pages.

2 Likes
#2

I also face this problem.
It will be great If can know where the local temporary data store is located.
Hope the administrator can give a solution, thank you.

#3

you should segment your scrape task by several sub-tasks... Otherwise, you will always face this problem...