Hey everyone, I have scraped a website which contains around 5,00,000 data rows (5 columns). The scraper shows that the scraping is finished. But whenever I want to export the data as csv the download button doesn't show up. I am using couchdb as a storage option. Any help?
Hi did you click the Refresh button? You should be able to see some of the scraped info.
It's possible the Chrome window may have crashed; in such cases you may or may not have any scraped data. However, if you manually close the scraper window, it should stop gracefully and you should have obtained some scraped data up until that point.
I'd suggest you split up your scraping into batches if possible, say 100,000 lines, then close Chrome (full Exit), launch again and continue.