I’m using Scraper to crawl around 30,000 data entries (manually counted). I’ve tried multiple times, but Edge keeps crashing halfway through.
Would it be possible to add a feature in Web Scraper that shows a prompt like "Running for XXXX mins, crawled XXX entries total", and auto-exports the crawled data? This would make the process much easier to manage.