Web Scraper version: 0.3.8
Chrome version: 49.0.2623.112
OS: XP
Sitemap:
https://www.casualtyforms.org/form/[1-32538]
Error Message:
I actually scraped in batches of 1000 to 5000 pages
I was accessing a table on each page called 'table'
On reviewing the data I found it had missed batches of records/pages, generally a sequence of 15 records were missed although in some cases it was 14 or 27 or 29
The pages do exist, and re-running the scrape with just the missing pages in the pagination sequence picks the data up Ok