Web Scraper version: 0.3.7
Chrome version: Version 64.0.3282.186
OS: Windows
Sitemap:
{"_id":"amzn_mens_clothing_v1","startUrl":["https://www.amazon.com/Best-Sellers-Mens-Clothing/zgbs/fashion/1040658/"],"selectors":[{"id":"category","type":"SelectorLink","selector":"ul ul ul ul a","parentSelectors":["_root"],"multiple":true,"delay":0},{"id":"subcategory","type":"SelectorLink","selector":"ul ul ul ul ul a","parentSelectors":["category"],"multiple":true,"delay":0},{"id":"item","type":"SelectorElement","selector":"div.zg_itemImmersion:nth-of-type(n+2)","parentSelectors":["subcategory"],"multiple":true,"delay":0},{"id":"rank","type":"SelectorText","selector":"span.zg_rankNumber","parentSelectors":["item"],"multiple":false,"regex":"","delay":0},{"id":"description","type":"SelectorElement","selector":"div.zg_itemWrapper div.p13n-sc-truncated","parentSelectors":["item"],"multiple":false,"delay":0}]}
Error Message: I have been using webscraper.io without any real issues for several months (it's been great). Recently, the sitemap above, and several similar ones, have been experiencing issues when executing the scrape. When I preview the data, the "description" field above shows the correct information. When I then run the scrape, the "description" field is returned with a "null" result roughly 80% of the time (the other 20% captures the requested information). Any help is appreciated.
To access error messages follow these steps:
- Open chrome://extensions/ or go to manage extensions
- Enable “developer mode” at the top right
- Open Web Scrapers “background page”
- A new popup window should appear.
- Go to “Console” tab. You should see Web Scraper log messages and errors there.