Web Scraper version: 0.6.4
Chrome version: 96.0.4664.93 (Build ufficiale) (a 64 bit)
OS: windows Edizione Windows 10 Pro
Versione 21H2
Data installazione: 20/08/2021
Build sistema operativo 19044.1348
Esperienza Windows Feature Experience Pack 120.2212.3920.0
Sitemap:
{id:"my sitemap"}
{"_id":"pitchfork2","startUrl":["https://pitchfork.com/reviews/albums/?page=[1500-1839]"],"selectors":[{"id":"globalselector","parentSelectors":["_root"],"type":"SelectorElement","selector":"div.review-collection-fragment:nth-of-type(1) div.review","multiple":true,"delay":0},{"id":"artist","parentSelectors":["globalselector"],"type":"SelectorText","selector":".artist-list li","multiple":false,"delay":0,"regex":""},{"id":"album","parentSelectors":["globalselector"],"type":"SelectorText","selector":"h2","multiple":false,"delay":0,"regex":""},{"id":"genre","parentSelectors":["globalselector"],"type":"SelectorText","selector":"a.genre-list__link","multiple":false,"delay":0,"regex":""},{"id":"Author","parentSelectors":["globalselector"],"type":"SelectorText","selector":"a.linked","multiple":false,"delay":0,"regex":""},{"id":"album-link","parentSelectors":["globalselector"],"type":"SelectorLink","selector":"a.review__link","multiple":false,"delay":0},{"id":"vote","parentSelectors":["album-link"],"type":"SelectorText","selector":"span.score","multiple":false,"delay":0,"regex":""},{"id":"date","parentSelectors":["album-link"],"type":"SelectorText","selector":"time","multiple":false,"delay":0,"regex":""},{"id":"label","parentSelectors":["album-link"],"type":"SelectorText","selector":"li.labels-list__item","multiple":false,"delay":0,"regex":""},{"id":"year","parentSelectors":["album-link"],"type":"SelectorText","selector":"span.single-album-tombstone__meta-year","multiple":false,"delay":0,"regex":""},{"id":"review","parentSelectors":["album-link"],"type":"SelectorGroup","selector":".contents p","delay":0,"extractAttribute":""}]}
Error Message:
no error messages relating either to webscraper or pitchfork
To access error messages follow these steps:
- Open chrome://extensions/ or go to manage extensions
- Enable “developer mode” at the top right
- Open Web Scrapers “background page”
- A new popup window should appear.
- Go to “Console” tab. You should see Web Scraper log messages and errors there.
Yello, my scraping project is to scrape pitchfork reviews, it actually works fine, but it doesnt do all the pages in the interval, it actually closes with no message and stop scraping after x pages (can be 10, or 20, depends) and I have to start over after checking what was the page it got up to.
Really annoying.
