Web Scraper version: 1.29.66
Chrome version: 115.0.5790.102
OS: macos
Sitemap:
{id:"rooks"}
Error Message:
I have no error messages. When I scrape a site it opens all pages I am looking for (few hundred) but in the export in csv or excel only some 20 are shown.
here you go:
{"_id":"rooks","startUrl":["https://rooks.pl/gb/"],"selectors":[{"id":"categories","parentSelectors":["_root"],"type":"SelectorLink","selector":"div.cbp-category-link-w a","multiple":true,"linkType":"linkFromHref"},{"id":"subcategories","parentSelectors":["categories"],"type":"SelectorLink","selector":"a.subcategory-name","multiple":true,"linkType":"linkFromHref"},{"id":"products","parentSelectors":["subcategories"],"type":"SelectorLink","selector":"a.product_img_link[itemprop='url']","multiple":true,"linkType":"linkFromHref"},{"id":"title","parentSelectors":["products"],"type":"SelectorText","selector":"h1","multiple":false,"regex":""},{"id":"refernce","parentSelectors":["products"],"type":"SelectorText","selector":"span[itemprop='sku']","multiple":false,"regex":""},{"id":"price","parentSelectors":["products"],"type":"SelectorText","selector":"span.price[itemprop='price']","multiple":false,"regex":""},{"id":"techdata","parentSelectors":["products"],"type":"SelectorHTML","selector":"section#idTab2","multiple":false,"regex":""}]}
@dioneo Hi, that's because some of the targeted categories lead straight to the product listing page and are skipped due to your sitemap structure.
https://rooks.pl/gb/321-iveco
https://rooks.pl/gb/18-pneumatic-hammers
