I want to scrape the whole site with their products category wise, and when one category is opened it again gives multiple categories on the left side which has different products in it, how to resolve this, help!
Main Category Page URL: Handmade Paper shop - Over 600 tree free products to buy
Suppose a category is selected from above link named 'Paper' which give again multiple categories on left pane and on the main page also.
URL: Paper Archives - Handmade Paper | Tree Free Paper | Bluecat Paper
check it out:
{"_id":"bluecatpaper","startUrl":["https://bluecatpaper.com/shop/"],"selectors":[{"id":"cat","linkType":"linkFromHref","multiple":true,"parentSelectors":["_root"],"selector":"li.product-category a","type":"SelectorLink"},{"id":"element","multiple":true,"parentSelectors":["cat"],"selector":"div.fusion-product-content","type":"SelectorElement"},{"id":"link","linkType":"linkFromHref","multiple":true,"parentSelectors":["element"],"selector":".product-title a","type":"SelectorLink"},{"id":"price","multiple":false,"parentSelectors":["link"],"regex":"","selector":"p.price","type":"SelectorText"},{"id":"descr_short","multiple":false,"parentSelectors":["link"],"regex":"","selector":"[class*=\"product-details__short-description\"]","type":"SelectorHTML"},{"id":"sku","multiple":false,"parentSelectors":["link"],"regex":"","selector":".sku","type":"SelectorText"},{"id":"category","multiple":false,"parentSelectors":["link"],"regex":"","selector":"a[rel=\"tag\"]","type":"SelectorText"},{"id":"desciption","multiple":false,"parentSelectors":["link"],"regex":"","selector":"div[id=\"tab-description\"]","type":"SelectorHTML"},{"id":"weight","multiple":false,"parentSelectors":["link"],"regex":"","selector":".woocommerce-product-attributes-item--weight td","type":"SelectorText"},{"id":"dimensions","multiple":false,"parentSelectors":["link"],"regex":"","selector":".woocommerce-product-attributes-item--dimensions td","type":"SelectorText"}]}
Can you help me out on this!?
https://forum.webscraper.io/t/cant-select-multiple-styles-of-a-product-with-their-respective-prices/14801