Hi, I am new to web scraper and I am trying to scrape data from our website. We are trying to scrape the title, category, price, availability, Model #, image url, product options, and the description. I have managed to scrape the data but I am struggling with one issues. Each product my have different product options and they will have different sku's for each product. When I scrape the data I want each sku and each product option to be on its own line. For example:
If a product comes in small and large and its available in black and white i want the data to export line by line
black, small, title, category, price, availability, Model #, image url, description
black, large, title, category, price, availability, Model #, image url, description
white, small, title, category, price, availability, Model #, image url, description
white, large, title, category, price, availability, Model #, image url, description
I created a page with a few links as an example. Any help would be greatly appreciated!
Url: https://hoolichat.com/index.php/twacomm-product-links/
Sitemap:
{"_id":"twacomm-products","startUrl":["https://hoolichat.com/index.php/twacomm-product-links/"],"selectors":[{"id":"product links","type":"SelectorLink","parentSelectors":["_root"],"selector":".post-content a","multiple":true,"delay":0},{"id":"Title","type":"SelectorText","parentSelectors":["product links"],"selector":".col-left h1","multiple":false,"regex":"","delay":0},{"id":"Model","type":"SelectorText","parentSelectors":["product links"],"selector":".col-left span","multiple":false,"regex":"","delay":0},{"id":"Category","type":"SelectorText","parentSelectors":["product links"],"selector":"div.breadcrumbs","multiple":false,"regex":"","delay":0},{"id":"Price","type":"SelectorText","parentSelectors":["product links"],"selector":"strong.accent3","multiple":false,"regex":"","delay":0},{"id":"availability","type":"SelectorText","parentSelectors":["product links"],"selector":"span#avail","multiple":false,"regex":"","delay":0},{"id":"Attribute","type":"SelectorText","parentSelectors":["product links"],"selector":".prod-options li:nth-of-type(1)","multiple":false,"regex":"","delay":0},{"id":"attribute options","type":"SelectorText","parentSelectors":["product links"],"selector":".prod-options li:nth-of-type(n+2)","multiple":true,"regex":"","delay":0},{"id":"Product Brochure","type":"SelectorLink","parentSelectors":["product links"],"selector":".desclinks a:nth-of-type(2)","multiple":false,"delay":0},{"id":"Description","type":"SelectorHTML","parentSelectors":["product links"],"selector":"div#proddesc","multiple":false,"regex":"","delay":0},{"id":"Sku1","type":"SelectorText","parentSelectors":["product links"],"selector":"#sku-table tr:nth-of-type(n+2)","multiple":true,"regex":"","delay":0},{"id":"image","type":"SelectorImage","parentSelectors":["product links"],"selector":"img[alt='Allen Tel Single Line Phone with Automatic Dialer']","multiple":false,"delay":0}]}