Hello Forum,
I am trying to scrap products from a website by using webscraper chrome extension.
Product link: https://www.autozone.com/external-engine/alternator/duralast-gold-alternator/973439_223645_0
I have succeeded to scrap the main product information but I have stuck at one section in the product page which is know as 'Vehicle Fitment' because this section kept information in the form of nested.
For example:
1)First we would need to click on Vehicle Fitment tab. It will show all vehicle make names(Honda)
2)Then would need to click on each 'Vehicle Make' name. It will show all vehicle models names(RC100)
3)Then would need to click on each 'Vehicle Model' name. It will show all vehicle years names(2001)
4)Then would need to click on each 'Vehicle Year' name. It will show all vehicle Engine names(8 cylinder)
I would need to scrap the Vehicle Fitment values in the same nested form.
For example:{ "vehicle_make" => {"vehicle_model" => { "vehicle_years" => "vehicle_cylinders"} }}
Let me know if it is possible.
Below is my current sitemap:
{"_id":"alternator","startUrl":["https://www.autozone.com/external-engine/alternator"],"selectors":[{"id":"product_link","type":"SelectorLink","parentSelectors":["_root"],"selector":".productImageContainer a","multiple":true,"delay":0},{"id":"pagination","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"#compareBottom a#next","multiple":false,"delay":0,"clickElementSelector":"#compareBottom a#next","clickType":"clickOnce","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"main_image","type":"SelectorImage","parentSelectors":["product_link"],"selector":"img#mainimage","multiple":false,"delay":0},{"id":"thumbnail_images","type":"SelectorGroup","parentSelectors":["product_link"],"selector":".inline li img","delay":0,"extractAttribute":"src"},{"id":"title","type":"SelectorText","parentSelectors":["product_link"],"selector":".prodName","multiple":false,"regex":"","delay":0},{"id":"part_number","type":"SelectorText","parentSelectors":["product_link"],"selector":".part-number span","multiple":false,"regex":"","delay":0},{"id":"warranty","type":"SelectorText","parentSelectors":["product_link"],"selector":"a.jspop-warranty","multiple":false,"regex":"","delay":0},{"id":"current_price","type":"SelectorText","parentSelectors":["product_link"],"selector":"td.base-price","multiple":false,"regex":"","delay":0},{"id":"core_price","type":"SelectorText","parentSelectors":["product_link"],"selector":"td.core-price","multiple":false,"regex":"","delay":0},{"id":"total_price","type":"SelectorText","parentSelectors":["product_link"],"selector":"td.total-price","multiple":false,"regex":"","delay":0},{"id":"description","type":"SelectorHTML","parentSelectors":["product_link"],"selector":"div#features","multiple":false,"regex":"","delay":0},{"id":"details_heading","type":"SelectorGroup","parentSelectors":["product_link"],"selector":"#prodspecs tr td:nth-of-type(1)","delay":0,"extractAttribute":""},{"id":"details_values","type":"SelectorGroup","parentSelectors":["product_link"],"selector":"#prodspecs tr td:nth-of-type(2)","delay":0,"extractAttribute":""}]}