Created a quick video, just can't figure out how to have the webscrprpaer navigate mulitple dropdowns to get to the product links... Web Scraper Dropdown Naviga...
https://portal.husqvarnagroup.com/us/diamond-blades/?facet.isDiscontinued=Active%20products
Hi,
I created a click to open all dropdowns so the links are rendered in the HTML and added a subsequent link selector to scope all product links:
{"_id":"husqvarnagroup-com-1","startUrl":["https://portal.husqvarnagroup.com/us/diamond-blades/?facet.isDiscontinued=Active%20products"],"selectors":[{"clickActionType":"real","clickElementSelector":"table.b2b-qb tbody > tr:not(.b2b-qc) button.ui-az","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":0,"discardInitialElements":"discard-when-click-element-exists","id":"open-dropdowns","multiple":true,"parentSelectors":["_root"],"selector":"body","type":"SelectorElementClick"},{"id":"links","linkType":"linkFromHref","multiple":true,"parentSelectors":["_root"],"selector":".b2b-qe > span a, .ui-du a.ui-d","type":"SelectorLink"}]}
Thank you JanAp!!! I really appreciate your help... I do have a couple questions if you don't mind...
Sure, how can I help?
Zight Recording 2025-02-17 ... 
{"_id":"husqvarnagroup-com-jan","startUrl":["https://portal.husqvarnagroup.com/us/diamond-blades/?facet.isDiscontinued=Active%20products"],"selectors":[{"clickActionType":"real","clickElementSelector":"table.b2b-qb tbody > tr:not(.b2b-qc) button.ui-az","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":0,"discardInitialElements":"discard-when-click-element-exists","id":"open-dropdowns","multiple":true,"parentSelectors":["_root"],"selector":"body","type":"SelectorElementClick"},{"id":"links","linkType":"linkFromHref","multiple":true,"parentSelectors":["_root"],"selector":".b2b-qe > span a, .ui-du a.ui-d","type":"SelectorLink"},{"id":"product-quality","multiple":false,"parentSelectors":["links"],"regex":"","selector":".b2b-f0 span.label_xs","type":"SelectorText"},{"id":"product-title","multiple":false,"parentSelectors":["links"],"regex":"","selector":"h1.b2b-h0 span","type":"SelectorText"},{"id":"product-number","multiple":false,"parentSelectors":["links"],"regex":"","selector":"p[data-testid]","type":"SelectorText"},{"id":"stock-status","multiple":false,"parentSelectors":["links"],"regex":"","selector":"span.body_xxs_default","type":"SelectorText"},{"id":"variant-title","multiple":false,"parentSelectors":["links"],"regex":"","selector":".b2b-ir span","type":"SelectorText"},{"id":"our-price","multiple":false,"parentSelectors":["links"],"regex":"","selector":".b2b-g- .heading_m span","type":"SelectorText"},{"id":"product-description","multiple":false,"parentSelectors":["links"],"regex":"","selector":".b2b-dv span","type":"SelectorText"},{"id":"product-image","multiple":false,"parentSelectors":["links"],"selector":".b2b-f0 img.b2b-m4","type":"SelectorImage"},{"extractAttribute":"","id":"optimal-materials","parentSelectors":["links"],"selector":"div.body_xxs_default","type":"SelectorGroup"},{"extractAttribute":"","id":"products-using-this","parentSelectors":["links"],"selector":".b2b-hh a","type":"SelectorGroup"},{"clickActionType":"real","clickElementSelector":"button.b2b-e5","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":0,"discardInitialElements":"discard-when-click-element-exists","id":"body","multiple":true,"parentSelectors":["links"],"selector":".b2b-fx > div.b2b-f4","type":"SelectorElementClick"},{"id":"product-data-labels","multiple":false,"parentSelectors":["wrapper_for_product-data-labels_product-data-values"],"regex":"","selector":"div:nth-of-type(1) p","type":"SelectorText"},{"id":"product-data-values","multiple":false,"parentSelectors":["wrapper_for_product-data-labels_product-data-values"],"regex":"","selector":"div:nth-of-type(2) p","type":"SelectorText"},{"id":"wrapper_for_product-data-labels_product-data-values","multiple":true,"parentSelectors":["body"],"selector":".b2b-f2 div.b2b-qy:nth-of-type(n+2)","type":"SelectorElement"}]}
I discarded the click selector since the specs data is already available in the HTML without expanding the dropdown. See the 'specifications-wrapper' selector. To display each specification in a new column, a separate selector must be created for each. See the reference below:
{"_id":"husqvarnagroup-com-jan","startUrl":["https://portal.husqvarnagroup.com/us/diamond-blades/?facet.isDiscontinued=Active%20products"],"selectors":[{"clickActionType":"real","clickElementSelector":"table.b2b-qb tbody > tr:not(.b2b-qc) button.ui-az","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":0,"discardInitialElements":"discard-when-click-element-exists","id":"open-dropdowns","multiple":true,"parentSelectors":["_root"],"selector":"body","type":"SelectorElementClick"},{"id":"links","linkType":"linkFromHref","multiple":true,"parentSelectors":["_root"],"selector":".b2b-qe > span a, .ui-du a.ui-d","type":"SelectorLink"},{"id":"product-quality","multiple":false,"parentSelectors":["links"],"regex":"","selector":".b2b-f0 span.label_xs","type":"SelectorText"},{"id":"product-title","multiple":false,"parentSelectors":["links"],"regex":"","selector":"h1.b2b-h0 span","type":"SelectorText"},{"id":"product-number","multiple":false,"parentSelectors":["links"],"regex":"","selector":"p[data-testid]","type":"SelectorText"},{"id":"stock-status","multiple":false,"parentSelectors":["links"],"regex":"","selector":"span.body_xxs_default","type":"SelectorText"},{"id":"variant-title","multiple":false,"parentSelectors":["links"],"regex":"","selector":".b2b-ir span","type":"SelectorText"},{"id":"our-price","multiple":false,"parentSelectors":["links"],"regex":"","selector":".b2b-g- .heading_m span","type":"SelectorText"},{"id":"product-description","multiple":false,"parentSelectors":["links"],"regex":"","selector":".b2b-dv span","type":"SelectorText"},{"id":"product-image","multiple":false,"parentSelectors":["links"],"selector":".b2b-f0 img.b2b-m4","type":"SelectorImage"},{"extractAttribute":"","id":"optimal-materials","parentSelectors":["links"],"selector":"div.body_xxs_default","type":"SelectorGroup"},{"extractAttribute":"","id":"products-using-this","parentSelectors":["links"],"selector":".b2b-hh a","type":"SelectorGroup"},{"id":"specifications-wrapper","multiple":true,"parentSelectors":["links"],"selector":"[data-testid=\"accordion-item-specifications\"]","type":"SelectorElement"},{"id":"Type of power cutter tool","multiple":false,"parentSelectors":["specifications-wrapper"],"regex":"","selector":"[role=\"cell\"]:contains('Type of power cutter tool') +","type":"SelectorText"},{"id":"Performance level","multiple":false,"parentSelectors":["specifications-wrapper"],"regex":"","selector":"[role=\"cell\"]:contains('Performance level') +","type":"SelectorText"},{"id":"Blade configuration","multiple":false,"parentSelectors":["specifications-wrapper"],"regex":"","selector":"[role=\"cell\"]:contains('Blade configuration') +","type":"SelectorText"}]}
Thank you... let me check it out. Again, greatful for your help!!
Janis, would you be able to do paid work?
If you have a budget allocated for scraping-related tasks, I highly recommend setting up a Web Scraper Cloud account. This will provide you with access to powerful features such as proxy rotation for handling CAPTCHAs, a scraping job scheduler, automatic data export, an advanced data parser, and, of course, excellent support!