Scrape with click element to get price & color/finish info

How to?
#1

Describe the problem.
Hello, brand new user here. I'd like to extract product available color/finish along with its pricing by size. I can't seem to get it to work. Could someone help guide me through it and show me what the end sitemap should look like? Thank you so much for your help

Url: https://www.homedepot.com/p/Hampton-Bay-3-5-in-W-x-62-5-in-L-Crown-White-3-5-in-Vertical-Blind-Louver-Set-9-pack-10793478810659/302456749

Sitemap:
{"_id":"homedepot_stock_top_page","startUrl":["https://www.homedepot.com/b/Window-Treatments/Quick-Ship/N-5yc1vZar4wZ1z0khnj"],"selectors":[{"id":"Product","type":"SelectorLink","parentSelectors":["_root"],"selector":".js-pod-0 .pod-plp__description a","multiple":false,"delay":0},{"id":"Finish Select","type":"SelectorElementClick","parentSelectors":["Product"],"selector":"div[data-attributename='Color/Finish'], [data-tilemessaging='Crown_Alabaster'] div","multiple":true,"delay":"2000","clickElementSelector":"div[data-attributename='Color/Finish'], [data-attributename='Color/Finish'] div.attribute__label","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueHTMLText"}]}

#2

Something along these lines should work:

{"_id":"homedepot_stock_top_page","startUrl":["https://www.homedepot.com/b/Window-Treatments/Quick-Ship/N-5yc1vZar4wZ1z0khnj"],"selectors":[{"id":"Product","type":"SelectorLink","parentSelectors":["_root"],"selector":".js-pod-0 .pod-plp__description a","multiple":false,"delay":0},{"id":"color-click","type":"SelectorElementClick","parentSelectors":["Product"],"selector":"body:has(.product-title__title)","multiple":true,"delay":"750","clickElementSelector":".swatch__image img","clickType":"clickOnce","discardInitialElements":"discard-when-click-element-exists","clickElementUniquenessType":"uniqueCSSSelector"},{"id":"size-click","type":"SelectorElementClick","parentSelectors":["color-click"],"selector":"_parent_","multiple":true,"delay":"750","clickElementSelector":".super-sku__inline-dropdown-section .drop-down__list li span a","clickType":"clickOnce","discardInitialElements":"discard-when-click-element-exists","clickElementUniquenessType":"uniqueCSSSelector"},{"id":"name","type":"SelectorText","parentSelectors":["size-click"],"selector":"h1.product-title__title","multiple":false,"regex":"","delay":0},{"id":"price","type":"SelectorText","parentSelectors":["size-click"],"selector":"span[itemprop='price']","multiple":false,"regex":"","delay":0},{"id":"color","type":"SelectorText","parentSelectors":["size-click"],"selector":"[data-attributename='Color/Finish'] span","multiple":false,"regex":"","delay":0},{"id":"size","type":"SelectorText","parentSelectors":["size-click"],"selector":".super-sku__inline-dropdown-section span.attribute__name","multiple":false,"regex":"","delay":0}]}

Although, be careful, as there are quite a lot of clicks required to extract the data, so if there are products with higher variation count than this, you RAM might not particularly enjoy it.

#3

Thank you so much @webber.
Since the data is so big, I've narrowed down to just faux wood and added a new attribute "brand".
Scraping seems to be working but no data was extracted when I exported as .csv. What did I do wrong? What should the sitemap be?

url:

SItemap (updated)
{"_id":"homedepot_fw","startUrl":["https://www.homedepot.com/b/Window-Treatments-Blinds-Faux-Wood-Blinds/Quick-Ship/N-5yc1vZbc8bZ1z0khnj"],"selectors":[{"id":"product","type":"SelectorLink","parentSelectors":["_root"],"selector":".js-pod-0 .pod-plp__description a","multiple":false,"delay":0},{"id":"color-click","type":"SelectorElementClick","parentSelectors":["product"],"selector":"body:has(.product-title__title)","multiple":true,"delay":"750","clickElementSelector":".swatch__image img","clickType":"clickOnce","discardInitialElements":"discard-when-click-element-exists","clickElementUniquenessType":"uniqueCSSSelector"},{"id":"size-click","type":"SelectorElementClick","parentSelectors":["color-click"],"selector":"parent","multiple":true,"delay":"750","clickElementSelector":".super-sku__inline-dropdown-section .drop-down__list li span a","clickType":"clickOnce","discardInitialElements":"discard-when-click-element-exists","clickElementUniquenessType":"uniqueCSSSelector"},{"id":"brand","type":"SelectorText","parentSelectors":["size-click"],"selector":".bttn--cta span","multiple":false,"regex":"","delay":0},{"id":"name","type":"SelectorText","parentSelectors":["size-click"],"selector":"h1.product-title__title","multiple":false,"regex":"","delay":0},{"id":"price","type":"SelectorText","parentSelectors":["size-click"],"selector":"span[itemprop='price']","multiple":false,"regex":"","delay":0},{"id":"color","type":"SelectorText","parentSelectors":["size-click"],"selector":"[data-attributename='Color/Finish'] span","multiple":false,"regex":"","delay":0},{"id":"size","type":"SelectorText","parentSelectors":["size-click"],"selector":".super-sku__inline-dropdown-section span.attribute__name","multiple":false,"regex":"","delay":0}]}