Describe the problem.
Struggling to scrape prices that change according to clicking on different categories, such as the test site 'ecommerce site with popup links' provided on here. No video tutorial for it yet 
Url: https://webscraper.io/test-sites/e-commerce/allinone-popup-links/product/583
Sitemap:
?
A great find. I didn't know about this specific test page on the site.This will get all the info:
{"_id":"forum-webscraper-test-site-dynamic-page","startUrl":["https://webscraper.io/test-sites/e-commerce/allinone-popup-links/product/583"],"selectors":[{"id":"Product name","type":"SelectorText","parentSelectors":["_root"],"selector":"h4:nth-of-type(2)","multiple":false,"regex":"","delay":0},{"id":"Click options","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.col-lg-10","multiple":true,"delay":"750","clickElementSelector":"div.swatches > button.btn","clickType":"clickOnce","discardInitialElements":"discard-when-click-element-exists","clickElementUniquenessType":"uniqueText"},{"id":"Selection","type":"SelectorText","parentSelectors":["Click options"],"selector":"div.swatches > button.btn-primary","multiple":false,"regex":"","delay":0},{"id":"Price","type":"SelectorText","parentSelectors":["Click options"],"selector":"h4.pull-right.price","multiple":false,"regex":"","delay":0}]}
Oh great stuff, thanks i’ll try this asap!
@leemeng I'm struggling with an application of this if you've got any ideas?
trying to scrape the different prices according to weight on this website: https://www.myprotein.com/sports-nutrition/impact-whey-protein/10530943.html
Got this far but, clicking each weight amount, but can't retrieve the amount and price !
{"_id":"myprotein","startUrl":["https://www.myprotein.com/"],"selectors":[{"id":"Category Link","type":"SelectorLink","parentSelectors":["_root"],"selector":"a.responsiveFlyoutMenu_levelOneLink-hasChildren","multiple":false,"delay":0},{"id":"Subacategory","type":"SelectorLink","parentSelectors":["Category Link"],"selector":"a[data-context='Whey Protein']","multiple":false,"delay":0},{"id":"ProductLink","type":"SelectorLink","parentSelectors":["Subacategory"],"selector":".athenaProductBlock > a","multiple":true,"delay":0},{"id":"Name","type":"SelectorText","parentSelectors":["ProductLink"],"selector":"h1.productName_title","multiple":false,"regex":"","delay":0},{"id":"image","type":"SelectorImage","parentSelectors":["ProductLink"],"selector":"img.athenaProductImageCarousel_image","multiple":false,"delay":0},{"id":"click options","type":"SelectorElementClick","parentSelectors":["ProductLink"],"selector":"div.athenaProductVariations","multiple":true,"delay":"750","clickElementSelector":"button.athenaProductVariations_box","clickType":"clickOnce","discardInitialElements":"discard-when-click-element-exists","clickElementUniquenessType":"uniqueText"},{"id":"selection","type":"SelectorText","parentSelectors":["click options"],"selector":"li.athenaProductVariations_listItem >button.athenaProductVariations_box.default","multiple":false,"regex":"","delay":0},{"id":"price","type":"SelectorText","parentSelectors":["click options"],"selector":"p.productPrice_price","multiple":false,"regex":"","delay":0}]}
Nearly there with this, still not the cleanest though:
{"_id":"myprotein","startUrl":["https://www.myprotein.com/"],"selectors":[{"id":"Category Link","type":"SelectorLink","parentSelectors":["_root"],"selector":"a.responsiveFlyoutMenu_levelOneLink-hasChildren","multiple":false,"delay":0},{"id":"Subacategory","type":"SelectorLink","parentSelectors":["Category Link"],"selector":"a[data-context='Whey Protein']","multiple":false,"delay":0},{"id":"ProductLink","type":"SelectorLink","parentSelectors":["Subacategory"],"selector":".athenaProductBlock > a","multiple":true,"delay":0},{"id":"Name","type":"SelectorText","parentSelectors":["ProductLink"],"selector":"h1.productName_title","multiple":false,"regex":"","delay":0},{"id":"image","type":"SelectorImage","parentSelectors":["ProductLink"],"selector":"img.athenaProductImageCarousel_image","multiple":false,"delay":0},{"id":"click options","type":"SelectorElementClick","parentSelectors":["ProductLink"],"selector":"div.athenaProductPage_productDetailsContainer","multiple":true,"delay":"750","clickElementSelector":"button.athenaProductVariations_box","clickType":"clickOnce","discardInitialElements":"discard-when-click-element-exists","clickElementUniquenessType":"uniqueText"},{"id":"selection","type":"SelectorText","parentSelectors":["click options"],"selector":"button.athenaProductVariations_box","multiple":true,"regex":"","delay":0},{"id":"price","type":"SelectorText","parentSelectors":["click options"],"selector":"span.productPrice_priceInfo > p.productPrice_price","multiple":true,"regex":"","delay":0}]}