Hi Guys...
I am trying to use element click to click into a drop down box and cycle through the variants inside the box.
Once it clicks one of the variants i want it to scrape some HTML/text from three different elements which change when clicking the variant inside the drop down box
I can somewhat get this working but not correctly enough. It skips data and doesn't scrape everything and is just really problematic.
I am currently using another webscraper which works fine but its slow and buggy and i really would like to use webscraper.io This issue is the only thing holding me back from using it fully.
Here is my current sitemap:
The same issue arises across different URL product listings - but with different results.
This URL works somewhat and clicks through the list but misses/skips data(pricing): https://www.ebay.com.au/itm/283340166980
This URL just scrapes the default variant already selected in the drop down list and doesn't click through the list: https://www.ebay.com.au/itm/232744877949
{"_id":"variations","startUrl":["https://www.ebay.com.au/itm/283340166980"],"selectors":[{"id":"getvariations","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"span[id="prcIsum"],option[selected="selected"],span[id="sel-msku-variation"]","multiple":true,"delay":0,"clickElementSelector":"select.msku-sel, #vi_main_img_fs li:nth-of-type(n+14), div#test12","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueHTMLText"},{"id":"names","type":"SelectorText","parentSelectors":["getvariations"],"selector":"parent","multiple":true,"regex":"","delay":0}]}
Please, Any help would be much appreciated
I have tried a multitude of things and still cannot get it working perfectly.
I have also seen alot of other people are having real issues with the Element Click Selector and so i am hoping it's not just me being dumb. I have really tried everything i can. I have tried different element uniqueness, delays, click type, different elements to select etc etc.. The above sitemap is the best i can get it. - It atleast somewhat works.
Regards,
Richard.