Describe the problem:
Hi!
I am trying to scrap the vehicle engine specs from Edmunds. To see all the trims, I need to click twice to switch to a new one. I have tried the option method from the tutorials, however, it would not work since these are buttons to click.
I am here using the ford f150 as an example. Is it possible to scrape all the trims?
Thanks!
Url: https://www.edmunds.com/ford/f-150/2021/supercab/features-specs/
Something like this:
{"_id":"forum-edmunds-b","startUrl":["https://www.edmunds.com/ford/f-150/2021/supercab/features-specs/"],"selectors":[{"id":"Vehicle","type":"SelectorText","parentSelectors":["_root"],"selector":"div > h1","multiple":false,"regex":"" },{"id":"Click all dropdown","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"#Overview-section-title-content table","multiple":true,"delay":"3500","clickElementSelector":"#Overview-section-title-content thead div.dropdown-wrapper div[role='menu'] > button[tabindex]","clickType":"clickOnce","discardInitialElements":"discard-when-click-element-exists","clickElementUniquenessType":"uniqueText"},{"id":"Model","type":"SelectorText","parentSelectors":["Click all dropdown"],"selector":"div.custom-dropdown-label div.font-weight-bold[title]","multiple":false,"regex":"" },{"id":"Engine","type":"SelectorText","parentSelectors":["Click all dropdown"],"selector":"div.custom-dropdown-label div.text-truncate.field.medium","multiple":false,"regex":"" },{"id":"MSRP","type":"SelectorText","parentSelectors":["Click all dropdown"],"selector":"div:contains('MSRP') div.heading-3","multiple":false,"regex":"" },{"id":"Engine Type","type":"SelectorText","parentSelectors":["Click all dropdown"],"selector":"tr:contains('Engine Type') td","multiple":false,"regex":"" }]}