I'm trying to scrape this website. (Verklaringen Nederlands Meetinstituut | CJIB.nl).
After selecting "Flitspalen" in the first dropdown menu, i want to store all the numbered items in one column (example: "3001 - Zoeterwoude-Rijndijk (N11)") :
after that I want to store all the items of the dropdown form-wrapper in a second column (related to the first column):
I watched all the tutorials but i cant figure it out. Thank you for helping!
@koi Hello, it is possible to be done using an 'Element click' selector in a combination with the 'Element' selector.
Example:
{"_id":"cjib-nl","startUrl":["https://www.cjib.nl/verklaringen-nederlands-meetinstituut"],"selectors":[{"clickElementSelector":"select[name='category'] option:contains(\"Flitspalen\")","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":1200,"discardInitialElements":"do-not-discard","id":"click-1","multiple":true,"parentSelectors":["_root"],"selector":"body","type":"SelectorElementClick"},{"delay":0,"id":"wrapper","multiple":true,"parentSelectors":["_root"],"selector":"summary[data-filter-province]","type":"SelectorElement"},{"delay":0,"id":"name","multiple":false,"parentSelectors":["wrapper"],"regex":"","selector":"_parent_","type":"SelectorText"}]}
Thank you for the quick response. With the presented JSON, i receive the first part (the numbered items) but not the second part (information in the dropdown form-wrapper).
Can you help me with receiving the information necessary for the second column? Thank you in advance.
@koi Hi, to scrape all of the data that can be found under the sub-dropdown you will have to create an additional 'Element click' selector and extra 'Element' selectors to target each of the rows.
Example:
{"_id":"cjib-nl","startUrl":["https://www.cjib.nl/verklaringen-nederlands-meetinstituut"],"selectors":[{"clickElementSelector":"select[name='category'] option:contains(\"Flitspalen\")","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":1200,"discardInitialElements":"do-not-discard","id":"click-1","multiple":true,"parentSelectors":["_root"],"selector":"body","type":"SelectorElementClick"},{"delay":0,"id":"name","multiple":false,"parentSelectors":["wrapper-details"],"regex":"","selector":"summary","type":"SelectorText"},{"delay":0,"id":"details","multiple":true,"parentSelectors":["wrapper-details"],"selector":"li.m-list--wob__item","type":"SelectorElement"},{"delay":0,"id":"name-1","multiple":false,"parentSelectors":["details"],"regex":"","selector":"_parent_","type":"SelectorText"},{"clickElementSelector":"summary[data-filter-province][aria-expanded='false']","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":2000,"discardInitialElements":"do-not-discard","id":"click-2","multiple":true,"parentSelectors":["_root"],"selector":"body","type":"SelectorElementClick"},{"delay":0,"id":"wrapper-details","multiple":true,"parentSelectors":["_root"],"selector":"details.form-wrapper","type":"SelectorElement"}]}
