Describe the problem.
I need to scrape personnel details from the link mentioned below. There are three steps I want to do:
- I need to select each of the options seperately from the drop down next to 'select cadre' and click on select.
- This leads to a table of information popping up (without a change in the url). I then want to click on each of the urls in the table which will lead me to a pop up.
- From this pop up I want to scrape all the personnel details.
I am unable to get the first step done though! I have tried element click and element attribute to no avail. It always returns no data once I press 'scrape'. What am I doing wrong?
All comments appreciated!
Url: https://supremo.nic.in/knowyourofficerIAs.aspx
Sitemap:
{"_id":"iasofficer","startUrl":["https://supremo.nic.in/knowyourofficerIAs.aspx"],"selectors":[{"id":"cadrelink","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"li.search-field input, ul.chosen-choices","multiple":false,"delay":"5","clickElementSelector":"input#btnSubmit.btn","clickType":"clickOnce","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"},{"id":"officerlink","type":"SelectorPopupLink","parentSelectors":["cadrelink"],"selector":"u a","multiple":false,"delay":0},{"id":"name","type":"SelectorText","parentSelectors":["officerlink"],"selector":"tr:contains('Name :') td:nth-of-type(2)","multiple":false,"regex":"","delay":0}]}