Describe the problem.
I would like to figure out how to scrape the address, activity, and disposition off of a website, but do not know how to work around the dropdown for the date. Any advice?
P.S. I am very much a novice to this so I may need someone to dumb it down.
@ctrip Hi. In order to load the updated table for each of the dates, the page has to be reloaded.
Unfortunately, an 'Element click' selector will not keep functioning if the page is reloaded, therefore, the most viable option to scrape this data will require creating a separate sitemap for each of the desired dates.
Example:
{"_id":"iowa-city-org","startUrl":["https://www.iowa-city.org/IcgovApps/police/activitylog?Length=11"],"selectors":[{"clickElementSelector":"select option:contains(\"4/11/2022\")","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":1000,"discardInitialElements":"do-not-discard","id":"click-1","multiple":true,"parentSelectors":["_root"],"selector":"body","type":"SelectorElementClick"},{"clickElementSelector":"body:has(h2:not(:contains(\"Police Activity on 4/11/2022\"))) input","clickElementUniquenessType":"uniqueText","clickType":"clickMore","delay":1200,"discardInitialElements":"do-not-discard","id":"click-2","multiple":true,"parentSelectors":["_root"],"selector":"body","type":"SelectorElementClick"},{"delay":0,"id":"table","multiple":true,"parentSelectors":["_root"],"selector":"tbody tr","type":"SelectorElement"},{"delay":0,"id":"dispatch-number","multiple":false,"parentSelectors":["table"],"regex":"","selector":"td:nth-of-type(1)","type":"SelectorText"},{"delay":0,"id":"address","multiple":false,"parentSelectors":["table"],"regex":"","selector":"td:nth-of-type(2)","type":"SelectorText"},{"delay":0,"id":"activity","multiple":false,"parentSelectors":["table"],"regex":"","selector":"td:nth-of-type(3)","type":"SelectorText"},{"delay":0,"id":"disposition","multiple":false,"parentSelectors":["table"],"regex":"","selector":"td:nth-of-type(4)","type":"SelectorText"},{"delay":0,"id":"details","multiple":false,"parentSelectors":["table"],"regex":"","selector":"td:nth-of-type(5)","type":"SelectorText"}]}
Hope it helps.