Any ideas? Been struggling with how to export all of these records. What I have so far seems to crash after it gets to the 3rd page and doesn't show me any records.
Need to paginate through all 13 pages. Ideally it would also click on the "view details" pop-up and export all of that information. I have a workaround where I found most of the info in the HTML, but still missing the license number which is important.
The url doesn't change when changing pages. It seems to use javascript calls to handle these functions.
Url: https://www.iframeapps.dcnr.state.pa.us/Topogeo/LicensedDrillers/default.aspx
Sitemap:
{"_id":"padrillersframe","startUrl":["https://www.iframeapps.dcnr.state.pa.us/Topogeo/LicensedDrillers/default.aspx"],"selectors":[{"id":"pagination","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"#gvReportResults tr:nth-of-type(n+3)","multiple":true,"delay":"2000","clickElementSelector":"input[alt='>']","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"Company","type":"SelectorText","parentSelectors":["pagination"],"selector":"td:nth-of-type(1)","multiple":false,"regex":"","delay":0},{"id":"City","type":"SelectorText","parentSelectors":["pagination"],"selector":"td:nth-of-type(2)","multiple":false,"regex":"","delay":0},{"id":"details","type":"SelectorElementAttribute","parentSelectors":["pagination"],"selector":"td:nth-of-type(7) a","multiple":false,"extractAttribute":"title","delay":0},{"id":"State","type":"SelectorText","parentSelectors":["pagination"],"selector":"td:nth-of-type(3)","multiple":false,"regex":"","delay":0},{"id":"Phone","type":"SelectorText","parentSelectors":["pagination"],"selector":"td:nth-of-type(4)","multiple":false,"regex":"","delay":0}]}