Site: CPSO - Doctor Search
I'm like 90% of the way there with my site map, I have the tool set to arrange the search form with my desired parameters, submit the search request, and it scrapes the first results page perfectly but gets hung up after with the following error:
- ACCESSING_UNDEFINED_ELEMENT 1 probably page was reloaded at getText with [1]
I'm assuming it's the way the site handles pagination - my current sitemap uses the pagination function but I've also tried developing a map using element click with worse results. Any insight would be appreciated!
Current sitemap for reference:
{"_id":"cpso-search","startUrl":["https://www.cpso.on.ca/Public/Doctor-Search"],"selectors":[{"id":"submit click","parentSelectors":["_root"],"type":"SelectorElementClick","clickActionType":"real","clickElementSelector":"input#p_lt_ctl01_pageplaceholder_p_lt_ctl02_CPSO_AllDoctorsSearch_btnSubmit1","clickElementUniquenessType":"uniqueText","clickType":"clickOnce","delay":2000,"discardInitialElements":"do-not-discard","multiple":false,"selector":"input#p_lt_ctl01_pageplaceholder_p_lt_ctl02_CPSO_AllDoctorsSearch_btnSubmit1"},{"id":"pageination","parentSelectors":["_root","pageination"],"paginationType":"auto","type":"SelectorPagination","selector":".doctor-search-paging nav"},{"id":"search-results-doctorname","parentSelectors":["wrapper_for_search-results-doctorname_search-doctorinfo"],"type":"SelectorText","selector":"h3","multiple":false,"regex":""},{"id":"search-doctorinfo","parentSelectors":["wrapper_for_search-results-doctorname_search-doctorinfo"],"type":"SelectorText","selector":"p:nth-of-type(1)","multiple":false,"regex":""},{"id":"wrapper_for_search-results-doctorname_search-doctorinfo","parentSelectors":["pageination"],"type":"SelectorElement","selector":"article","multiple":true}],"websiteStateSetup":{"enabled":true,"performWhenNotFoundSelector":"input#p_lt_ctl01_pageplaceholder_p_lt_ctl02_CPSO_AllDoctorsSearch_btnSubmit1","actions":[{"selector":"button.open_adv_search","type":"click"},{"selector":"label[for='rdoDocTypeFamly']","type":"click"}]}}