Hello all. First of all thank you for any assistance. I have spent a number of hours trying to figure it out myself but cannot get the pagination portion to work. Currently it only acquires the data from the first page. I have tried a link selector and element click but have had no luck for it to run through all the pages.
Two things to note -
- The number of pages can change depending on the filters set (i have the first page set as the starting URL.)
- There are 25 links on each pagination. Once each page is clicked the link has a single part that changes reflecting the first number on each page. ie - the first page has the number 1 in the link. page 2 has 26, page 3 has 51 and so on...
Sitemap:
{"_id":"webscraperhelp","startUrl":["https://delcopublicaccess.co.delaware.pa.us/search/case?queryString=%2BFiledDate%20>%3D%2011%2F01%2F2019%20%2BFiledDate%20<%3D%2011%2F30%2F2019&searchFilters[0].indexFieldName=caseType&searchFilters[0].operation=%3D&searchFilters[0].values[0]=Municipal%20Lien&pagingState.startRow=226&pagingState.orderBy=filedDate%20asc"],"selectors":[{"id":"case numbers (links)","type":"SelectorLink","parentSelectors":["_root","pages2"],"selector":".ok-table-cell a","multiple":true,"delay":0},{"id":"case classification","type":"SelectorText","parentSelectors":["case numbers (links)"],"selector":"dt:contains('Classification') + dd","multiple":false,"regex":"","delay":0},{"id":"case filed date","type":"SelectorText","parentSelectors":["case numbers (links)"],"selector":"dt:contains('Filed Date') + dd","multiple":false,"regex":"","delay":0},{"id":"case number","type":"SelectorText","parentSelectors":["case numbers (links)"],"selector":"dt:contains('Case Number') + dd","multiple":false,"regex":"","delay":0},{"id":"Person 1","type":"SelectorElement","parentSelectors":["case numbers (links)"],"selector":"tbody tr:nth-of-type(1)","multiple":false,"delay":0},{"id":"Role","type":"SelectorText","parentSelectors":["Person 1"],"selector":"td","multiple":false,"regex":"","delay":0},{"id":"Name","type":"SelectorText","parentSelectors":["Person 1"],"selector":"td[data-label='Name']","multiple":false,"regex":"","delay":0},{"id":"Address","type":"SelectorText","parentSelectors":["Person 1"],"selector":"td[data-label='Address']","multiple":false,"regex":"","delay":0},{"id":"Person 2","type":"SelectorElement","parentSelectors":["Person 2"],"selector":"tr:nth-of-type(2) td","multiple":true,"delay":0},{"id":"Person 2-1","type":"SelectorElement","parentSelectors":["case numbers (links)"],"selector":"tbody tr:nth-of-type(2)","multiple":false,"delay":0},{"id":"Person 3","type":"SelectorElement","parentSelectors":["case numbers (links)"],"selector":"tbody tr:nth-of-type(3)","multiple":false,"delay":0},{"id":"Role2","type":"SelectorText","parentSelectors":["Person 2-1"],"selector":"td[data-label='Role']","multiple":false,"regex":"","delay":0},{"id":"Name2","type":"SelectorText","parentSelectors":["Person 2-1"],"selector":"td[data-label='Name']","multiple":false,"regex":"","delay":0},{"id":"Address2","type":"SelectorText","parentSelectors":["Person 2-1"],"selector":"td[data-label='Address']","multiple":false,"regex":"","delay":0},{"id":"Role 3","type":"SelectorText","parentSelectors":["Person 3"],"selector":"td[data-label='Role']","multiple":false,"regex":"","delay":0},{"id":"Name 3","type":"SelectorText","parentSelectors":["Person 3"],"selector":"td[data-label='Name']","multiple":false,"regex":"","delay":0},{"id":"Address 3","type":"SelectorText","parentSelectors":["Person 3"],"selector":"td[data-label='Address']","multiple":false,"regex":"","delay":0},{"id":"pages2","type":"SelectorLink","parentSelectors":["_root","pages2"],"selector":".pagination li:nth-of-type(n+2) a","multiple":true,"delay":0}]}