Help with pagination problem

#1

Hello can someone help me with this kind of pagination where the url isn't changing. I am trying to scrape the first name, last name, and email on this site but I found some problem with my pagination and don't know how to fix it.

Site: https://www.lcss.us/jcbc

{"_id":"NameEmailMultiplePages","startUrl":["https://www.lcss.us/jcbc"],"selectors":[{"id":"Pagination","parentSelectors":["_root","Pagination"],"paginationType":"clickOnce","selector":".dWWkhH svg:nth-of-type(2)","type":"SelectorPagination"},{"id":"Last Name","parentSelectors":["Pagination"],"type":"SelectorElement","selector":"td:nth-of-type(1) div.L0MOmM","multiple":true},{"id":"Name","parentSelectors":["Last Name"],"type":"SelectorText","selector":"div","multiple":false,"regex":""},{"id":"First Name","parentSelectors":["Pagination"],"type":"SelectorElement","selector":"td:nth-of-type(2) div.L0MOmM","multiple":true},{"id":"Email","parentSelectors":["Pagination"],"type":"SelectorElement","selector":"td:nth-of-type(3) div.L0MOmM","multiple":true},{"id":"Name2","parentSelectors":["First Name"],"type":"SelectorText","selector":"div","multiple":false,"regex":""},{"id":"Email2","parentSelectors":["Email"],"type":"SelectorText","selector":"div","multiple":false,"regex":""}]}

#2

Hi, you can try the "Element click" Type to flip trough pages and scrape the data in Table format. Cheers

{"_id":"NameEmailMultiplePages","startUrl":["https://www.lcss.us/jcbc"],"selectors":[{"id":"next-page-click","parentSelectors":["_root"],"type":"SelectorElementClick","clickActionType":"real","clickElementSelector":"[data-testid=\"page-next\"]","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickMore","delay":1000,"discardInitialElements":"do-not-discard","multiple":true,"selector":"_parent_"},{"id":"data-table","parentSelectors":["next-page-click"],"type":"SelectorTable","multiple":true,"selector":"table","tableDataRowSelector":"tr.dsil2C","tableHeaderRowSelector":"thead","columns":[{"extract":true,"header":"Last Name","name":"Last Name"},{"extract":true,"header":"First Name","name":"First Name"},{"extract":true,"header":"Email","name":"Email"},{"extract":false,"header":"Position","name":"Position"},{"extract":false,"header":"Dept/Subject","name":"Dept/Subject"},{"extract":false,"header":"Grade","name":"Grade"}]}]}
1 Like