I am planning to scrape data from websites with separate departments, name and email. I got the code already for scraping the name and email but how can I scrape data from multiple departments, the url is changing in every department. I tried copying each link but I find it to be tedious for sites with 20+ departments.
Sitemap code without pagination 'cuz I can't figure it out:
{"_id":"Site","startUrl":["https://www.edgefield.k12.sc.us/Page/432"],"selectors":[{"id":"Element","parentSelectors":["_root"],"type":"SelectorElement","selector":"div.staff:nth-of-type(n+8)","multiple":true},{"id":"Name","parentSelectors":["Element"],"type":"SelectorText","selector":"li.staffname","multiple":false,"regex":""},{"id":"Email","parentSelectors":["Element"],"type":"SelectorText","selector":"a","multiple":false,"regex":""}]}