Difficult Alphabetized and number page

How to?
#1

Hi, thank you for anyone willing to help me with this problem.
I need to scrape physician data from a hospital website, the problem is the website dos not display all the doctors at once, but user needs to first select the Alphabet first then select the pages under said alphabet.
Below are screnshot of the page :

msedge_20240104-162930649-162
msedge_20240104-162930649-162607×862 32.5 KB

Thank you again for anyone willing to help me with this !

Url: Specialists | Mount Elizabeth Hospitals
Sitemap:
{"_id":"MountElizabethNovena_Dokter","startUrl":["Specialists | Mount Elizabeth Hospitals a.enabled-name","multiple":true,"linkType":"linkFromHref"},{"id":"pagination","parentSelectors":["alphabet","pagination"],"paginationType":"auto","type":"SelectorPagination","selector":"a.page-link"},{"id":"container","parentSelectors":["pagination"],"type":"SelectorElement","selector":"div.item-content","multiple":true},{"id":"name","parentSelectors":["container"],"type":"SelectorText","selector":"b","multiple":false,"regex":""},{"id":"specialties","parentSelectors":["container"],"type":"SelectorText","selector":"p","multiple":false,"regex":""}]}

#2

Hi, here you go, you can use this sitemap as a reference for pagination:

{"_id":"mountelizabeth","startUrl":["https://www.mountelizabeth.com.sg/patient-services/specialists?hospital=mount-elizabeth-hospital"],"selectors":[{"id":"pagination","paginationType":"auto","parentSelectors":["_root","pagination"],"selector":"[class=\"pagination\"]:not(:has([class*=\"next\"])) [class*=\"page-item\"], [class*=\"next\"]","type":"SelectorPagination"},{"id":"listing","multiple":true,"parentSelectors":["pagination"],"selector":"div.item-content","type":"SelectorElement"},{"id":"name","multiple":false,"parentSelectors":["listing"],"regex":"","selector":"h5 b","type":"SelectorText"},{"id":"field","multiple":false,"parentSelectors":["listing"],"regex":"","selector":"p.detail-designation","type":"SelectorText"}]}

Cheers

#3

Thank you so much! :pray:

#4

Btw, if you dont mind, may i ask some question ?
How did you get the selectors for the pagination ?
Your selectors for the "Next" button :

Blockquote
[class="pagination"]:not(:has([class*="next"])) [class*="page-item"], [class*="next"]

When i click the "Next" button using pagination this is what i get :

Blockquote
.next a

screenshot below :

msedge_20240105-110410231-164
msedge_20240105-110410231-164988×883 49.1 KB

#5

Initially, I created it manually, since for the letter A for example the next arrow did not exist. But then I noticed that if you open the page in a new window, all the listings are displayed at once and there is no need to go through the letters. So basically the pagination should work only with .next a

#6

i see, thank you so much for your help ! :pray: