Hello!
I would like your help for scraping this website
Url: https://www.doctoralia.com.mx/especialidades-medicas
My goal is to get the Doctors' informations (Name, speciality, address and phone number).
So for starting, I think I should create my Sitemap from https://www.doctoralia.com.mx/especialidades-medicas
After that, I will have all the links visible and now I can go on the doctors' informations.
It seems ok to get all the doctors with the pagination
-
My concerns for this page are that I can have several addresses or nothing and I do not know how to scrap them and moreover in one line (in the result). Is it also a kind of pagination to deal with?
For each line, I would like to get it in the result file (which would be each doctor) these informations and not to write it at the next line (not sure to be clear). 1 line = 1 doctor = 0 or more addresses. What should I use for? -
Then, to get the phone number I have to click on the Dr's name and then on the "mostrar numero" like for this one https://www.doctoralia.com.mx/gaston-pumarejo/fisioterapeuta/atizapan-de-zaragoza?address-id=129551#address-id=%5B129551%5D&filters%5Bspecializations%5D%5B%5D=24
It can have it or not. What should I use for?
I have tried with a regex but I am not able to get only the number instead of <a href tel: ...
- How can I finally have a csv file with Doctors' informations (Name, speciality, address and phone number) and only that?
Thank you very much by advance for your help.
Sitemap:
{"_id":"final","startUrl":["https://www.doctoralia.com.mx/especialidades-medicas"],"selectors":[{"id":"Speciality_click","type":"SelectorLink","parentSelectors":["_root"],"selector":"div.col-sm-6:nth-of-type(1) .display-flex a.text-muted","multiple":true,"delay":0},{"id":"pagination","type":"SelectorLink","parentSelectors":["Speciality_click","pagination"],"selector":".pagination li:nth-of-type(n+2) a","multiple":true,"delay":0},{"id":"dr_links","type":"SelectorLink","parentSelectors":["Speciality_click","pagination"],"selector":"a[itemprop='name']","multiple":true,"delay":0},{"id":"name","type":"SelectorText","parentSelectors":["dr_links"],"selector":"div.unified-doctor-header-info__name","multiple":false,"regex":"","delay":0},{"id":"specialite","type":"SelectorText","parentSelectors":["dr_links"],"selector":"h2.h4","multiple":true,"regex":"","delay":0},{"id":"cell","type":"SelectorHTML","parentSelectors":["dr_links"],"selector":"#address-89001-tab div.offset-right-1","multiple":true,"regex":"href="tel:\d{3} \d{3} \d{4}"","delay":0}]}