Are numbers scrapable if visible after a click?

How to?
#1

I am completely stuck in creating a correct sitemap, pagination is not working and I do not know if it is possible to capture telephone numbers which only appear after a click. I would like to scrape the following information for all the accounts (this is, f.e., the first one that appears)

  1. Clinica Dentes
  2. Dentisti Medici Chirurghi ed
  3. Via Arenazza, 85, MONOPOLI (BA) PUGLIA
  4. Phone number
    5- If possible the email as well

Url: Dentisti Medici Chirurghi ed Odontoiatri a Bari e dintorni

Thank you

#2

there is no need to click, because the phone number is laying in the source code...
easy ))
image

#3

Ok :slight_smile: thank you! Same with the email? Would you be so kind to send me the complete sitemap? (I'm not an expert and I'm not sure how to create it right. Thank you

#4

Hi,

Here is a reference on scraping the telephone nr., email does not seem to be available in the HTML, unfortunately:

{"_id":"virgilio","startUrl":["https://www.virgilio.it/italia/bari/cat/DENTISTI_MEDICI_CHIRURGHI_ED_ODONTOIATRI_(1).html?azi_eq_iq=2d896532-1d68-4b18-a50d-e6fb87f5f7ad"],"selectors":[{"elementLimit":0,"id":"listing-wrapper","multiple":true,"parentSelectors":["_root"],"scroll":false,"selector":"div.anagrafica_azienda","type":"SelectorElement"},{"id":"title","multiple":false,"multipleType":"singleColumn","parentSelectors":["listing-wrapper"],"regex":"","selector":"span.pagante-icon","type":"SelectorText"},{"id":"telephone","multiple":false,"multipleType":"singleColumn","parentSelectors":["listing-wrapper"],"regex":"","selector":"[id*=\"aziTelN2_\"] .cta-label","type":"SelectorText"}]}
#5

Also, have a quick look at the tutorials to have a better understanding of sitemap construction: Extension intro | Web Scraper How To

#6

Thank you again! I have checked the tutorials and have added pagination name and address. The pagination seems to work but the name and address for pages after n.1 are "fixed" and do not correspond to the actual telephone numbers which are instead correctly scraped. Would you know what I'm doing wrong?
Sitemap: {"id":"Dentisti_Bari_pagination","startUrl":["https://www.virgilio.it/italia/bari/cat/DENTISTI_MEDICI_CHIRURGHI_ED_ODONTOIATRI(1).html?azi_eq_iq=2d896532-1d68-4b18-a50d-e6fb87f5f7ad"],"selectors":[{"id":"title","multiple":false,"multipleType":"singleColumn","parentSelectors":["listing-wrapper"],"regex":"","selector":"span.pagante-icon","type":"SelectorText"},{"id":"telephone","multiple":false,"multipleType":"singleColumn","parentSelectors":["listing-wrapper"],"regex":"","selector":"[id*="aziTelN2_"] .cta-label","type":"SelectorText"},{"id":"Pagination","paginationType":"auto","parentSelectors":["_root","Pagination"],"selector":"a.bgc10","type":"SelectorPagination"},{"elementLimit":0,"id":"listing-wrapper","multiple":true,"parentSelectors":["Pagination"],"scroll":false,"selector":"div.anagrafica_azienda","type":"SelectorElement"},{"id":"Nome","multiple":false,"multipleType":"singleColumn","parentSelectors":["Pagination"],"regex":"","selector":"h3[itemprop='name']","type":"SelectorText"},{"id":"Indirizzo","multiple":false,"multipleType":"singleColumn","parentSelectors":["Pagination"],"regex":"","selector":"div.anagrafica_azienda","type":"SelectorText"}]}

#7

Please post the sitemap as Preformatted text

code

#8 
{"_id":"Dentisti_Bari_pagination","startUrl":["https://www.virgilio.it/italia/bari/cat/DENTISTI_MEDICI_CHIRURGHI_ED_ODONTOIATRI_(1).html?azi_eq_iq=2d896532-1d68-4b18-a50d-e6fb87f5f7ad"],"selectors":[{"id":"title","multiple":false,"multipleType":"singleColumn","parentSelectors":["listing-wrapper"],"regex":"","selector":"span.pagante-icon","type":"SelectorText"},{"id":"telephone","multiple":false,"multipleType":"singleColumn","parentSelectors":["listing-wrapper"],"regex":"","selector":"[id*=\"aziTelN2_\"] .cta-label","type":"SelectorText"},{"id":"Pagination","paginationType":"auto","parentSelectors":["_root","Pagination"],"selector":"a.bgc10","type":"SelectorPagination"},{"elementLimit":0,"id":"listing-wrapper","multiple":true,"parentSelectors":["Pagination"],"scroll":false,"selector":"div.anagrafica_azienda","type":"SelectorElement"},{"id":"Nome","multiple":false,"multipleType":"singleColumn","parentSelectors":["Pagination"],"regex":"","selector":"h3[itemprop='name']","type":"SelectorText"},{"id":"Indirizzo","multiple":false,"multipleType":"singleColumn","parentSelectors":["Pagination"],"regex":"","selector":"div.anagrafica_azienda","type":"SelectorText"}]}
#9
  1. Pagination. You should always target only the 'next page' button if available.
  2. The data selectors must be children of the wrapper to align.
{"_id":"Dentisti_Bari_pagination","startUrl":["https://www.virgilio.it/italia/bari/cat/DENTISTI_MEDICI_CHIRURGHI_ED_ODONTOIATRI_(1).html?azi_eq_iq=2d896532-1d68-4b18-a50d-e6fb87f5f7ad"],"selectors":[{"id":"title","multiple":false,"multipleType":"singleColumn","parentSelectors":["listing-wrapper"],"regex":"","selector":"h3","type":"SelectorText"},{"id":"telephone","multiple":false,"multipleType":"singleColumn","parentSelectors":["listing-wrapper"],"regex":"","selector":"[id*=\"aziTelN2_\"] .cta-label","type":"SelectorText"},{"id":"Pagination","paginationType":"auto","parentSelectors":["_root","Pagination"],"selector":"a[title=\"Avanti\"]","type":"SelectorPagination"},{"elementLimit":0,"id":"listing-wrapper","multiple":true,"parentSelectors":["Pagination"],"scroll":false,"selector":"div.anagrafica_azienda","type":"SelectorElement"}]}
1 Like