Hi there i am trying to scrape content from
i can scrape only the names but i want to scrape the content inside the url like address and phone number for example.It looks that that the content in the URL is java script.Is it posible or not some how?
Thank you
Url: http://example.com
Sitemap:
{id:"sitemap code"}
@rodmans Hi. There shouldn't be any issues to retreive the desired data.
Should increase the page load delay to something like 5000 due to the slow loading pace of this website.
Sitemap example:
{"_id":"creativeworld-meesefrakfurt","startUrl":["https://creativeworld.messefrankfurt.com/frankfurt/en/exhibitor-search.html"],"selectors":[{"id":"wrapper","type":"SelectorElement","parentSelectors":["_root"],"selector":".ex-exhibitor-search-results > div > div > div > div:has(h4.ex-exhibitor-search-result-item__headline)","multiple":true,"delay":0},{"id":"content","type":"SelectorText","parentSelectors":["wrapper"],"selector":"p","multiple":false,"regex":"","delay":0},{"id":"url","type":"SelectorLink","parentSelectors":["wrapper"],"selector":"a","multiple":false,"delay":0},{"id":"card","type":"SelectorElement","parentSelectors":["url"],"selector":"body:has(h1.ex-exhibitor-detail__title-headline)","multiple":true,"delay":0},{"id":"telephone","type":"SelectorText","parentSelectors":["card"],"selector":"a.ex-contact-box__address-field-tel-number","multiple":false,"regex":"","delay":0},{"id":"address","type":"SelectorGroup","parentSelectors":["card"],"selector":"div.ex-contact-box__address-field > p","delay":0,"extractAttribute":""}]}
@viesturs
Awesome thanks but how to get all of the from A to Z it scrapes only 26 results?
The pagination is the problem now because if i select only A the Url dont change.