Hi,
Im trying to scrape the details of each and every location here
this is the sitemap but im getting only some results
{"_id":"wolt","startUrl":["Wolt – Wolt .AllergyInfo__phone___24l9L span","multiple":false,"regex":"","delay":0}]}
what am i missing?
thanks!
this is the sitemap
{"_id":"wolt_andre2","startUrl":["Wolt – Wolt .AllergyInfo__phone___24l9L span","multiple":false,"regex":"","delay":0}]}
Blockquote
{"_id":"wolt_andre2","startUrl":["Wolt – Wolt .AllergyInfo__phone___24l9L span","multiple":false,"regex":"","delay":0}]}
Blockquote
{"_id":"wolt_andre2","startUrl":["https://wolt.com/en/swe/stockholm/discovery/category-burgers"],"selectors":[{"id":"cards","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":".ListPage__wrapper___v7CEM","multiple":false,"delay":"5000"},{"id":"pages","type":"SelectorLink","parentSelectors":["cards"],"selector":"a","multiple":true,"delay":0},{"id":"name","type":"SelectorText","parentSelectors":["pages"],"selector":"h1","multiple":false,"regex":"","delay":0},{"id":"address1","type":"SelectorText","parentSelectors":["pages"],"selector":"div.VenueSideInfo__primary___1_CZS","multiple":false,"regex":"","delay":0},{"id":"address2","type":"SelectorText","parentSelectors":["pages"],"selector":"div.VenueSideInfo__secondary___1Sd3q","multiple":false,"regex":"","delay":0},{"id":"phone","type":"SelectorText","parentSelectors":["pages"],"selector":".VenueSideInfo__venueInformation___31X6t .AllergyInfo__phone___24l9L span","multiple":false,"regex":"","delay":0}]}Hi, @eldoland Cards should be more specified, I think. I made a bit different approach.
Here's my edit:
{"_id":"wolt_andre2","startUrl":["https://wolt.com/en/swe/stockholm/discovery/category-burgers"],"selectors":[{"id":"cards","type":"SelectorElement","parentSelectors":["_root"],"selector":"div.DiscoveryVenueListItem__listItem___2jWVS","multiple":true,"delay":0},{"id":"pages","type":"SelectorLink","parentSelectors":["cards"],"selector":"a","multiple":false,"delay":0},{"id":"name","type":"SelectorText","parentSelectors":["element"],"selector":"h1","multiple":false,"regex":"","delay":0},{"id":"address1","type":"SelectorText","parentSelectors":["element"],"selector":"div.VenueSideInfo__primary___1_CZS","multiple":false,"regex":"","delay":0},{"id":"address2","type":"SelectorText","parentSelectors":["element"],"selector":"div.VenueSideInfo__secondary___1Sd3q","multiple":false,"regex":"","delay":0},{"id":"phone","type":"SelectorText","parentSelectors":["element"],"selector":".VenueSideInfo__venueInformation___31X6t .AllergyInfo__phone___24l9L span","multiple":false,"regex":"","delay":0},{"id":"scroll","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"body:has(h1[data-test-id=\"DiscoveryPageTitle\"])","multiple":true,"delay":2000},{"id":"element","type":"SelectorElement","parentSelectors":["pages"],"selector":"body:has(span[data-localization-key])","multiple":true,"delay":0}]}
thanks a lot @ViestursWS !
btw i get only 25 results
https://monosnap.com/file/FAcEm9MVkoKKUmqi0kBuqBOxv5cR91
how can we get them all?
thanks!
@eldoland
After the code inspection of this site, I came to the conclusion that it's not really possible because the pointer it has, after you perform the scroll the upper divisions are disappearing and new ones are coming in and reverse so, therefore, it can't extract all of the information only some parts of it. If there would be a way to disable the pointer everything would work fine.
