Impossible to scrape because of auto-loader

How to?
#1

Hello,
I tried to scrape a website for the first time. i'm able to get all the informations i need but only on few items because there are an auto-loader and i can't find a way to bypass it. Have you some tips about it ? Thanks

the website source : https://licklist.co.uk/venues

My Sitemap:
{"_id":"licklist","startUrl":["https://licklist.co.uk/venues"],"selectors":[{"id":"venue-link","type":"SelectorLink","parentSelectors":["_root"],"selector":"h2 a","multiple":true,"delay":0},{"id":"Address","type":"SelectorText","parentSelectors":["venue-link"],"selector":"div.address","multiple":false,"regex":"","delay":0},{"id":"email","type":"SelectorText","parentSelectors":["venue-link"],"selector":".email div","multiple":false,"regex":"","delay":0},{"id":"Website","type":"SelectorText","parentSelectors":["venue-link"],"selector":".website div","multiple":false,"regex":"","delay":0},{"id":"type","type":"SelectorText","parentSelectors":["venue-link"],"selector":"div.categories__category__values","multiple":false,"regex":"","delay":0},{"id":"","type":"SelectorText","parentSelectors":["_root"],"selector":"","multiple":false,"regex":"","delay":0}]}

#2

Hello,

Maybe you can try with Element scroll. example below:
{"_id":"licklist","startUrl":["https://licklist.co.uk/venues"],"selectors":[{"id":"scroll","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":".list-element div.row","multiple":true,"delay":"1500"}]}

The page is goig to be loaded then you can start your scrape similarly to what you've done it for the first 12 venues.

Hope this help.
David

#3

Hi David, Thank you for your answer. I try it on a smaller category and it's works perfectly ! :pray: