I'm trying to scrape this webpage: https://www.barbican.org.uk/whats-on/classical-music
There's an infinite scroll and I can't get it to work. I have done previously but I seem to be getting errors.
What's the correct ID for the scroll element?
Try the sitemap below. I've made the scroller stop at line 15 (it'll usually scrape a few more after that). If you want to get more lines, just change the number in the scroller selector, .views-infinite-scroll-content-wrapper > div:nth-of-type(-n+15).
If you want to scroll without limits (usually a bad idea), you can remove the nth child, infinite-scroll-content-wrapper > div
{"_id":"barbican_scroll","startUrl":["https://www.barbican.org.uk/whats-on/classical-music"],"selectors":[{"id":"scroller","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":".views-infinite-scroll-content-wrapper > div:nth-of-type(-n+15)","multiple":true,"delay":"2500"},{"id":"ensemble","type":"SelectorText","parentSelectors":["scroller"],"selector":"div.search-listing__flex-container > div.listing-title-wrapper","multiple":false,"regex":"","delay":0},{"id":"date","type":"SelectorText","parentSelectors":["scroller"],"selector":"div.search-listing__intro > div:nth-child(1)","multiple":false,"regex":"","delay":0}]}