Infinite Scroll Loop

How to?
#1

I would like to scrape names of artists in an infinite scroll loop.

Unfortunately it only scrolls three times and then the whole scraping ends. I want to scrape as much as data as possible.

Url: https://goout.net/en/artists/

Sitemap:
{"_id":"gooutartists","startUrl":["https://goout.net/en/artists/"],"selectors":[{"id":"Artist names","type":"SelectorText","parentSelectors":["scrolldown"],"selector":"h3.name a","multiple":true,"regex":"","delay":"0"},{"id":"scrolldown","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"div.js-ga-content-group > div.newContent","multiple":true,"delay":"2000"}]}

#2

You selected the box elements in bulk, should have clicked on them separately.
Try this, should be working.

{"_id":"scroll-sitemap-fixed","startUrl":["https://goout.net/en/artists/"],"selectors":[{"id":"scrolldown","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"div.listBoxed div.item","multiple":true,"delay":"2000"},{"id":"name","type":"SelectorText","parentSelectors":["scrolldown"],"selector":"h3.name a","multiple":false,"regex":"","delay":0}]}
#3

Thank you. Now it scrolls!
However, when I close the window and scraping ends, I don't see any data scraped. It is empty.

#4

The data will only show up when the scraper has finished scraping, just give it a minute and everything should appear.

#5

Thanks. I also tried to get elements and extract name + country from them.

It scrolled down the bottom of the page but for some reason could not find the elements, hence no data were scraped.

Do you have any idea what may be the problem?

{"_id":"pokus","startUrl":["https://goout.net/en/artists/?tag=performing-soon"],"selectors":[{"id":"scrolldown","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"div.listBoxed div.item","multiple":true,"delay":"2000"},{"id":"artist-element","type":"SelectorElement","parentSelectors":["scrolldown"],"selector":"div.listBoxed div.item","multiple":true,"delay":0},{"id":"artist-name","type":"SelectorText","parentSelectors":["artist-element"],"selector":"h3.name a","multiple":false,"regex":"","delay":0},{"id":"artist-country","type":"SelectorText","parentSelectors":["artist-element"],"selector":"div.second","multiple":false,"regex":"","delay":0}]}
#6

You have already have selected the element with the ElementClick selector, so adding another element selector was not needed, you can jump straight into scraping the the artists name and country of origin.
This should solve your problem:

{"_id":"pokus-fixed","startUrl":["https://goout.net/en/artists/?tag=performing-soon"],"selectors":[{"id":"scrolldown","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"div.listBoxed div.item","multiple":true,"delay":"2000"},{"id":"artist-name","type":"SelectorText","parentSelectors":["scrolldown"],"selector":"h3.name a","multiple":false,"regex":"","delay":0},{"id":"artist-country","type":"SelectorText","parentSelectors":["scrolldown"],"selector":"div.second","multiple":false,"regex":"","delay":0}]}
#7

Thanks! For some reason it won't reach the end of the page, though.

Or maybe it does, but I have different data count with each try.

At the very least it would be nice if it froze when it stopped scraping so that I could actually see what happened instead of closing the page right away.