I have been working on various techniques scrape instagram for the last week.
One issue I am struggling with, is infinite scroll.
To keep things simple I have selected posts (in a variety of different ways) and used 'element scroll down' whilst 'multiple' to see if I can just get the page to run from top to bottom.
Once I have got this working I will add some child items and pull data.
I can see it is triggering but the scroll is behaving erratically scraping up and down around three times before just quitting after only scraping just a few of the posts out of the 2000.
I recorded a video here
Link here (although it could be any account)