Hello!
I have been working on various techniques scrape instagram for the last week.
One issue I am struggling with, is infinite scroll.
To keep things simple I have selected posts (in a variety of different ways) and used 'element scroll down' whilst 'multiple' to see if I can just get the page to run from top to bottom.
Once I have got this working I will add some child items and pull data.
I can see it is triggering but the scroll is behaving erratically scraping up and down around three times before just quitting after only scraping just a few of the posts out of the 2000.
I recorded a video here
(https://) drive.google.com/file/d/1tnymY0YwecA1Ma82VBmctign6RdPu5YI/view
Link here (although it could be any account)
Code here
{"_id":"instagramfix","startUrl":["https://www.instagram.com/pampamlondon/"],"selectors":[{"id":"scroll","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":".v1Nh3 a","multiple":true,"delay":"1000"}]}
Thanks
David