Instagram infinite scroll

Hello!

I have been working on various techniques scrape instagram for the last week.
One issue I am struggling with, is infinite scroll.

To keep things simple I have selected posts (in a variety of different ways) and used 'element scroll down' whilst 'multiple' to see if I can just get the page to run from top to bottom.

Once I have got this working I will add some child items and pull data.

I can see it is triggering but the scroll is behaving erratically scraping up and down around three times before just quitting after only scraping just a few of the posts out of the 2000.

I recorded a video here
(https://) drive.google.com/file/d/1tnymY0YwecA1Ma82VBmctign6RdPu5YI/view

Link here (although it could be any account)

Code here

{"_id":"instagramfix","startUrl":["https://www.instagram.com/pampamlondon/"],"selectors":[{"id":"scroll","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":".v1Nh3 a","multiple":true,"delay":"1000"}]}

Thanks
David

Just wanted to bump this as hoping someone can help.

Have also changed the status to a bug as as I have spoken to another user @atechn who has also had a similar issue with infinite scroll on LinkedIn with irrational up and down scrolling.

Chrome Version 74.0.3729.108 (Official Build) (64-bit)
Windows 10

Is anyone able to assist?

1 Like