https://www.instagram.com/bullymake/ << I would like to scrape the followers no this account. If you click on the number of followers, it opens a pop up and the pop up needs to be scrolled down to scrape. How do I do this?
I understand that it might take a lot of time to scroll until the end. In such case, is it possible to stop at lets say 10k followers?
Did you found out a solution for your post ?
Instagram is a bit harder and and you will need some advanced tricks. Notably, site uses a separate scroller for the popup window. You will need to use an undocumented scroller parameter to select the right scroll element, as described in a posting by @martins :
The sitemap below will properly scroll the Followers popup and stop at around 133 followers. You can change the number in the scroller selector
ul li:nth-of-type(n+4):nth-of-type(even):nth-of-type(-n+133)
The final number of followers is always higher because of the way the scroller shows more followers at the bottom.
Sitemap:
{"_id":"forum-instagram-followers-b","startUrl":["https://www.instagram.com/bullymake/"],"selectors":[{"id":"Username","type":"SelectorText","parentSelectors":["_root"],"selector":"main header h2","multiple":false,"regex":"" },{"id":"Click Followers","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div[role='presentation'] > div[role='dialog']:contains('Followers')","multiple":false,"delay":"2500","clickElementSelector":"header li:contains('followers') a","clickType":"clickOnce","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"Separate scroller","type":"SelectorElementScroll","parentSelectors":["Click Followers"],"selector":"ul li:nth-of-type(n+4):nth-of-type(even):nth-of-type(-n+133)","multiple":true,"delay":"2500","scrollElementSelector":"div > div:contains('Followers') + div"},{"id":"Row wrappers","type":"SelectorElement","parentSelectors":["Click Followers"],"selector":"ul li","multiple":true },{"id":"Handle","type":"SelectorText","parentSelectors":["Row wrappers"],"selector":"div > span > a[title]","multiple":false,"regex":"" },{"id":"Name","type":"SelectorText","parentSelectors":["Row wrappers"],"selector":"div > div > div:last-of-type > div:last-of-type","multiple":false,"regex":"" },{"id":"Link","type":"SelectorLink","parentSelectors":["Row wrappers"],"selector":"div > span > a[title]","multiple":false }]}
The scroller parameter I added is:
,"scrollElementSelector": "div > div:contains('Followers') + div"
Other refs:
http://nthmaster.com/
https://www.w3schools.com/cssref/css_selectors.asp
The algorithms Instagram uses can be tricky sometimes