Hi there, I am trying to scrape the followers from my instagram profile
https://www.instagram.com/fernandonjardim/followers , but when I set scroll_down and select the elements, it doesn't scroll down /:
here is my site map
"_id":"test2","startUrl":["https://www.instagram.com/fernandonjardim/followers"],"selectors":[{"delay":2000,"elementLimit":500,"id":"users","multiple":true,"parentSelectors":["_root"],"selector":"div._ab9-","type":"SelectorElementScroll"}]}
Instagram is a tricky one and you'll need more advanced knowledge of CSS selectors and also the undocumented/under-documented scrollElementSelector selector. This one needs to be added via Json code (can't use the gui). Try this sitemap:
{"_id":"forum-instagram-followers-d","startUrl":["https://www.instagram.com/fernandonjardim/followers"],"selectors":[{"delay":2500,"elementLimit":50,"id":"Special scroller","multiple":true,"parentSelectors":["_root"],"scrollElementSelector":"div[role='dialog'] > div div[style^='display'] > div > div:last-of-type","selector":"div[aria-labelledby]","type":"SelectorElementScroll"},{"id":"Handle","multiple":false,"parentSelectors":["Special scroller"],"regex":"","selector":"div > a span","type":"SelectorText"},{"id":"Name","multiple":false,"parentSelectors":["Special scroller"],"regex":"","selector":"div:nth-child(2) > div:nth-child(2)","type":"SelectorText"},{"id":"Link","multiple":false,"parentSelectors":["Special scroller"],"selector":"div a","type":"SelectorLink"}]}
I added this line to the Json:
"scrollElementSelector": "div[role='dialog'] > div div[style^='display'] > div > div:last-of-type"
For this scrape example, I used Page load delay 5500 and set Element limit to 50 (means scrape 50 results). You can adjust that as well as the Delay (ms) for scroller.
I am having the same problem, but I am attempting to scrape the main feed instead of a follower list. It seems like you solved the original issue here, but the details don't line up with my code. My scrape does scroll, but only a couple times then closes. The scrape currently only records 9 results - I would like 50 or 100.
My sitemap:
{"_id":"instagram_chronologic","startUrl":["https://www.instagram.com/?variant=following"],"selectors":[{"id":"post_block","parentSelectors":["_root"],"type":"SelectorElementScroll","selector":"article","multiple":true,"delay":10000,"elementLimit":500},{"id":"caption_intro","parentSelectors":["post_block"],"type":"SelectorText","selector":"._aacl span._aacl","multiple":false,"regex":""}]}