Describe the problem.
Hello, could anyone help me to fetch all links in instagram post with infinite scrolling?
I can get part of post link with this sitemap via using element scrolling down, but I'd like to fetch all post links.
Url: https://www.instagram.com/explore/tags/新馬辣/?hl=zh-tw
Sitemap:
{"_id":"new_scraper_in_order","startUrl":["https://www.instagram.com/explore/tags/新馬辣/?hl=zh-tw"],"selectors":[{"id":"all_posts","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":".KC1QD > div:nth-of-type(2) > div","multiple":false,"delay":0},{"id":"post_link","type":"SelectorLink","parentSelectors":["all_posts"],"selector":"a","multiple":true,"delay":0},{"id":"content_element","type":"SelectorElement","parentSelectors":["post_link"],"selector":"div.X7jCj","multiple":false,"delay":0},{"id":"content","type":"SelectorText","parentSelectors":["content_element"],"selector":".C4VMK span","multiple":true,"regex":"","delay":0},{"id":"content_h1_htmlTag","type":"SelectorText","parentSelectors":["content_element"],"selector":"h1","multiple":false,"regex":"","delay":0}]}
Thanks in advance.