Scrape TwittwrFollowers

This is less of a "how to?" and more of a "how to!"

For those that want a recipe to scrape twitter follows for a specific user, here it is! It's 90% working, just broke when I tried to scrape lists that person has. It successfully pulls: Name. Handle, Location, Bio, Following, Followers, Likes, Web site link and date they joined.

Enjoy

{"_id":"twitter-followers","startUrl":["https://twitter.com/Web_Scraping_US/followers"],"selectors":[{"id":"Scroll DOwn","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"div.GridTimeline-items div.Grid-cell","multiple":true,"delay":"3000"},{"id":"Name","type":"SelectorText","parentSelectors":["Scroll DOwn"],"selector":"a.fullname","multiple":false,"regex":"","delay":0},{"id":"Userhandle","type":"SelectorText","parentSelectors":["Scroll DOwn"],"selector":"a.ProfileCard-screennameLink span.username","multiple":false,"regex":"","delay":0},{"id":"bio","type":"SelectorText","parentSelectors":["Scroll DOwn"],"selector":"p.ProfileCard-bio","multiple":false,"regex":"","delay":0},{"id":"Link in","type":"SelectorLink","parentSelectors":["Scroll DOwn"],"selector":"a.fullname","multiple":false,"delay":0},{"id":"Tweets","type":"SelectorText","parentSelectors":["Link in"],"selector":"li.ProfileNav-item.ProfileNav-item--tweets span.ProfileNav-value","multiple":false,"regex":"","delay":0},{"id":"Following","type":"SelectorText","parentSelectors":["Link in"],"selector":"li.ProfileNav-item.ProfileNav-item--following span.ProfileNav-value","multiple":false,"regex":"","delay":0},{"id":"Followers","type":"SelectorText","parentSelectors":["Link in"],"selector":"li.ProfileNav-item.ProfileNav-item--followers span.ProfileNav-value","multiple":false,"regex":"","delay":0},{"id":"Likes","type":"SelectorText","parentSelectors":["Link in"],"selector":"li.ProfileNav-item.ProfileNav-item--favorites span.ProfileNav-value","multiple":false,"regex":"","delay":0},{"id":"Joined","type":"SelectorText","parentSelectors":["Link in"],"selector":"span.ProfileHeaderCard-joinDateText","multiple":false,"regex":"","delay":0},{"id":"Webpage","type":"SelectorText","parentSelectors":["Link in"],"selector":"span.ProfileHeaderCard-urlText a.u-textUserColor","multiple":false,"regex":"","delay":0},{"id":"Location","type":"SelectorText","parentSelectors":["Link in"],"selector":"span.ProfileHeaderCard-locationText","multiple":false,"regex":"","delay":0},{"id":"lists","type":"SelectorText","parentSelectors":["Link in"],"selector":"li.ProfileNav-item.ProfileNav-item--lists span.ProfileNav-label","multiple":false,"regex":"","delay":0},{"id":"Groups","type":"SelectorGroup","parentSelectors":["Link in"],"selector":"div.Grid:nth-of-type(n+1) a.ProfileListItem-name","delay":0,"extractAttribute":""}]}

Ironic that I chose the user Webscraper to scrape:) Now if someone knows how to make it open the more actions box, click add to list and all the other clicks needed to auto add them to a list, let me know!

Bret, if it's only for twitter, why does title says it's for LinkedIn?:grinning: