Scroll through Facebookgroups

How to?
#1

Hi. I like to scroll through the entire members of a Facebook Group. After this it should extract the Links of the users (this is not implemented yet). i am struggeling with the infinite scroll. Does anyone know why my scraper does not scroll to the next members of the group. It cancels scraping before it clicks through the load more button at the end of the members list. Hope anybody can help. Thanks a lot.

Url: https://www.facebook.com/groups/868521679982769/members

Sitemap:
{"_id":"facebook","startUrl":["https://www.facebook.com/groups/868521679982769/members"],"selectors":[{"id":"scrollweiter","type":"SelectorElementClick","selector":"div.fbProfileBrowserList div.fbProfileBrowserList a.pam","parentSelectors":["_root"],"multiple":false,"delay":"2000","clickElementSelector":"div.fbProfileBrowserList div.fbProfileBrowserList a.pam","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueCSSSelector"}]}

#2

Hello,

FaceBook is a very diificult site to use for scraping. Is it your first sitemaps with them ?

You shoud send us a gif because it is difficult to see what you want to collect.
( element preview for selector ou Click selector are not underlined by Web scraper so I don't see what you want to get)

At this step, I can't help you more. sorry

#3

1
I want to get the date and content of the post (text) from each timeline publication but I can only capture two publications.

#4

Hi

normaly you should use a "Element scroll down" selector for this kind of pagination.

I didn't test more because too many members and because I don't want to be banned by Facebook (this site seems protected against scrapping ...

{"_id":"test_facebook","startUrl":["https://www.facebook.com/groups/868521679982769/members"],"selectors":[{"id":"scrollweiter","type":"SelectorElementScroll","selector":"div#groupsMemberSection_recently_joined._21m- div.uiProfileBlockContent > div._6a","parentSelectors":["_root"],"multiple":true,"delay":"2000"},{"id":"name","type":"SelectorText","selector":"div#groupsMemberSection_admins_moderators._21m- div._60ri a","parentSelectors":["_root"],"multiple":false,"regex":"","delay":0}]}