Scraping Facebook Page Search Results

How to?
#1

I am looking to scrape the search results of the following Facebook page search string - here's the URL

The page is scrolling down, but it is not recording any of the data .

I would like the scraper to click into each of the page results, click on the about page for the Facebook page, extract the email, number and website. It will do this for each listing in the results and continue scrolling to complete the actions on each of the listings.

Any help would be appreciated

Url: https://www.facebook.com/search/str/dentist+london/keywords_pages?epa=FILTERS&filters=eyJjYXRlZ29yeSI6IntcIm5hbWVcIjpcInBhZ2VzX2NhdGVnb3J5XCIsXCJhcmdzXCI6XCIxMDA2XCJ9In0%3D

Sitemap:
{"_id":"facebook_dentist","startUrl":["https://www.facebook.com/search/str/dentist+london/keywords_pages?epa=FILTERS&filters=eyJjYXRlZ29yeSI6IntcIm5hbWVcIjpcInBhZ2VzX2NhdGVnb3J5XCIsXCJhcmdzXCI6XCIxMDA2XCJ9In0%3D"],"selectors":[{"id":"listing","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"div#BrowseResultsContainer._1yt div._3u1","multiple":true,"delay":0},{"id":"Name","type":"SelectorLink","parentSelectors":["listing"],"selector":"span#u_ps_fetchstream_8_4_b._5bl2 a._32mo","multiple":false,"delay":0},{"id":"clickabout","type":"SelectorLink","parentSelectors":["Name"],"selector":"div._2yaa:nth-of-type(7) a._2yau","multiple":false,"delay":0},{"id":"number","type":"SelectorText","parentSelectors":["clickabout"],"selector":"div._3n4o div._50f4","multiple":false,"regex":"","delay":0},{"id":"email","type":"SelectorText","parentSelectors":["clickabout"],"selector":"a#u_fetchstream_10_0 div._50f4","multiple":false,"regex":"","delay":0},{"id":"website","type":"SelectorText","parentSelectors":["clickabout"],"selector":"a div div._50f4","multiple":false,"regex":"","delay":0}]}

#2

Try this - it might scroll down for a while

{"_id":"facebook_dentist","startUrl":["https://www.facebook.com/search/str/dentist+london/keywords_pages?epa=FILTERS&filters=eyJjYXRlZ29yeSI6IntcIm5hbWVcIjpcInBhZ2VzX2NhdGVnb3J5XCIsXCJhcmdzXCI6XCIxMDA2XCJ9In0%3D"],"selectors":[{"id":"listing","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"._gli","multiple":true,"delay":""},{"id":"Name","type":"SelectorLink","parentSelectors":["listing"],"selector":"a._32mo","multiple":false,"delay":0},{"id":"clickabout","type":"SelectorLink","parentSelectors":["Name"],"selector":"div._2yaa:contains("About") a._2yau","multiple":false,"delay":0},{"id":"number","type":"SelectorText","parentSelectors":["clickabout"],"selector":"div._3n4o div._50f4","multiple":false,"regex":"","delay":0},{"id":"email","type":"SelectorText","parentSelectors":["clickabout"],"selector":"a#u_fetchstream_10_0 div._50f4","multiple":false,"regex":"","delay":0},{"id":"website","type":"SelectorText","parentSelectors":["clickabout"],"selector":"a div div._50f4","multiple":false,"regex":"","delay":0}]}

#3

Made a few corrections here but not yet finished with the scroll down..
{"_id":"facebook_dentist","startUrl":["https://www.facebook.com/search/str/dentist+london/keywords_pages?epa=FILTERS&filters=eyJjYXRlZ29yeSI6IntcIm5hbWVcIjpcInBhZ2VzX2NhdGVnb3J5XCIsXCJhcmdzXCI6XCIxMDA2XCJ9In0%3D"],"selectors":[{"id":"listing","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"._gli","multiple":true,"delay":"2000"},{"id":"Name","type":"SelectorLink","parentSelectors":["listing"],"selector":"a._32mo","multiple":false,"delay":0},{"id":"clickabout","type":"SelectorLink","parentSelectors":["Name"],"selector":"a._2yau:Contains("About")","multiple":false,"delay":0},{"id":"number","type":"SelectorText","parentSelectors":["clickabout"],"selector":"div._3n4o div._50f4","multiple":false,"regex":"","delay":0},{"id":"email","type":"SelectorText","parentSelectors":["clickabout"],"selector":"a#u_fetchstream_10_0 div._50f4","multiple":false,"regex":"","delay":0},{"id":"website","type":"SelectorText","parentSelectors":["clickabout"],"selector":"a div div._50f4","multiple":false,"regex":"","delay":0}]}

#4

Thanks for replying.

I'm having issues importing this as it's not recognising this as JSON.

Am I just copying the following into the import sitemap field?

{"_id":"facebook_dentist","startUrl":["https://www.facebook.com/search/str/dentist+london/keywords_pages?epa=FILTERS&filters=eyJjYXRlZ29yeSI6IntcIm5hbWVcIjpcInBhZ2VzX2NhdGVnb3J5XCIsXCJhcmdzXCI6XCIxMDA2XCJ9In0%3D"],"selectors":[{"id":"listing","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"._gli","multiple":true,"delay":"2000"},{"id":"Name","type":"SelectorLink","parentSelectors":["listing"],"selector":"a._32mo","multiple":false,"delay":0},{"id":"clickabout","type":"SelectorLink","parentSelectors":["Name"],"selector":"a._2yau:Contains("About")","multiple":false,"delay":0},{"id":"number","type":"SelectorText","parentSelectors":["clickabout"],"selector":"div._3n4o div._50f4","multiple":false,"regex":"","delay":0},{"id":"email","type":"SelectorText","parentSelectors":["clickabout"],"selector":"a#u_fetchstream_10_0 div._50f4","multiple":false,"regex":"","delay":0},{"id":"website","type":"SelectorText","parentSelectors":["clickabout"],"selector":"a div div._50f4","multiple":false,"regex":"","delay":0}]}

#5

The reason why it bretfeig’s code isn't recognized as JSON lies in the following section:
"selector":"a._2yau:Contains("About")",

You must replace the double quotes surrounding "About" with single quotes:
"selector":"a._2yau:Contains('About')",

So, here’s bretfeig’s complete code, with the fixed quotes and slightly formatted by me for easier reading:

{"_id":"facebook_dentist","startUrl":["https://www.facebook.com/search/str/dentist+london/keywords_pages?epa=FILTERS&filters=eyJjYXRlZ29yeSI6IntcIm5hbWVcIjpcInBhZ2VzX2NhdGVnb3J5XCIsXCJhcmdzXCI6XCIxMDA2XCJ9In0%3D"],
"selectors":[
{"id":"listing","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"._gli","multiple":true,"delay":2000},
{"id":"Name","type":"SelectorLink","parentSelectors":["listing"],"selector":"a._32mo","multiple":false,"delay":0},
{"id":"clickabout","type":"SelectorLink","parentSelectors":["Name"],"selector":"a._2yau:Contains('About')","multiple":false,"delay":0},
{"id":"number","type":"SelectorText","parentSelectors":["clickabout"],"selector":"div._3n4o div._50f4","multiple":false,"regex":"","delay":0},
{"id":"email","type":"SelectorText","parentSelectors":["clickabout"],"selector":"a#u_fetchstream_10_0 div._50f4","multiple":false,"regex":"","delay":0},
{"id":"website","type":"SelectorText","parentSelectors":["clickabout"],"selector":"a div div._50f4","multiple":false,"regex":"","delay":0}]}