Google Scholar - cycles through in preview but not in scrape

How to?
#1

Describe the problem.
I want get the profile link for everyone listed at UBC on google scholar - when I use the click selector and preview data is cycles through the pages just fine - when I don't use the click selector I can scraped thd links for the first page but when I try and combine them I end up just getting the links for the second page (and it doesnt even go to a third page). Not sure what I am doing wrong!

Thanks!

Url: https://scholar.google.ca/citations?view_op=view_org&hl=en&org=13655899619131983200

Sitemap:
{"_id":"scholar2","startUrl":["https://scholar.google.ca/citations?view_op=view_org&hl=en&org=13655899619131983200"],"selectors":[{"id":"Page","type":"SelectorElementClick","selector":"div.gsc_1usr:nth-of-type(n+10) h3.gsc_oai_name a","parentSelectors":["_root"],"multiple":true,"delay":"5000","clickElementSelector":"button.gs_btnPR span.gs_ico","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"},{"id":"Link","type":"SelectorLink","selector":"h3.gsc_oai_name a","parentSelectors":["_root","Page"],"multiple":true,"delay":0}]}

#2

Hmm..,. I couldn't get this one to work either. Can't get the pagination selector right.. It should be one of these

.gs_btn_srt
.gsc_pgn_pnx

Either seem to work in either scrapers but not here.

Anyone else figure this one out?

#3

Hi!

It's a little tricky with this site, it will go to next page if pagination is included in a selector wrapper within Element Click selector.

Funniest part is that it will eventually stop you from scraping by popping a CAPTCHA that will make your scrape useless - as it will give results ONLY if finished by itself and not stopped by anything.

Please try to play with the timings, i'd try maybe 5 to 7 seconds, maybe it would be successful.

{"_id":"google","startUrl":["https://scholar.google.ca/citations?view_op=view_org&hl=en&org=13655899619131983200&before_author=jyv2_wq-AAAJ&astart=0"],"selectors":[{"id":"clk","type":"SelectorElementClick","selector":"div#gsc_sa_ccl","parentSelectors":["_root"],"multiple":true,"delay":"5000","clickElementSelector":"button.gs_btnPR span.gs_ico","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"},{"id":"txt","type":"SelectorText","selector":"h3.gsc_oai_name a","parentSelectors":["clk"],"multiple":true,"regex":"","delay":0}]}

P.S. when trying to pick a selector that calls an action during pick (example of this website: you pick a button, and it switches page), tick or click on 'Enable Key Events' that always pops out first you click select and then, pointing mouse on necessary element, press 'S' on your keyboard to safely pick the selector.