Vimeo Scrapping Problem

[klu41k]

Hello! I need help scrape videos from vimeo from many pages.

It is necessary for the scraper to follow this link https://vimeo.com/staff go to each video and save the title.

The problem appeared with the "load more" button, I found a similar code on the forum that should suit me, but it did not work.

Can anyone help me?

Url:

Sitemap:
{"_id":"1","startUrl":["https://vimeo.com/staff"],"selectors":[{"id":"clicker","type":"SelectorLink","parentSelectors":["scroller"],"selector":"h2.aos-ArticleTitle a","multiple":false,"delay":0},{"id":"Name","type":"SelectorText","parentSelectors":["clicker"],"selector":"span._1fHNK","multiple":false,"regex":"","delay":0},{"id":"scroller","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"button.profile-load-more__button span.sc-kAzzGY","multiple":true,"delay":0,"clickElementSelector":"div.iris-annotation-layer","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueCSSSelector"}]}

[DrPangea]

Hi there,

Just for my own practice I took a shot at this and here's what I came up with:

sitemap: {"_id":"vimeo","startUrl":["https://vimeo.com/staff"],"selectors":[{"id":"Element/click","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.clip__wrapper","multiple":true,"delay":0,"clickElementSelector":"button.profile-load-more__button span.sc-kAzzGY span","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueCSSSelector"},{"id":"title","type":"SelectorText","parentSelectors":["Element/click"],"selector":"span.iris_link","multiple":false,"regex":"","delay":0}]}

That should give you every title including those hidden behind the "Load more" button. I think the problem you were having was due to the incorrect selector being used. You need to direct the Element Click Selector to both the Element you wish to scrape as well as the click that needs to happen to load more videos.

here's a screenshot of the results:

[klu41k]

Thank You Very Mutch !! It Works!