Element Click Selector - Load More

I am trying to scrape data from a travel agent site, where the first few profiles are shown and others can be loaded by clicking on Load More.

I am using the Element Click Selector, (also pressing "s" key while putting my cursor on the load more link - this does nothing), clicking on load more just loads the page instead of selecting it.

I have no clue how to select the load more button without making it load.
Url: https://www.signaturetravelnetwork.com/SigNet/index.cfm/AgentProfileSearch/index?LanguagesSpoken=490&destinationSpecialties=0&InterestSpecialties=0&ProductExpertise=0&searchText=0&agentCity=&agentState=&sortBy=0&signatureExperts=1

Please help.

Thanks,
Anum

You can see the element that you need to select by pressing right mouse click on it and selecting inspect. In this case the selector would be button:contains("Load more").

2 Likes

Thank you! It worked beautifully :sunny:

Hello Anum
could you post your sitemaps because for me it doesnt work.
This is my test:

{"_id":"test_signature_travel_network","startUrl":["https://www.signaturetravelnetwork.com/SigNet/index.cfm/AgentProfileSearch/index?LanguagesSpoken=490&destinationSpecialties=0&InterestSpecialties=0&ProductExpertise=0&searchText=0&agentCity=&agentState=&sortBy=0&signatureExperts=1"],"selectors":[{"id":"element","type":"SelectorElement","selector":"div.agent","parentSelectors":["_root","pagination"],"multiple":true,"delay":"2000"},{"id":"name","type":"SelectorText","selector":"div.agent-name","parentSelectors":["element"],"multiple":false,"regex":"","delay":0},{"id":"pagination","type":"SelectorElementClick","selector":"div.agent","parentSelectors":["_root","pagination"],"multiple":true,"delay":"3000","clickElementSelector":"button:contains("Load more")","clickType":"clickMore","discardInitialElements":true,"clickElementUniquenessType":"uniqueText"}]}

Hi,
this morning, I found how to process. No nead to get your sitemaps.
Thanks