Help ?- Scraping of Hidden Phones, Emails & URLS After Click "Show"

How to?
#1

Hello.How can I parse phones, emails or websites from sites that become visible only after clicking on the link "Show" & when only the first few digits are visible, the last ones are hidden?There are no clear examples in any tutorials. Are there any experts in that?

Url: https://flagma.co.uk/companies/page-1/

Sitemap:
{id:"sitemap code"}

#2

Hi @Vlad.

In this particular case, it would be possible by using an 'Element click' selector set as a 'parent' for a 'Text' selector targeting the revealed phone number.

Practical example:

{"_id":"flagma-co-uk","startUrl":["https://flagma.co.uk/2025714/"],"selectors":[{"clickElementSelector":"#contacts a[onclick]","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":1200,"discardInitialElements":"discard-when-click-element-exists","id":"reveal-click","multiple":true,"parentSelectors":["_root"],"selector":"html","type":"SelectorElementClick"},{"delay":0,"id":"phone","multiple":false,"parentSelectors":["reveal-click"],"regex":"","selector":"a.tel","type":"SelectorText"}]}

#3

.Thanks a lot for your help.

#4

Thank you very much for your help. You are the only expert here who can help. There was another problem with the pagination of hidden pages that appear after clicking on the link - "Next"(in Russian- "ะกะปะตะดัƒัŽั‰ะฐั". How can I do it? Again, there are no such examples in their tutorials - only easy examples are considered when all the pages are visible.Here is an example of a website. I tried it - data is not collected from all pages. I need help. Here is my sitemap. I was able to collect only 183 ads but there should be 402 ads in total.
{"_id":"mediall-ru","startUrl":["http://www.mediall.ru/requireproduct/index1.htm"],"selectors":[{"id":"pagination","parentSelectors":["_root","pagination"],"paginationType":"clickMore","selector":"li:nth-of-type(9) a","type":"SelectorPagination"},{"id":"Element-Card","parentSelectors":["pagination"],"type":"SelectorElement","selector":"td[colspan='2']","multiple":true,"delay":0},{"id":"Company-Links","parentSelectors":["Element-Card"],"type":"SelectorLink","selector":"strong a","multiple":false,"delay":0},{"id":"Telephone","parentSelectors":["Company-Links"],"type":"SelectorText","selector":"tr:contains('ะขะตะปะตั„ะพะฝ') td:nth-of-type(2)","multiple":false,"delay":0,"regex":""},{"id":"Email","parentSelectors":["Company-Links"],"type":"SelectorLink","selector":"tr:contains('E-mail') a","multiple":false,"delay":0}]}

#5

@Vlad Hi.

In this case, you have to manually adjust the selector so it targets the list/button that contains the keyword - 'ะกะปะตะดัƒัŽั‰ะฐั' - li:contains("ะกะปะตะดัƒัŽั‰ะฐั") a

Learn more about that here:

https://webscraper.io/how-to-video/jquery-contains-selector
https://webscraper.io/documentation/css-selector

1 Like