Scrape NIH Reporter Tool

Hi. I got a problem when scraping this web here:

https://reporter.nih.gov/search/woeaI6XSFUeNwW-A_NqA4g/project-details/10608989

I want to scrape the name of the PI/Project Leader, Title, and also the Email. However, I could not scrape the email part as I had to click on the button 'View Email' to show the actual email address.

Here is the screenshot:
image

What can I do to scrape the email?

Thank you!

Hi,

You can try this setup:

{"_id":"nih-gov","startUrl":["https://reporter.nih.gov/search/woeaI6XSFUeNwW-A_NqA4g/project-details/10608989"],"selectors":[{"clickActionType":"real","clickElementSelector":"button:contains('View Email')","clickElementUniquenessType":"uniqueText","clickType":"clickOnce","delay":2000,"discardInitialElements":"do-not-discard","id":"email-click","multiple":false,"parentSelectors":["project-leader"],"selector":"body","type":"SelectorElementClick"},{"id":"e-mail","multiple":false,"parentSelectors":["project-leader"],"regex":"","selector":"a[href*=\"mail\"]","type":"SelectorText"},{"id":"project-leader","multiple":true,"parentSelectors":["_root"],"selector":".data-section:contains('Project Leader')","type":"SelectorElement"}]}

Hope it helps :+1: