Hi. I got a problem when scraping this web here:
https://reporter.nih.gov/search/woeaI6XSFUeNwW-A_NqA4g/project-details/10608989
I want to scrape the name of the PI/Project Leader, Title, and also the Email. However, I could not scrape the email part as I had to click on the button 'View Email' to show the actual email address.
Here is the screenshot:
What can I do to scrape the email?
Thank you!
Hi,
You can try this setup:
{"_id":"nih-gov","startUrl":["https://reporter.nih.gov/search/woeaI6XSFUeNwW-A_NqA4g/project-details/10608989"],"selectors":[{"clickActionType":"real","clickElementSelector":"button:contains('View Email')","clickElementUniquenessType":"uniqueText","clickType":"clickOnce","delay":2000,"discardInitialElements":"do-not-discard","id":"email-click","multiple":false,"parentSelectors":["project-leader"],"selector":"body","type":"SelectorElementClick"},{"id":"e-mail","multiple":false,"parentSelectors":["project-leader"],"regex":"","selector":"a[href*=\"mail\"]","type":"SelectorText"},{"id":"project-leader","multiple":true,"parentSelectors":["_root"],"selector":".data-section:contains('Project Leader')","type":"SelectorElement"}]}
Hope it helps 
Thank you! It works!