How to scrape text from a popup window

How to?
#1

Hi there,

I am attempting to scrape from this association page.
I have it setup to click on each profile on the page. I also have it setup to scrape the text but it doesn't scrape, but it only just clicks through each popup.

https://www.americanboardortho.com/general-public/orthodontist-locator/

Sitemap:
{"_id":"orthor","startUrl":["https://www.americanboardortho.com/general-public/orthodontist-locator/"],"selectors":[{"id":"item","type":"SelectorElement","selector":"div.col-sm-3:nth-of-type(n+17)","parentSelectors":["_root"],"multiple":true,"delay":0},{"id":"viewdetails","type":"SelectorPopupLink","selector":"a:nth-of-type(1)","parentSelectors":["item"],"multiple":false,"delay":0},{"id":"name","type":"SelectorText","selector":"div.modal.in h4.modal-title","parentSelectors":["viewdetails"],"multiple":false,"regex":"","delay":0},{"id":"website","type":"SelectorText","selector":"div.modal.in a","parentSelectors":["viewdetails"],"multiple":false,"regex":"","delay":0}]}

#2

Hello,

scrape for this website can be done using Element Click selector, first you click modal content (popup window content with the info) and pick it into Selector, then close it and select all Show details for Click selector.

Then you create a text selectors inside it to pick text into popup window.

Here's a working example sitemap:

{"_id":"orthor-test","startUrl":["https://www.americanboardortho.com/general-public/orthodontist-locator/"],"selectors":[{"id":"click_to_open","type":"SelectorElementClick","selector":"div.modal.in div.modal-content","parentSelectors":["_root"],"multiple":true,"delay":"500","clickElementSelector":"div.col-sm-3 a","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueCSSSelector"},{"id":"name","type":"SelectorText","selector":"h4.modal-title","parentSelectors":["click_to_open"],"multiple":false,"regex":"","delay":0},{"id":"site","type":"SelectorText","selector":"div.col-sm-8 a","parentSelectors":["click_to_open"],"multiple":false,"regex":"","delay":0}]}

#3

im try but its not work.
unable get text selected from new popup.
im try test to element link then set text selector, but result is null

#4

hi iconolast

i have follow your guide but no data been scraped

{"_id":"matrade","startUrl":["http://www.matrade.gov.my/cms/tradeList.jsp"],"selectors":[{"id":"ada","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"a.blue","multiple":true,"delay":"500","clickElementSelector":"a.my_popup_open","clickType":"clickOnce","discardInitialElements":false,"clickElementUniquenessType":"uniqueCSSSelector"}]}

can you please help me

thanks

#5

{"_id":"belaja","startUrl":["https://www.americanboardortho.com/general-public/orthodontist-locator/"],"selectors":[{"id":"doktor","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.modal.in div.modal-body","multiple":true,"delay":"500","clickElementSelector":"div.col-sm-3 a","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueCSSSelector"}]}

nothing happened, please help