Cannot select elements inside Pop up window

Describe the problem.
I'm trying to scrap the reviews within a popup window. But it does not allow me to select any element within that window. How do we overcome this ?

Url: http://example.com
Sole Fitness: Sole F63 Treadmill | Treadmills
(Need to click on "Read All xxx reviews"

Sitemap:
{"_id":"soletreadmills","startUrl":["https://www.soletreadmills.com/treadmills/f63-sole-treadmill"],"selectors":[{"id":"elem_click","type":"SelectorElementClick","parentSelectors":["_root"],"selector":".rr-close-button img","multiple":false,"delay":2000,"clickElementSelector":"a#answ_read_reviews","clickType":"clickOnce","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"review_element","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div[class="acs_review_text acs_js_review_attribute"]","multiple":true,"delay":2000,"clickElementSelector":"a[class="answ_pagination_next acs_page_next pr-link pr-accent-color"]","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"review","type":"SelectorText","parentSelectors":["review_element"],"selector":"div[class="acs_review_text acs_js_review_attribute"]","multiple":false,"regex":"","delay":0}]}

Hi @slk
Your sitemap isn't valid because you probably made some copy-paste error.
But anyway after inspecting the code it comes out that this page consists from couple of iframes which is kind of a mess to deal with.
When i inspected the code, it comes out that your review page link hides here:


And you could make a seperate sitemap for reviews using the extracted link.

Here's how i got the page-review link:
{"_id":"soletreadmills-com","startUrl":["https://www.soletreadmills.com/treadmills/f63-sole-treadmill"],"selectors":[{"id":"iframe","type":"SelectorElementAttribute","parentSelectors":["_root"],"selector":"#__rr_PR_OverlayFrame_iFrame","multiple":false,"extractAttribute":"src","delay":0},{"id":"link","type":"SelectorText","parentSelectors":["iframe"],"selector":"[itemprop=\"reviewBody\"]:iframe","multiple":false,"regex":"","delay":0}]}

1 Like

Thank you. It's a good workaround :slight_smile:

1 Like