How scrape a popup link

[raj66kas]

Hi all,
Is there a technic to scrape a popup link that appears within the same window ( no new tab or no new window). I can see that javascript() call is made for the popup.

When I use the popup link selector, the script runs to completion but with null data for the popup section. When I try using element click, the selections are not valid or cant access the popup box.

When I test the scrape at the box level, it does return data.

What is the recommended time for the wait parameter?

Thanks in advance

[ViestursWS]

@raj66kas Hi, can you, please, provide your sitemap or the targeted website?

[raj66kas]

HI Vieturs,

For the pop-link to work you have to create I think a free account.
here is the site map for Coconino - RealTaxLien

This is one of many versions that I've tried

{"_id":"bbbb","startUrl":["Error - Coconino - RealTaxLien tr:nth-of-type(n+3)","type":"SelectorElement"},{"id":"AdvNum","multiple":false,"parentSelectors":["SelectRows"],"regex":"","selector":".advNum a","type":"SelectorText"},{"id":"TaxYear","multiple":false,"parentSelectors":["SelectRows"],"regex":"","selector":"td:nth-of-type(2)","type":"SelectorText"},{"id":"SoldTo","multiple":false,"parentSelectors":["SelectRows"],"regex":"","selector":"b","type":"SelectorText"},{"id":"ClickAdvNum","multiple":false,"parentSelectors":["SelectRows"],"selector":".advNum a","type":"SelectorPopupLink"},{"id":"pxAccNum","multiple":false,"parentSelectors":["pBox"],"regex":"","selector":"div.popup-content > div.popup-body > table > tbody > tr:nth-child(1) > td.left > div > table > tbody > tr:nth-child(2) > td:nth-child(2)","type":"SelectorText"},{"id":"vFCV","multiple":false,"parentSelectors":["pBox"],"regex":"","selector":"div.popup-content > div.popup-body > table > tbody > tr:nth-child(1) > td.right > div:nth-child(2) > table > tbody > tr:nth-child(4) > td:nth-child(2)","type":"SelectorText"},{"id":"oiOwnerAddress","multiple":false,"parentSelectors":["pBox"],"regex":"","selector":"div.popup-content > div.popup-body > table > tbody > tr:nth-child(1) > td.right > div:nth-child(3) > table > tbody > tr:nth-child(2) > td:nth-child(2)","type":"SelectorText"},{"id":"ClickResults","multiple":false,"parentSelectors":["_root"],"selector":"#cat1 > ul > li:nth-child(2) > a","type":"SelectorLink"},{"clickElementSelector":"a.close","clickElementUniquenessType":"uniqueText","clickType":"clickOnce","delay":2000,"discardInitialElements":"do-not-discard","id":"CloseBox","multiple":false,"parentSelectors":["pBox"],"selector":"div.popup-header","type":"SelectorElementClick"},{"id":"mainBody","multiple":false,"parentSelectors":["ClickResults"],"selector":"#mainLayoutContainer > div > div.left-nav-bg","type":"SelectorElement"},{"id":"pBox","multiple":false,"parentSelectors":["ClickAdvNum"],"selector":"div.popup-box","type":"SelectorElement"}]}

[ViestursWS]

@raj66kas It does not appear as the sitemap JSON you sent is valid. Please, apply preformatted text on your sitemap before sending it, otherwise, it has some formatting errors.

[raj66kas]

it seems like it just wrapped in single quotes

{"_id":"bbbb","startUrl":["https://coconino.arizonataxsale.com/index.cfm?folder=home"],"selectors":[{"id":"SelectRows","parentSelectors":["mainBody"],"type":"SelectorElement","selector":".center tr:nth-of-type(n+3)","multiple":true},{"id":"AdvNum","parentSelectors":["SelectRows"],"type":"SelectorText","selector":".advNum a","multiple":false,"regex":""},{"id":"TaxYear","parentSelectors":["SelectRows"],"type":"SelectorText","selector":"td:nth-of-type(2)","multiple":false,"regex":""},{"id":"SoldTo","parentSelectors":["SelectRows"],"type":"SelectorText","selector":"b","multiple":false,"regex":""},{"id":"ClickAdvNum","parentSelectors":["SelectRows"],"type":"SelectorPopupLink","selector":".advNum a","multiple":false},{"id":"pxAccNum","parentSelectors":["pBox"],"type":"SelectorText","selector":"div.popup-content > div.popup-body > table > tbody > tr:nth-child(1) > td.left > div > table > tbody > tr:nth-child(2) > td:nth-child(2)","multiple":false,"regex":""},{"id":"vFCV","parentSelectors":["pBox"],"type":"SelectorText","selector":"div.popup-content > div.popup-body > table > tbody > tr:nth-child(1) > td.right > div:nth-child(2) > table > tbody > tr:nth-child(4) > td:nth-child(2)","multiple":false,"regex":""},{"id":"oiOwnerAddress","parentSelectors":["pBox"],"type":"SelectorText","selector":"div.popup-content > div.popup-body > table > tbody > tr:nth-child(1) > td.right > div:nth-child(3) > table > tbody > tr:nth-child(2) > td:nth-child(2)","multiple":false,"regex":""},{"id":"ClickResults","parentSelectors":["_root"],"type":"SelectorLink","selector":"#cat1 > ul > li:nth-child(2) > a","multiple":false},{"id":"CloseBox","parentSelectors":["pBox"],"type":"SelectorElementClick","clickElementSelector":"a.close","clickElementUniquenessType":"uniqueText","clickType":"clickOnce","delay":2000,"discardInitialElements":"do-not-discard","multiple":false,"selector":"div.popup-header"},{"id":"mainBody","parentSelectors":["ClickResults"],"type":"SelectorElement","selector":"#mainLayoutContainer > div > div.left-nav-bg","multiple":false},{"id":"pBox","parentSelectors":["ClickAdvNum"],"type":"SelectorElement","selector":"div.popup-box","multiple":false}]}