Hi,
I am trying to scrape the search results from this Website (Insolvenzbekanntmachungen). In order to see the results I want to scrape you will have to select a country (e.g. Hamburg) and click search/suche in the bottom left.
You can see a table with information. I try to scrape this information but also the information from the pop up window that opens when clicking on the magnifying glas. Here I just want to copy all the text in the pop up.
When using the type "Popup Link" in order to navigate to the popup window, i get an error that says: “Uncaught TypeError: popupWindow is undefined”. So this is kind of a dead end.
{"_id":"popup_cmd","startUrl":["https://neu.insolvenzbekanntmachungen.de/ap/suche.jsf"],"selectors":[{"id":"popup1","type":"SelectorPopupLink","parentSelectors":["_root"],"selector":"input#tbl_ergebnis\:0\:frm_detail\:j_idt160","multiple":false,"delay":0}]}
With "element click" the scraper opens all the pop ups one after another. However, I am not able to select the pop-up windows as a child in order to select type “text” and copy all the text. When opening the webscraper while having the popup menu open, I get an error message “parent element not found!”
Somehow the scraper does not understand that the child "pop up" belongs to the "parent" website.
{"_id":"insolvenz","startUrl":["https://neu.insolvenzbekanntmachungen.de/ap/ergebnis.jsf"],"selectors":[{"id":"element click","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"input.pngbutton","multiple":true,"delay":2000,"clickElementSelector":"input.pngbutton","clickType":"clickOnce","discardInitialElements":"discard-when-click-element-exists","clickElementUniquenessType":"uniqueHTML"},{"id":"copyall","type":"SelectorText","parentSelectors":["element click"],"selector":"parent","multiple":true,"regex":"","delay":0}]}
Any one has an idea? Any help would be much appreciated!
Best regards!