Problem with popup

How to?
#1

Hi folks,

want to extract the link to the website and the mail address of the companies listed here:
http://www.lvca.lv/en/members

My approach opens the popups and when I check the data and element preview, I get a result. But when I actually scrape there is no data.

{"_id":"lvca_lit","startUrl":["http://www.lvca.lv/en/members"],"selectors":[{"id":"popup","type":"SelectorPopupLink","parentSelectors":["_root"],"selector":"img.Member__Logo","multiple":true,"delay":0},{"id":"mail","type":"SelectorText","parentSelectors":["popup"],"selector":"div.ShowMember__Contact:nth-of-type(4)","multiple":true,"regex":"","delay":0},{"id":"website","type":"SelectorText","parentSelectors":["popup"],"selector":"a.ShowMember__Link","multiple":true,"regex":"","delay":0}]}

Appreciate your help - cheers!

#2

ah, forgot to tell you.. when i hover over the pic, the browser shows the link, for e.g. http://www.lvca.lv/en/members-1/deloitte-latvia

But I control it. So if you have an idea how I can do so, that would be the solution :slight_smile:

#3

These are actually just plain HTML links (a href) so you can use Type: Link and a proper selector. I used Page load delay 5500.

{"_id":"lvca_lit-test","startUrl":["http://www.lvca.lv/en/members"],"selectors":[{"id":"Click companies","type":"SelectorLink","parentSelectors":["_root"],"selector":"div[class^='Col'] > a.Member__Link","multiple":true,"delay":0},{"id":"mail","type":"SelectorText","parentSelectors":["Click companies"],"selector":"div[class='ShowMember__Contact']","multiple":false,"regex":"","delay":0},{"id":"website","type":"SelectorText","parentSelectors":["Click companies"],"selector":"a.ShowMember__Link","multiple":false,"regex":"","delay":0},{"id":"Desc 25 chars","type":"SelectorText","parentSelectors":["Click companies"],"selector":"div.ShowMember__Body","multiple":false,"regex":".{25}","delay":0}]}

#4

Thanks a lot!

While dealing more and more with scraping I realize that request interval and page load delay are very important success factors.

Page speed 5500 works fine. Do you generally use this setting or how did you find out that it works out in this specific case?

Thanks in advance!