Hi, this is basically a fair's exhibitoner company list. When you first open the website, and click the "Austeller A-Z" button on the left menu, the exhibitioner list opens up. Then whenever you click a company there, a window with information about the company opens. I need to scrape email addresses of the companies here, but whatever I did, I couldn't make it work on this website. Can someone help me, if you can make it work, can you please share your sitemap for it?
Url: Show Map
I didn't move any further of this sitemap.
{"_id":"GHM","startUrl":["https://ghm.ungerboeck.com/PROD/app85.cshtml?aat=5964656e5444346d4231593836494a36757335347950476159537173556c6471486f594848544c565145733d"],"selectors":[{"clickActionType":"real","clickElementSelector":"li:nth-of-type(1) div[click\\.delegate='showMenu(groupHeader)']","clickElementUniquenessType":"uniqueHTMLText","clickType":"clickOnce","delay":500,"discardInitialElements":"discard","id":"click1","multiple":false,"parentSelectors":["_root"],"selector":"li:nth-of-type(1) div[click\\.delegate='showMenu(groupHeader)']","type":"SelectorElementClick"},{"clickActionType":"real","clickElementSelector":".active.menu-level-2 div.booth-title","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":1000,"discardInitialElements":"discard-when-click-element-exists","id":"click","multiple":true,"parentSelectors":["_root"],"selector":"body","type":"SelectorElementClick"},{"id":"name","multiple":false,"parentSelectors":["click"],"regex":"","selector":".exhibitor-introduction span","type":"SelectorText"},{"id":"descr","multiple":false,"parentSelectors":["click"],"regex":"","selector":".exhibitor-introduction p","type":"SelectorText"},{"id":"address","multiple":false,"parentSelectors":["click"],"regex":"","selector":"section.mailing-address","type":"SelectorText"},{"id":"email","multiple":false,"parentSelectors":["click"],"regex":"","selector":".contact-item a:contains(\"@\")","type":"SelectorText"},{"clickActionType":"real","clickElementSelector":".modal-header button:has(.fa-xmark)","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":500,"discardInitialElements":"discard","id":"close","multiple":false,"parentSelectors":["click"],"selector":".modal-header button:has(.fa-xmark)","type":"SelectorElementClick"}]}
Too hard website for WebScraper. All needed data can be received via API
First of all, thank you so much for your time.
I also managed to create something similar to this. However, after opening the company card, it does not close it back for some reason. As you said, this website is too hard for web scraping I guess. I think I will just scrape the company names and search them on google with proxies or something. Can't think of any other solution really.
Hi,
I change body to ux-dialog-container and increased the delays a bit, seems to work fine:
{"_id":"GHM","startUrl":["https://ghm.ungerboeck.com/PROD/app85.cshtml?aat=5964656e5444346d4231593836494a36757335347950476159537173556c6471486f594848544c565145733d"],"selectors":[{"clickActionType":"real","clickElementSelector":"li:nth-of-type(1) div[click\\.delegate='showMenu(groupHeader)']","clickElementUniquenessType":"uniqueHTMLText","clickType":"clickOnce","delay":500,"discardInitialElements":"discard","id":"click1","multiple":false,"parentSelectors":["_root"],"selector":"li:nth-of-type(1) div[click\\.delegate='showMenu(groupHeader)']","type":"SelectorElementClick"},{"clickActionType":"real","clickElementSelector":".active.menu-level-2 div.booth-title","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":2000,"discardInitialElements":"discard-when-click-element-exists","id":"click","multiple":true,"parentSelectors":["_root"],"selector":"ux-dialog-container","type":"SelectorElementClick"},{"id":"name","multiple":false,"parentSelectors":["click"],"regex":"","selector":".exhibitor-introduction span","type":"SelectorText"},{"id":"descr","multiple":false,"parentSelectors":["click"],"regex":"","selector":".exhibitor-introduction p","type":"SelectorText"},{"id":"address","multiple":false,"parentSelectors":["click"],"regex":"","selector":"section.mailing-address","type":"SelectorText"},{"id":"email","multiple":false,"parentSelectors":["click"],"regex":"","selector":".contact-item a:contains(\"@\")","type":"SelectorText"},{"clickActionType":"real","clickElementSelector":".modal-header button:has(.fa-xmark)","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":1000,"discardInitialElements":"discard","id":"close","multiple":false,"parentSelectors":["click"],"selector":".modal-header button:has(.fa-xmark)","type":"SelectorElementClick"}]}