Help scraping a web page

How to?
#1

On the following web page I am trying to get the name of the companies, their websites and their emails but the button that takes me to the next page with all the information does not work. I have tried as selector with: link (many problems because it does not let me select the area that I want), element click (It only works for me with the first one but not with the rest.)... I appreciate all the help possible to understand where my error was. My only interest is just to learn and discover where I am going wrong. Thanks.

Url: Quantum Effects - Exhibitor Index | Messe Stuttgart

Sitemap:
{"_id":"Quantum","startUrl":["Quantum Effects - Exhibitor Index | Messe Stuttgart button","type":"SelectorElementAttribute"},{"id":"Name","multiple":false,"parentSelectors":["_root"],"regex":"","selector":".modal-header h2","type":"SelectorText"},{"id":"website","multiple":false,"parentSelectors":["_root"],"regex":"","selector":"a[title='Open website']","type":"SelectorText"},{"id":"email","multiple":false,"parentSelectors":["_root"],"regex":"","selector":"a[title='Send mail']","type":"SelectorText"}]}

#2

Hi,

Please try the below setup:

{"_id":"messe-stuttgart-de","startUrl":["https://www.messe-stuttgart.de/quantum-effects/en/exhibition/exhibitors-products/exhibitor-index#/"],"selectors":[{"delay":0,"elementLimit":0,"id":"element","multiple":true,"parentSelectors":["_root"],"selector":"div.ed-item","type":"SelectorElementScroll"},{"clickActionType":"real","clickElementSelector":"div.ed-item h3","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":1000,"discardInitialElements":"discard-when-click-element-exists","id":"open","multiple":true,"parentSelectors":["_root"],"selector":"div#detail-modal","type":"SelectorElementClick"},{"id":"title","multiple":false,"parentSelectors":["open"],"regex":"","selector":"h2","type":"SelectorText"},{"id":"e-mail","multiple":false,"parentSelectors":["open"],"regex":"","selector":"a[title='Send mail']","type":"SelectorText"},{"id":"website","multiple":false,"parentSelectors":["open"],"regex":"","selector":"a[title='Open website']","type":"SelectorText"},{"clickActionType":"real","clickElementSelector":"i.icon-close","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":0,"discardInitialElements":"do-not-discard","id":"close","multiple":false,"parentSelectors":["open"],"selector":"_parent_","type":"SelectorElementClick"}]}
#3

Thanks JanAp for your help. It works fine now.

Regards

1 Like