Wondering how to tackle scraping the exhibitor list from a site where the list is sort of pop-up (URL does not change) and requires scrolling to see the entire list. Each exhibitor can be clicked for further info.
Url: http://annualmeeting.leadingage.org/conferences/floor_plans/shows/la18/exfx.html#exhibitors
Sitemap:
{id:"sitemap code"}
Hi!
All you need to do is just set up Element Click selector, selecting popup contents for selector itself, and all titles/buttons in the list to be clicked through. Fortunately this website change pop-up content instead of opening new every time. You can play with Element Click delay for quickness of scraping. Don't forget to adjust text selectors inside for your needs.
Your sitemap:
{"_id":"annualmeeting","startUrl":["http://annualmeeting.leadingage.org/conferences/floor_plans/shows/la18/exfx.html#exhibitors"],"selectors":[{"id":"click_popup","type":"SelectorElementClick","selector":"div.dialog:nth-of-type(7)","parentSelectors":["_root"],"multiple":true,"delay":"2000","clickElementSelector":"div.ui-widget-content div.slick-cell.l1","clickType":"clickOnce","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"},{"id":"txt","type":"SelectorText","selector":"div.exhContent h2","parentSelectors":["click_popup"],"multiple":false,"regex":"","delay":0},{"id":"addrss","type":"SelectorText","selector":"div.exi","parentSelectors":["click_popup"],"multiple":false,"regex":"","delay":0},{"id":"wbst","type":"SelectorText","selector":"tr.ui-contact-field:contains('WEB:')","parentSelectors":["click_popup"],"multiple":false,"regex":"","delay":0},{"id":"prfl","type":"SelectorText","selector":"p#txtProfile.exi","parentSelectors":["click_popup"],"multiple":false,"regex":"","delay":0},{"id":"cats","type":"SelectorText","selector":"p#txtCategories.exi","parentSelectors":["click_popup"],"multiple":false,"regex":"","delay":0}]}
Seems to be working. Thank you!
Here is another one which is confusing to me (I am learning, but still need some help). This one has a list of exhibitors, the list scrolls down, each is a link, which has further detail.
How would one create a site map for it? I tried several approaches but just can't seem to crack it.
Never mind. I think I figured it out.