Hello,
I am trying to scape name, emails, phone number from a membersite. www.bicsi.org. It has a member corporate search function. It has straight forward details on company name, city, email and website. When I try to scrape I choose "element" but it only grabs the first company name rather than all the companies. Should I not be choosing "element" or I am not selecting the parent correctly?
It seems to only grab "4 Liberty" top company and nothing else as the parent
Hi, can this listing view be accessed without a login? I would have to inspect the HTML to comment.
There actually is a login as I am a member of this organization.
Can I give that to you on this thread?
to share your login you can write a private message
Hi,
You can run this sitemap with a 10,000 delay and set the search query manually:
{"_id":"bicsi-org","startUrl":["https://www.bicsi.org/membership-global-community/membership/corporate-member-search"],"selectors":[{"id":"listing-wrapper","multiple":true,"parentSelectors":["_root"],"selector":"#Main_CorporateMemberSearch__bic_searchResultsContainer div.itemWrapper","type":"SelectorElement"},{"id":"name","multiple":false,"parentSelectors":["listing-wrapper"],"regex":"","selector":"[id*=\"CompanyName\"]","type":"SelectorText"},{"id":"e-mail","multiple":false,"parentSelectors":["listing-wrapper"],"regex":"","selector":"a[href*=\"mailto\"]","type":"SelectorText"},{"id":"website","multiple":false,"parentSelectors":["listing-wrapper"],"regex":"","selector":"td:contains('Website:') a","type":"SelectorText"}]}
I recommend deleting the login credentials from your post since they are publicly visible.
Thank you. I'm not sure what that means. I was curious if you could show me how to create the parent and then the child so that I can capture all the companies. Right now it seems to list everything under "4 liberty" the first company on the list when I select CA as the state.
I typed in the code provided. Thank you. I was able to get a data list that showed what I needed "company name, city, email". For some reason it would only populate "4 liberty" as the company name and not select the other companies.
Hi,
Could you describe the exact steps you are taking in the extension?
I am getting the correct output:
That's what I'm trying to get. Here is what I did.
Id - listing-wrapper
Type - Element
Multiple - Yes
I manually input into selector line - #Main_CorporateMemberSearch__bic_searchResultsContainer div.itemWrapper
I then click on the ID and add the following:
Id - Company
Type - Text
Selector - Select
Multiple - NO
I click on the first company name "4 liberty" and save.
I continue to do this same step for the other two categories for city and email
After that I click on Scrape under Sitemap and that does not seem to scape anything so I must be not doing it correctly.
Any help would be great!
Did you try to import the sitemap code I posted earlier?
Click 'Create new Sitemap -> Import Sitemap'
I did not previously but did not. It came up great. I still cannot download the data. I click on Sitemap drop down and select scrape but nothing happens.
