Hey guys, long time no see.
I want to scrape this website but I'm having some problems and I hope I can get some help here.
Website:https://www.bcpharmacists.org/search-pharmacy
Goal: For example, in City, I want to choose Victoria, BC and scrape all the results, I'm only intresed in PHARMACY NAME+ADDRESS. I think this has to do with iFrame or something like that I'm not an expert lol
thank you guys for your time
Unfortunately, no. This is a from submit navigation and the scraper will not be able to scrape it.
If this is a one-off or infrequent scrape, you can just add a custom delay at the top to give yourself enough time to manually click on the dropdown and search button, i.e. you need to finish clicking and have the results shown before the custom delay ends and the scraper starts. In this example, the custom delay is 25 sec:
{"_id":"bcpharmacists","startUrl":["https://www.bcpharmacists.org/search-pharmacy"],"selectors":[{"id":"custom delay","type":"SelectorElementClick","parentSelectors":["_root"],"selector":".search input.input-search","multiple":false,"delay":"25000","clickElementSelector":".search input.input-search","clickType":"clickOnce","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"Row wrappers","type":"SelectorElement","parentSelectors":["_root"],"selector":"tbody > tr","multiple":true,"delay":0},{"id":"Pharmacy","type":"SelectorText","parentSelectors":["Row wrappers"],"selector":"td:nth-of-type(1)","multiple":false,"regex":"","delay":0},{"id":"Address","type":"SelectorText","parentSelectors":["Row wrappers"],"selector":"td:nth-of-type(2)","multiple":false,"regex":"","delay":0}]}