Hi,
I am trying to distract all the below.
{"id":"architects-australia","startUrl":["https://www.yellowpages.com.au/search/listings?clue=Architects&eventType=pagination&pageNumber=1]"],"selectors":[{"id":"pagination","type":"SelectorLink","parentSelectors":["root","pagination"],"selector":".navigation:LAST","multiple":false,"delay":0},{"id":"business_page","type":"SelectorElement","parentSelectors":["root","pagination"],"selector":"div.cell.find-show-more-trial:nth-of-type(n+3),div.search-contact-card.call-to-actions-4","multiple":true,"delay":0},{"id":"business_name","type":"SelectorText","parentSelectors":["business_page"],"selector":".listing-name","multiple":false,"regex":"","delay":0},{"id":"business_number","type":"SelectorText","parentSelectors":["business_page"],"selector":".contact-text:first","multiple":false,"regex":"","delay":0},{"id":"business_address","type":"SelectorText","parentSelectors":["business_page"],"selector":".listing-address","multiple":false,"regex":"","delay":0},{"id":"business_class_location","type":"SelectorText","parentSelectors":["business_page"],"selector":".listing-heading","multiple":false,"regex":"","delay":0},{"id":"Email","type":"SelectorHTML","parentSelectors":["business_page"],"selector":"div.call-to-action.first:nth-of-type(2)","multiple":false,"regex":"(?:[a-z0-9!#$%&'*+/=?^{|}~-]+(?:\\.[a-z0-9!#$%&'*+/=?^_{|}~-]+)|"(?:[\x01-\x08\x0b\x0c\x0e-\x1f\x21\x23-\x5b\x5d-\x7f]|\\[\x01-\x09\x0b\x0c\x0e-\x7f])")@(?:(?:a-z0-9?\.)+a-z0-9?|\[(?:(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\.){3}(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?|[a-z0-9-]*[a-z0-9]:(?:[\x01-\x08\x0b\x0c\x0e-\x1f\x21-\x5a\x53-\x7f]|\\[\x01-\x09\x0b\x0c\x0e-\x7f])+)\])","delay":0},{"id":"Webpage","type":"SelectorHTML","parentSelectors":["business_page"],"selector":"div.call-to-action-group:nth-of-type(2) div.call-to-action:nth-of-type(1)","multiple":false,"regex":"[-a-zA-Z0-9@:%.\+~#=]{2,256}\.[a-z]{2,6}\b([-a-zA-Z0-9@:%\+.~#?&//=]*)","delay":0}]}
Question 1:
However, somehow its doubling up the results. Some business appears several times in the CSV. Any ideas on how to resolve this?
Question 2:
The scraper is not picking up all the results. E.g there are over 7000 architects in Australia and it only comes back with 1900. Any ideas on how to resolve?
Many many thanks,
Stephen