Dear Forum, I am trying to scrape the email addresses from a couple of companies on
https://www.sgprocessindustries.com/company-listings
however when I scrape and pangiate, the webscraper only scrapes up to 204 max (when it should scrape around 400 (Pg 1-40, 10 listing per page) listings and it doesnt scrape the email addresses properly. Only some Emails get scraped. Also the page order in which it scrapes is random instead of in order i.e "Page 1, page 2, page 3......"
Here is the sitemap.
{"_id":"processindustrieslistings","startUrl":["https://www.sgprocessindustries.com/company-listings?page=[1-40]"],"selectors":[{"id":"pagelinks_name","type":"SelectorLink","parentSelectors":["_root"],"selector":"h3 a","multiple":true,"delay":0},{"id":"businessname","type":"SelectorText","parentSelectors":["pagelinks_name"],"selector":".col-md-9 h3","multiple":false,"regex":"","delay":0},{"id":"addresses","type":"SelectorText","parentSelectors":["pagelinks_name"],"selector":"p:nth-of-type(1)","multiple":false,"regex":"","delay":0},{"id":"phone","type":"SelectorText","parentSelectors":["pagelinks_name"],"selector":".valuephone a","multiple":false,"regex":"","delay":0},{"id":"fax","type":"SelectorText","parentSelectors":["pagelinks_name"],"selector":".valuefax a","multiple":false,"regex":"","delay":0},{"id":"contact names","type":"SelectorText","parentSelectors":["pagelinks_name"],"selector":"p:nth-of-type(2)","multiple":false,"regex":"","delay":0},{"id":"website","type":"SelectorText","parentSelectors":["pagelinks_name"],"selector":".valuewebsite a","multiple":false,"regex":"","delay":0},{"id":"emails","type":"SelectorText","parentSelectors":["pagelinks_name"],"selector":".company-enquires h2","multiple":false,"regex":"","delay":0}]}
Thanks a ton!