I've spent hours trying to set this up but I couldn't figure it out.
Requirement:
- To Scrape multiple sets of text in a webpage
- Some sets of text doesn't have a datapoint (e.g. not all sets have a website)
This is the page i'm trying to scrape:
http://www.yp.com.hk/s-Limited/w-北角/p1/ch/
Here's my sitemap:
{"_id":"yp-limited-northpoint","startUrl":["http://www.yp.com.hk/s-Limited/w-北角/p1/ch/"],"selectors":[{"id":"company-name","type":"SelectorText","parentSelectors":["_root"],"selector":".cname a, div:nth-of-type(6) span.cname","multiple":false,"regex":"","delay":0},{"id":"Address","type":"SelectorText","parentSelectors":["_root"],"selector":"a span.addr","multiple":false,"regex":"","delay":0},{"id":"Phone","type":"SelectorText","parentSelectors":["_root"],"selector":"nobr a.blacklink, div:nth-of-type(6) table.tbl_addr:nth-of-type(1) nobr","multiple":false,"regex":"","delay":0},{"id":"Industry","type":"SelectorText","parentSelectors":["_root"],"selector":".category li:nth-of-type(1) a","multiple":false,"regex":"","delay":0},{"id":"website","type":"SelectorText","parentSelectors":["_root"],"selector":"div.listing_div:nth-of-type(n+7) div div:nth-of-type(1) a.bluelink","multiple":false,"regex":"","delay":0}]}
What I'm getting right now is simply the first set of info only.
What I need is for it to continue scraping the other sets of info,
and for the sets that doesn't have a particular info, leave it as nil, rather than scraping the info from another set.
Much appreciated if someone can give me a hand on how to set this up properly.
Thanks