Hi, new here and loving https://webscraper.io/. The problem I am having is how to include the parent node in the same record. Let explain with a scenario. So what I am trying to do is scrape data from this site...truepeoplesearch.com (name, age, phone, email). It starts at the main contact or root and then goes to each of their "possible relatives" pages and scrapes their data. I am able to successfully scrape the records of each possible relative but I would also like to include the root or main contact in the same record. The only way I could think to do this was to create new selectors in the root but this would add unnecessary columns in the export. Any help would be greatly appreciated!
Sitemap:
{"_id":"true_people_search","startUrl":["https://www.truepeoplesearch.com/results?name=Billy%20Ray%20Scott&citystatezip=Oklahoma%20City%2C%20OK&rid=0xr"],"selectors":[{"id":"relatives","type":"SelectorLink","parentSelectors":["_root"],"selector":"a[data-link-to-more='relative']","multiple":false,"delay":0},{"id":"address","type":"SelectorText","parentSelectors":["relatives"],"selector":"div:nth-of-type(4) .row a.olnk","multiple":false,"regex":"","delay":0},{"id":"Age","type":"SelectorText","parentSelectors":["relatives"],"selector":"span.content-value","multiple":false,"regex":"","delay":0},{"id":"phone1","type":"SelectorText","parentSelectors":["relatives"],"selector":".col-12 > div:nth-of-type(2) a[data-link-to-more='phone']","multiple":false,"regex":"","delay":0},{"id":"phone2","type":"SelectorText","parentSelectors":["relatives"],"selector":".col-12 > div:nth-of-type(3) .col a","multiple":false,"regex":"","delay":0},{"id":"phone3","type":"SelectorText","parentSelectors":["relatives"],"selector":".col-12 > div:nth-of-type(4) .col a","multiple":false,"regex":"","delay":0},{"id":"phone4","type":"SelectorText","parentSelectors":["relatives"],"selector":"div.pl-sm-2:nth-of-type(1) .col a","multiple":false,"regex":"","delay":0},{"id":"phone5","type":"SelectorText","parentSelectors":["relatives"],"selector":".collapse div:nth-of-type(2) .col a","multiple":false,"regex":"","delay":0},{"id":"phone6","type":"SelectorText","parentSelectors":["relatives"],"selector":".collapse div:nth-of-type(3) .col a","multiple":false,"regex":"","delay":0},{"id":"phone7","type":"SelectorText","parentSelectors":["relatives"],"selector":".collapse div:nth-of-type(4) .col a","multiple":false,"regex":"","delay":0},{"id":"phone8","type":"SelectorText","parentSelectors":["relatives"],"selector":"div:nth-of-type(5) a.link-to-more","multiple":false,"regex":"","delay":0},{"id":"phone9","type":"SelectorText","parentSelectors":["relatives"],"selector":"div.pl-sm-2:nth-of-type(6) .col a","multiple":false,"regex":"","delay":0},{"id":"phone10","type":"SelectorText","parentSelectors":["relatives"],"selector":"div:nth-of-type(7) .col a.link-to-more","multiple":false,"regex":"","delay":0},{"id":"phone11","type":"SelectorText","parentSelectors":["relatives"],"selector":"div:nth-of-type(8) .col a","multiple":false,"regex":"","delay":0},{"id":"email1","type":"SelectorText","parentSelectors":["relatives"],"selector":"div:nth-of-type(10) div.row:nth-of-type(2) div.content-value","multiple":false,"regex":"","delay":0},{"id":"email2","type":"SelectorText","parentSelectors":["relatives"],"selector":"div:nth-of-type(10) div:nth-of-type(3) div.content-value","multiple":false,"regex":"","delay":0},{"id":"email3","type":"SelectorText","parentSelectors":["relatives"],"selector":"div:nth-of-type(10) div:nth-of-type(4) div.content-value","multiple":false,"regex":"","delay":0}]}