I have been trying to utilize this tool to scrape the contant and site information from a website of all the plants and their facility managers contact information.
This is the exact URL I use (search results from their site) and it seems to go through with scraping but there is never any data under Browese. The pop ups show each individual contact info for each link in the above url and cycle through them but saves nothing. Please advise.
Unless you post your sitemap, I'm not entirely sure how you set it up and why it's not working. However, if you wanted to cycle through each link and pull the "contact details" of the plant managers. This will get it for you. Note: not all records have complete contact details and you'll see a NULL when it doesn't
{"_id":"delete-test-forum","startUrl":["http://ec2-52-202-150-226.compute-1.amazonaws.com/rmp/rmp.php?reptype=f&database=rmp&facility_name=&parent=&combined_name=&city=&county=&state=TX&zip=&execsum=&all_naics=&chemical_id=&datype=T&sortp=F&detail=0"],"selectors":[{"id":"Plant","type":"SelectorText","parentSelectors":["Links"],"selector":"h2","multiple":false,"regex":"","delay":0},{"id":"'Owner or Operator Phone","type":"SelectorText","parentSelectors":["Links"],"selector":"tr:contains('Owner or Operator Phone') td:nth-of-type(2)","multiple":false,"regex":"","delay":0},{"id":"Facility URL","type":"SelectorText","parentSelectors":["Links"],"selector":"tr:contains('Facility URL') td:nth-of-type(2)","multiple":false,"regex":"","delay":0},{"id":"Contact Name","type":"SelectorText","parentSelectors":["Links"],"selector":"tr:nth-of-type(3):contains('RMP Contact') td:nth-of-type(2)","multiple":false,"regex":"","delay":0},{"id":"Contact Title","type":"SelectorText","parentSelectors":["Links"],"selector":"tr:contains('RMP Contact Title') td:nth-of-type(2)","multiple":false,"regex":"","delay":0},{"id":"Email","type":"SelectorText","parentSelectors":["Links"],"selector":"tr:contains('RMP Contact Email') td:nth-of-type(1)+","multiple":false,"regex":"","delay":0},{"id":"Links","type":"SelectorLink","parentSelectors":["_root"],"selector":"tr:nth-of-type(n+2) a","multiple":true,"delay":0},{"id":"Reparer Name","type":"SelectorText","parentSelectors":["Links"],"selector":"tr:contains('RMP Preparer Name') td:nth-of-type(2)","multiple":false,"regex":"","delay":0},{"id":"Preparer Phone","type":"SelectorText","parentSelectors":["Links"],"selector":"tr:contains('RMP Preparer Phone') td:nth-of-type(2)","multiple":false,"regex":"","delay":0}]}