Web Scraper version:
Chrome version:
OS: Windows 7, Windows 10
Sitemap:
{"_id":"danmurphys_redwine_page201to300","startUrl":["https://www.danmurphys.com.au/red-wine/all?page=[201-300]"],"selectors":[{"id":"products","type":"SelectorElement","parentSelectors":["_root"],"selector":"ul.row div.ng-star-inserted li.col-xs-6, ul.row > li.col-xs-6","multiple":true,"delay":0},{"id":"prod_link","type":"SelectorLink","parentSelectors":["products"],"selector":"a.ng-star-inserted","multiple":false,"delay":0},{"id":"name","type":"SelectorText","parentSelectors":["prod_link"],"selector":"span.product-brand","multiple":false,"regex":"","delay":0},{"id":"name_sub","type":"SelectorText","parentSelectors":["prod_link"],"selector":"span.product-name","multiple":false,"regex":"","delay":0},{"id":"details","type":"SelectorText","parentSelectors":["prod_link"],"selector":"li.list--details_item","multiple":true,"regex":"","delay":0}]}
This works just fine. My issue is, when we scrape data, we have fields/column names that are hyphened such as prod_link-href. This caused an error in MySQL when uploading the CSVs to my Database. While it can be successfully be uploaded, referencing on a dashed/hyphened name column on SQL is strictly prohibited.
It's kind of an effort to open a bunch of CSV files and change every hyphen to an underscore.
Thanks!