Currently, cloud scraper is producing csv that looks like:
category,product-url
"Grocery, etc",http://abc.com
How can I parse so that its not affected by the ',' in "Grocery, etc"?
Hi!
You have to use regex in your selector.
in your case, to limit result to just one word, you shall use next value:
\w+
I usually use regexpal to try and error the result.
P.S. please note that WebScraper doesn't support 'global' flag yet.
Actually its not one word that I want. Sorry for the bad example.
I just want to be able to parse the records so that its not affected by ','.
like "Grocery, etc" can become "Grocery etc" when scraped.
or any other suggestion.
This is caused by cloud scraper does not consistently use "," as separator like chrome extension version.
If
"Grocery, etc","http://abc.com" I have no problem skipping the ','
If you are writing code to parse the CSV file use a CSV reader library.
Some examples:
https://docs.python.org/3/library/csv.html
I have found the solution. I am using NiFi so its a bit hard. Thanks.