We intend to use webscraper to scrape a site. We manage to get some data from the scraper output. However, there is a certain piece of data that the scraper cannot handle properly. It is a date. The date is different, depending what timezone the browser (in this case, the scraper) is in. But there is no time in there, so it is hard, or may be impossible, to interpret the time value correctly. So, for this piece of data, we get a json response instead, because the json response has both date and time, and is not dependent on the client/browser timezone. The webscraper browser extension is able to scrape the json response and return the correct data. However, when run in the cloud, the scraper gives empty strings for the scraped json fields.
Can the scraper scrape a json response? (assuming the json fields are always in the same order)
Sitemap :
{"_id":"powerballnextdrawjson","startUrl":["https://www.powerball.com/api/v1/estimates/powerball?_format=json"],"selectors":[{"id":"nextDrawDate","type":"SelectorText","parentSelectors":["_root"],"selector":"li:nth-of-type(2) span.type-string","multiple":false,"regex":"","delay":0},{"id":"nextJackpot","type":"SelectorText","parentSelectors":["_root"],"selector":"li:nth-of-type(3) span.type-string","multiple":false,"regex":"","delay":0},{"id":"nextCashValue","type":"SelectorText","parentSelectors":["_root"],"selector":"li:nth-of-type(4) span.type-string","multiple":false,"regex":"","delay":0},{"id":"testField","type":"SelectorElement","parentSelectors":["testField"],"selector":"li:nth-of-type(2) span.type-string","multiple":false,"delay":0}]}