Problem:
URL returns a JSON payload; there is NO html to speak of, so there's nothing to 'select'.
Can webscraper handle this use case?
We simply need WS to pass along the payload; no specific selectors.
Why? Because it would be convenient and we make use of Webscraper's other nice features (proxies, webhooks, etc). We also use WS for scraping of regular web pages, and it only makes sense to do scraping-tasks all in one place. We have a special use case to grab JSON for some URLs (the JSON payload provides more details than what's exposed in the HTML page, for a particular website).
Is there something that can be done in the sitemap to simply grab the entire response and forward it? Or put another way, can we just avoid having to define specific selectors ?