Some valid URLs not accepted as start URL

I have saved a local copy of a financial web page (stock prices) that doesn't scrape very well. I assume it is because the content is changing too quickly. I'm unable to even create a sitemap to access this offline page. The following URLs are all rejected with the message "The start URL is not a valid URL", even though my browser accepts them all.

Url: file:///home/usr/file.html
Url: http://0.0.0.0:8000/Documents/file.html
Url: http://localhost/file.html

Sitemap:
{id:"sitemap code"}
Unable to create a sitemap

1 Like

This is a known limitation in WS. I don't know why it's there. It won't take localhost or file URLS.

You can work around that by uploading your file to a web host or hosting it on a local web server, either one will need a FQDN. If you don't have a FQDN you can fake one just by adding it to the HOSTS file, e.g.:

www.myfakeserver..net 127.0.0.1

Then just point WS to www.myfakeserver..net

Lee,

Thanks you so much for that response. I was thinking about trying something like you suggest, but I had not worked out the details yet.

Thanks again,

Jim