Scraping a site where u have to login first

[ricco]

I have a site i login and use, i want to scrape the data from it. but scraping brings up the login window then goes away

Url: http://example.com

Sitemap:
{id:"sitemap code"}

[JanAp]

Hi,

Are you running this sitemap locally or in the Webscraper cloud?

[ricco]

local, can it still be done or

[JanAp]

It should work if you are logged in locally, make sure you are not blocking cookies.

[leemeng]

See:

Scraping a site which require login

On most modern websites, login is handled via sessions (cookies) or tokens so you would only need to login to the website before you start the scraping task (before launching WS). Once you start scraping, the website should "remember" that you have already logged in, and should no longer show a login prompt. If this doesn't work, you can try using Chrome's Autofill feature (remember name and password). Then you only need to click the "Login" or "Continue" button.