What websites can I use this extension on?

#1

How do I know what websites allow this extension to scrape its contents? Not looking for any legal trouble. Any ideas?

For example here is the website I'm looking to scrape from:

https://www.redfin.com/

I read somewhere that this application acts as a user and therefore technically isn't web scraping so this wouldn't violate redfin terms of service. How can I know what the robots.txt allows about scraping?

#2

Web Scraper is merely a tool so it is up to you to determine the legal and ethical issues about its use.

Robots.txt is for search engine crawlers (e.g. Google) so Web Scraper does not look at this file (i.e. it has no effect).