Hi,
Sorry if this has been asked before, I didn't find it in the archives.
I was wondering whether you can scrape multiple "sub-pages" of a said URL path using Web Scraper, when you don't know the pages URL but just the "parent" path.
Example (fake website):
I want to scrape all the "child pages" of the URL path "best-articles" : news.com/best-articles. And I don't know beforehand neither how many pages there are, nor what are the URL of the pages.
There might be 3 pages:
news.com/best-articles/how-to-scrape
news.com/best-articles/best-scraping-tools
news.com/best-articles/why-I-love-scraping
How to scrape those pages if I don't know their URLs? Is that possible with Web Scraper?