Create URL from username

I'm scraping a page and extracting various text fields. One of those text fields is the username of that page's owner. I then want to scrape a page from a secret URL, something like: https://example.com?u=username. But that URL is not on the page I'm scraping. I need to construct it within Web Scraper, maybe through a regex?

i.e. I scraped "username" and now want to scrape: "https://example.com?u=username" which is a different and secret page from the original page.

Additionally I'd like to combine the info from the text fields on the original page I'm scraping plus the info I scrape from the secret page into one CSV record.

1 Like