Can URLs be built dynamically based on element data

How to?
#1

I am trying to scrape a site that goes through a number of iFrames to get to a URL for the page I want to get the data from, but instead of trying to navigate the iFrames (which I can't seem to do), I have everything I need on the first page to build the URL to the actual page I want to scrape....how can I do that.

So example.....

Page examplesite.com - This website is for sale! - example site Resources and Information. contains a whole load of information, and includes an element for the product ID 123456789 which I can grab, but there is no link to the page I want to scrape which is examplesite.com - This website is for sale! - example site Resources and Information.

I can supply all of the URL, and I have the ID, I just can't work out how to stitch them together to create the link to then crate that navigation I need.

Any help would be appreciated (and don't bother trying to solve the iFrame issues....that's a dead end).

#2

Hi!

Generating the target link dynamically within the sitemap is not something Web Scraper can do. You would have to scrape the elements separately, then combine the elements in Excel (or whatever you are using), and then set the new links as start URLs.