Is there a way to type in a new URL (i.e. one that is different from the start URL)? Or, even less complex, if the start URL is google.com, can the scraper type something defined into the input box and click submit and then scrape the given results?
Thanks
Hello again!
You can have lots and lots of URL's in your sitemap, you have to create a new sitemap first (or edit one that already exists), and then open 'Edit metadata'...
There you have to hit the little [ + ] button to add more URLs to the sitemap...
i've compacted the google search URL so it's easy to understand:
https://www.google.com/search?source=hp&q=not+so+little+search
You can see that search query goes after equal sign, if you want it to be a phrase, you have to keep plus sign after each word.
Happy scraping!
Is it possible to scrape different elements from different start sites? For example, could one start link be a google search (like your example above) that then scrapes URLs and another be a more complex pagination of a retail store that scrapes totally different elements.
Hi!
You can put as much selectors for scrape as you want, but keep in mind that their name can be identical on different websites, thus resulting in data being mixed. Or missing (filled with "null"), because element names are too different.
It's recommended to have all sitemaps bound to a certain websites, to keep up with precise results.
