How to Iterate Drop Down entries -> open every search result -> scrape data -> iterate next site button

How to?
#1

Hello community,

I'm trying to scrape a complex website for my bachelor thesis. There are three problems to handle with.

  1. The Web Scraper should open the drop down menu "conference" and iterate all years automaticly and open the result page.

  2. Then all search results must be open to extract the the informationen on the detail site.

  3. The search results of each conference year are on many pages. So the web Scraper needs to iterat all pages.

Other Tools like mozenda and parseHub can handle with such complex tasks.

Is there any chance to do this with WebScraper.io?

Thank you in advance!

Url: https://eera-ecer.de/ecer-programmes/

Sitemap: Unfortunately i didn't know how to start with the drop down menu, so i don't have a sitemap example yet.