Hi,
I practice webscrapping with the domain www.immobilienscout24.de. My problem is, that it doesnt scrap until the last page and want to ask, if my proceed is right:
original-domain: this side shows flats in a certain city: https://www.immobilienscout24.de/Suche/S-T/Wohnung-Miete/Nordrhein-Westfalen/Koeln?enteredFrom=one_step_search
The edited link for the webscraper for scraping pages 1-44: https://www.immobilienscout24.de/Suche/S-T/P-[1-44]/Wohnung-Miete/Nordrhein-Westfalen/Koeln
My selector-graph: _root-----links----element----coldrent, number of rooms, size of the flat
root = my edited link
links = the 20 links you can see on my edited link (to reach the concrete flat-page)
element = the element/frame where you can find my search-criterias (number of rooms etc.)
and now via "text" scraping the Information: coldrent, number of rooms, size of the flat
When I start scrapping it works fine about hours; every 2-3 seconds it srcaps 1 flat. But it doesnt scrap until the last page. Before it reaches the last page the process become very slow and following errors appears in the backround-window:
background_script.js:1 {"error":"tab load event timeout","timestamp":1522995808,"level_name":"WARNING","message":"request timed out. continuing"}
{"timestamp":1522995808,"level_name":"INFO","message":"will not be sleeping for additional time"}
{"timestamp":1522995808,"level_name":"PROFILE","message":"101 DataExtractor getData"}
{"timestamp":1522995808,"level_name":"PROFILE","message":"60169 ms job execution"}
{"url":"https://www.immobilienscout24.de/expose/103280380","timestamp":1522995808,"level_name":"INFO","message":"Job execution started"}
Web Scraper version: 0.3.7
Chrome version: 65.0.3325.181
OS: Windows 10
Would be fine to finde some help here 
Thx!