How to scrape a live website that updates within seconds?

Hello, I try to scrape this live chat on the right side of this website: Live feed - Galaxus

It works for the 6 entities shown when starting the scraper but obviously doesn't start over again to get the new entries. Is there a way to loop the scraping process so it starts over all 10 seconds for example?

{"_id":"galaxuslive2","startUrl":["https://www.galaxus.ch/de/wiki/2736"],"selectors":[{"id":"event","type":"SelectorLink","parentSelectors":["_root","event"],"selector":".styles_wrapper__1He0k a","multiple":true,"delay":0},{"id":"Hauptkategorie","type":"SelectorText","parentSelectors":["event"],"selector":"div.breadcrumbView_withIcon__3mWwP:nth-of-type(1) a","multiple":false,"regex":"","delay":0},{"id":"Unterkategorie1","type":"SelectorText","parentSelectors":["event"],"selector":"div.breadcrumbView_withIcon__3mWwP:nth-of-type(2) a","multiple":false,"regex":"","delay":0},{"id":"Unterkategorie2","type":"SelectorText","parentSelectors":["event"],"selector":"div.breadcrumbView_withIcon__3mWwP:nth-of-type(3) a","multiple":false,"regex":"","delay":0},{"id":"Produktname","type":"SelectorText","parentSelectors":["event"],"selector":"span.productDetailBreadcrumb__NoLinkBreadcrumbStyled-yip624-0","multiple":false,"regex":"","delay":0}]}

Thank you for your advice

Cheers

@Dae You would need some sort of a scheduler that is already available in the cloud version. Every 10 seconds is a bit too fast tho...
Maximum is every minute.

1 Like

Thank you very much. it worked with the cloud. However, it's only possible to do it for approx. 3 hours with the free version