So I am scraping a website, but sometimes the page doesn't fully load and the scraper continues onto next page. Any way to force scraper to wait until page is loaded?
btw the delay and page load are set to 21000
Sitemap: {"_id":"indiana","startUrl":["Indiana Jones and the Dial of Destiny (2023) Showtimes | Fandango"}]}
@somethingsomewhere Hello, are you referring to the 'THEATERS NEAR' element?
If so - you can try to add an additional 'Element scroll' selector with the maximum 'Delay' value set to 60'000 ms, however after performing tests it does not seem as if this element would be rendered even within such a timeframe, therefore this is most likely a technical glitch within the website itself.
'Theater near' works for me, but when the orange button on that page is clicked, the next page which is the seat map sometimes loads for a long time and the scraper moves on to the next link before extracting any data. The first image attached is the loaded 'theater near' page and the second image is the loading screen
