Web Scraper 1.96.18
Firefox 140.3.1esr
Debian GNU/Linux 12 (bookworm)
following https://forum.webscraper.io/t/data-not-colected-after-website-state-setup-secuence/16662/6
Hello,
To solve the case where many parameters need to be manually populated before scrape starts, could the limit of Page load delay increase from 55000 to 180000 ms (3 min), in a next version ?
Thank you very much. Best regards.
Hi,
Could you please share the URL you are trying to scrape and describe the required steps to display the data on the website?
On https://global.morningstar.com/fr/outils/screener/fonds/, it's about selecting many parameters (~20 clicks) on the left panel before the scrape starts.
Actually, due to a recent update, you should be able to use the WSS. If the URL does not change after WSS steps, the URL should not be reloaded.