What to do after a 5xx server error?

Tips and tricks
#1

Hello,

The website I'm trying to scrape sometimes times out with a 504 error (it seems it has issues loading some data). But when I try the same page, it usually loads fine as the processing was finished on the background, but Webscraper finishes the job when it gets a 5xx error. Is there any way to retry or refresh when getting a 5xx webserver error instead of exiting?

Thanks in advance.

#2

Hi,

This issue can be addressed by using the cloud solution (paid version) of Webscraper.