Many null rows due to unloaded pages

there is a lot of null values in the final sitemap due to pages not loading during the scrape. script should recrawl those with null value.