How to extract from a .XML.GZ sitemap?

How to?
#1

Hey all, looking at getting information from a category on a large site.

Easiest way is going through the sitemap as I can't get the pagination to work correctly.

There's a specific sitemap for the category I'm targeting but it's stores as a .XML.GZ.

When I try to run the scrape, it just downloads the zipped XML and doesn't;t start the scrape.

Anyone know how to get round this?

#2

WS is probably not the tool for this. As you have already downloaded the file, you can unzip it with 7-zip and parse the XML file with Python or other language (they all have XML parsing libraries).