Hello, I'm a webscraper.io newbie using the FireFox extension.
I am trying to scrape data from all locations from the URL: Data Center Locations: Top Cities, States, Countries and Regions.
If I watch the scraper run, I can see it actually go through all 79(currently, it's dynamic) pages of the website and then start drilling into each location to get additional info. In this current timeframe there should be 3115 locations, but my output data only shows 2428 locations. Is there a limit as to how much data can be scraped with the webscraper.io extension?
TIA!!!!
Sitemap:
{"_id":"DataCenters","startUrl":["https://www.datacenters.com/locations"],"selectors":[{"id":"pagination","parentSelectors":["_root","pagination"],"paginationType":"clickMore","type":"SelectorPagination","selector":"button.Control__control__ijHLR:nth-of-type(n+2)"},{"id":"dc-element","parentSelectors":["pagination"],"type":"SelectorElement","selector":"div.LocationTile__location__tZKRS","multiple":true},{"id":"dc-owner","parentSelectors":["dc-element"],"type":"SelectorText","selector":"div.LocationTile__provider__BSecG","multiple":false,"regex":""},{"id":"dc-name","parentSelectors":["dc-element"],"type":"SelectorText","selector":"div.LocationTile__name__NrDKr","multiple":false,"regex":""},{"id":"dc-address","parentSelectors":["dc-element"],"type":"SelectorText","selector":"div.LocationTile__address__Utj30","multiple":false,"regex":""},{"id":"dc-element-detail-link","parentSelectors":["dc-element"],"type":"SelectorLink","selector":"a","multiple":false,"linkType":"linkFromHref"},{"id":"dc-phone","parentSelectors":["dc-element-detail-link"],"type":"SelectorText","selector":".LocationProviderDetail__phoneItemWrapper__PpePG span","multiple":false,"regex":""},{"id":"dc-totalspace","parentSelectors":["dc-element-detail-link"],"type":"SelectorText","selector":"div.LocationProviderDetail__providerInfoItem__kuPAs:nth-of-type(3) span","multiple":false,"regex":""},{"id":"dc-colocationspace","parentSelectors":["dc-element-detail-link"],"type":"SelectorText","selector":"div.LocationProviderDetail__providerInfoItem__kuPAs:nth-of-type(4) span","multiple":false,"regex":""},{"id":"dc-totalpower","parentSelectors":["dc-element-detail-link"],"type":"SelectorText","selector":"div.LocationProviderDetail__providerInfoItem__kuPAs:nth-of-type(5) span","multiple":false,"regex":""}]}