I had a problem with the scraper and pagination. So I created a scape that would do one page at a time. The volume of scrape data is relatively low, so this was acceptable. However, now when I put in the url for page 2..3.. etc., the scraper window still loads page 1 and I receive the previously scraped data. I cannot get it to scrape any pages beyond page one.
I have cleared my cache of any cookies and site data pertaining to that domain.
I have made sure that "disable cache" is checked under Developer Tools -> Networking tab.
Url: YoungLiving | Vitality Dietary Oils
Sitemap:
{"_id":"vitality-oils","startUrl":["https://www.youngliving.com/us/en/category/vitality-dietary-oils?page=2"],"selectors":[{"delay":0,"id":"product-link","multiple":true,"parentSelectors":["_root"],"selector":"a.w-100","type":"SelectorLink"},{"delay":0,"id":"name","multiple":false,"parentSelectors":["product-link"],"regex":"","selector":"h1","type":"SelectorText"},{"delay":0,"id":"image","multiple":false,"parentSelectors":["product-link"],"selector":"img.pdp-product-image","type":"SelectorImage"},{"delay":0,"id":"product-id","multiple":false,"parentSelectors":["product-link"],"regex":"","selector":"span.skuIdentifier","type":"SelectorText"},{"delay":0,"id":"product-price","multiple":false,"parentSelectors":["product-link"],"regex":"","selector":"div.sale-price","type":"SelectorText"}]}
