Hi all-
Searched for similar topics (I know this has come up before) but couldn't find a solution that worked for me.
I've been trying to consolidate review data for a couple of laptops but for some reason the pagination seems to stop after the third page of reviews. I've played with the request interval and page load times, used both the beta pagination and link selectors, but I can't seem to figure out why it's stopping.
The pagination link doesn't appear to by dynamic or anything, I've been using ".next a" and it works but stops.
Any ideas?
Sitemap:
{"_id":"bby-all-review-template","startUrl":["https://www.bestbuy.com/site/reviews/hp-15-6-touch-screen-laptop-intel-core-i7-16gb-memory-512gb-ssd-natural-silver/6477889?variant=A&skuId=6477889"],"selectors":[{"id":"pagination","parentSelectors":["_root","pagination"],"paginationType":"auto","selector":".next a","type":"SelectorPagination"},{"id":"Element Select","parentSelectors":["_root","pagination"],"type":"SelectorElementScroll","selector":"li.review-item","multiple":true,"delay":2000,"elementLimit":500},{"id":"Reviewer Name","parentSelectors":["Element Select"],"type":"SelectorText","selector":".review-item-header strong","multiple":false,"regex":""},{"id":"Review Title","parentSelectors":["Element Select"],"type":"SelectorText","selector":"h4","multiple":false,"regex":""},{"id":"Complete Heading","parentSelectors":["Element Select"],"type":"SelectorText","selector":"div.review-heading","multiple":false,"regex":""},{"id":"Verified Purchaser","parentSelectors":["Element Select"],"type":"SelectorText","selector":".verified-purchaser-mv-wrapper span.overlayTrigger","multiple":false,"regex":""},{"id":"Post Date","parentSelectors":["Element Select"],"type":"SelectorHTML","selector":"div.posted-date-ownership","multiple":false,"regex":""},{"id":"Review Text","parentSelectors":["Element Select"],"type":"SelectorText","selector":"p.pre-white-space","multiple":false,"regex":""}]}
