Hello, I'm trying to scrape some pricing information and dealer information for price comparisons amongst autosale aggregator sites. The issue i'm running into is as follows - I can successfully scrape two pages when I have Element Click set to "Click Once," however, this terminates itself after two vehicles and does not continue beyond the first page change. When I have Element Click set to "Click More," the scraper successfully cycles through pages, however no data is returned. I feel like I'm missing something obvious..any help would be appreciated.
Sitemap:
{"_id":"cargurusfinal","startUrl":["https://www.cargurus.com/Cars/inventorylisting/viewDetailsFilterViewInventoryListing.action?sourceContext=carGurusHomePageModel&newSearchFromOverviewPage=true&inventorySearchWidgetType=AUTO&entitySelectingHelper.selectedEntity=&entitySelectingHelper.selectedEntity2=&zip=75001&distance=50&searchChanged=true&modelChanged=true&filtersModified=true#listing=220184655"],"selectors":[{"id":"masterframe","type":"SelectorElement","parentSelectors":["_root"],"selector":"div.containsListingSearchResults","multiple":false,"delay":0},{"id":"anchorframe","type":"SelectorElement","parentSelectors":["masterframe"],"selector":"main","multiple":false,"delay":0},{"id":"textboxes","type":"SelectorElement","parentSelectors":["anchorframe"],"selector":"div.cg-listingStub-bodySection:nth-of-type(5)","multiple":false,"delay":0},{"id":"textrip","type":"SelectorText","parentSelectors":["textboxes","pageanchor"],"selector":"parent","multiple":true,"regex":"","delay":0},{"id":"pageanchor","type":"SelectorElement","parentSelectors":["anchorframe"],"selector":"div.cg-listingDetailFauxPage-wrap","multiple":true,"delay":0},{"id":"clickthrough","type":"SelectorElementClick","parentSelectors":["pageanchor"],"selector":"parent","multiple":true,"delay":"7500","clickElementSelector":"a.mb-scrollButtons.mb-right","clickType":"clickOnce","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"}]}