Pagination for used trucks

How to?
#1

I'm trying to scrape cars.com for a used truck, but pagination never seems to work. All of the CSVs I create have 30 or less rows, whereas the website has 100+ entries. Can someone help me with pagination here?

Url: https://www.cars.com/for-sale/searchresults.action/?mdId=21095&mdId=21115&mdId=21097&mdId=21101&mdId=21775&mkId=20015&rd=99999&searchSource=QUICK_FORM&zc=23452

Sitemap:
{"_id":"f150","startUrl":["https://www.cars.com/for-sale/searchresults.action/?mdId=21095&mdId=21115&mdId=21097&mdId=21101&mdId=21775&mkId=20015&rd=99999&searchSource=QUICK_FORM&zc=23452"],"selectors":[{"id":"pagination","type":"SelectorLink","parentSelectors":["_root","pagination"],"selector":".page-list a","multiple":true,"delay":0},{"id":"link","type":"SelectorLink","parentSelectors":["_root","pagination"],"selector":"a.shop-srp-listings__listing","multiple":true,"delay":0},{"id":"type","type":"SelectorText","parentSelectors":["link"],"selector":"h1.cui-heading-2--secondary","multiple":false,"regex":"","delay":0},{"id":"price","type":"SelectorText","parentSelectors":["link"],"selector":"span.vehicle-info__price-display","multiple":false,"regex":"","delay":0},{"id":"miles","type":"SelectorText","parentSelectors":["link"],"selector":"div.vdp-cap-price__mileage--mobile","multiple":false,"regex":"","delay":0}]}

#2

When the url indexes with every new page, you can use the square brackets in the metadata url to paginate. Here is an example from your url:

Orig:
https://www.cars.com/for-sale/searchresults.action/?mdId=21095%2C21115%2C21097%2C21101%2C21775&mkId=20015&page=1&perPage=20&rd=99999&searchSource=PAGINATION&sort=relevance&zc=23452

New:
https://www.cars.com/for-sale/searchresults.action/?mdId=21095%2C21115%2C21097%2C21101%2C21775&mkId=20015&page=[1-20]&perPage=20&rd=99999&searchSource=PAGINATION&sort=relevance&zc=23452

Replace your url with the new one above in the metadata url of your scraper definition and it should paginate for 1-20 pages.