Amazon Pagination not working, only first page

How to?
#1

Describe the problem. amazon pagination wont go past the first page, was working previously

Url: https://www.amazon.com/s?k=ram+mounts&ref=nb_sb_noss_1

Sitemap:
{"_id":"amazonscraper","startUrl":["https://www.amazon.com/s/ref=nb_sb_noss_2?url=search-alias%3Daps&field-keywords=Ram+Mounts+"],"selectors":[{"id":"detail page","type":"SelectorLink","parentSelectors":["Element Select"],"selector":"a.a-link-normal","multiple":false,"delay":0},{"id":"Element Select","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.sg-col-inner > div.s-include-content-margin div.sg-row h5.a-color-base","multiple":true,"delay":"3000","clickElementSelector":"ul.a-pagination a","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueCSSSelector"},{"id":"Price","type":"SelectorText","parentSelectors":["detail page"],"selector":"td.a-span12 span.a-size-medium","multiple":false,"regex":"","delay":0},{"id":"Asin","type":"SelectorText","parentSelectors":["detail page"],"selector":"tr:contains('ASIN') td.a-size-base","multiple":false,"regex":"","delay":0},{"id":"model number","type":"SelectorText","parentSelectors":["detail page"],"selector":"tr:contains('Item model number') td.a-size-base","multiple":false,"regex":"","delay":0},{"id":"Sellers","type":"SelectorLink","parentSelectors":["detail page"],"selector":"div#olp_feature_div.feature span:nth-of-type(1) a","multiple":false,"delay":0},{"id":"Seller-select","type":"SelectorElement","parentSelectors":["Sellers"],"selector":"div.a-section div.a-section div.a-row:nth-of-type(n+2)","multiple":true,"delay":0},{"id":"Seller-Alt-Name","type":"SelectorText","parentSelectors":["Seller-select"],"selector":"h3.a-spacing-none","multiple":false,"regex":"","delay":0},{"id":"Seller-Alt-Price","type":"SelectorText","parentSelectors":["Seller-select"],"selector":"span.a-size-large","multiple":false,"regex":"","delay":0},{"id":"Condition","type":"SelectorText","parentSelectors":["Seller-select"],"selector":"div.a-section span.a-size-medium","multiple":false,"regex":"","delay":0},{"id":"Product Rating","type":"SelectorText","parentSelectors":["detail page"],"selector":"div.centerColAlign span.a-declarative span.a-size-base","multiple":false,"regex":"","delay":0}]}

#2

Amazon is tricky since they deploy some really good anti-scraping technology aimed at preventing competitors from taking the data.

There is a workaround:

Since the URL changes per page, we are able to use a dynamic URL within the metadata start page area.
I used 2 links, 1 the start page and then one to cycle through pages 2-20

Since we're using this as our pagination mechanism, I changed your initial elementClickSelector to a ElementSelector. Mostly everything else remains the same

Let me know if this does the trick. . It looks like it's working

{"_id":"amazonscraper","startUrl":["https://www.amazon.com/s/ref=nb_sb_noss_2?url=search-alias%3Daps&field-keywords=Ram+Mounts+","https://www.amazon.com/s?k=Ram+Mounts&lo=list&page=[2-20]"],"selectors":[{"id":"detail page","type":"SelectorLink","parentSelectors":["Element Select"],"selector":"h5.a-color-base a.a-link-normal","multiple":false,"delay":0},{"id":"Element Select","type":"SelectorElement","parentSelectors":["_root"],"selector":"div.rush-component div.sg-col-4-of-12.sg-col-16-of-24 > div.sg-col-inner, div.sg-col-inner > div.s-include-content-margin div.sg-col-4-of-12.sg-col-16-of-24 > div.sg-col-inner","multiple":true,"delay":"3000"},{"id":"Price","type":"SelectorText","parentSelectors":["detail page"],"selector":"td.a-span12 span.a-size-medium","multiple":false,"regex":"","delay":0},{"id":"Asin","type":"SelectorText","parentSelectors":["detail page"],"selector":"tr:contains('ASIN') td.a-size-base","multiple":false,"regex":"","delay":0},{"id":"model number","type":"SelectorText","parentSelectors":["detail page"],"selector":"tr:contains('Item model number') td.a-size-base","multiple":false,"regex":"","delay":0},{"id":"Sellers","type":"SelectorLink","parentSelectors":["detail page"],"selector":"div.centerColAlign div.feature div.a-section span a","multiple":false,"delay":0},{"id":"Seller-select","type":"SelectorElement","parentSelectors":["Sellers"],"selector":"div.a-row.olpOffer","multiple":true,"delay":0},{"id":"Seller-Alt-Name","type":"SelectorText","parentSelectors":["Seller-select"],"selector":"h3.a-spacing-none","multiple":false,"regex":"","delay":0},{"id":"Seller-Alt-Price","type":"SelectorText","parentSelectors":["Seller-select"],"selector":"span.a-size-large","multiple":false,"regex":"","delay":0},{"id":"Condition","type":"SelectorText","parentSelectors":["Seller-select"],"selector":"div.a-section span.a-size-medium","multiple":false,"regex":"","delay":0},{"id":"Product Rating","type":"SelectorElementAttribute","parentSelectors":["detail page"],"selector":"#acrPopover","multiple":false,"extractAttribute":"title","delay":0},{"id":"Name","type":"SelectorText","parentSelectors":["detail page"],"selector":"h1.a-size-large span.a-size-large","multiple":false,"regex":"","delay":0}]}
#3

it looks like it is working but it is starting on page 20, anyway to change that? im not sure if it ever scrapes 1-20. let me know your thoughts, and thanks for the help.

#4

Any one done in cheerio
I am getting only one page then after amazon restricting remainig pages what to do