Problem with pagination - elementclick

Hi all!

I have an issue now with pagination. I am currently using element click to scrape this site, however pagination always seems to be the issue.
I would really appreciate if someone could advise what I am doing wrongly!

Thank you!

Url: https://www.lazada.com.my/panasonic/?from=input&q=water%20heater

Sitemap:
{"_id":"lazada","startUrl":["https://www.lazada.com.my/panasonic/?from=input&q=water%20heater"],"selectors":[{"id":"product links","type":"SelectorLink","parentSelectors":["Element Click"],"selector":"a","multiple":true,"delay":0},{"id":"Product Name","type":"SelectorText","parentSelectors":["product links"],"selector":"h1.pdp-product-title","multiple":false,"regex":"","delay":0},{"id":"Ratings (Qty)","type":"SelectorText","parentSelectors":["product links"],"selector":"div.pdp-review-summary a.pdp-link:nth-of-type(1)","multiple":false,"regex":"","delay":0},{"id":"Price","type":"SelectorText","parentSelectors":["product links"],"selector":"span.pdp-price.pdp-price_type_normal","multiple":false,"regex":"","delay":0},{"id":"Distributor","type":"SelectorText","parentSelectors":["product links"],"selector":"div.seller-name__detail a.pdp-link","multiple":false,"regex":"","delay":0},{"id":"Discount","type":"SelectorText","parentSelectors":["product links"],"selector":"span.pdp-product-price__discount","multiple":false,"regex":"","delay":0},{"id":"Original Price","type":"SelectorText","parentSelectors":["product links"],"selector":"div.origin-block span.pdp-price","multiple":false,"regex":"","delay":0},{"id":"Distributor Ratings","type":"SelectorText","parentSelectors":["product links"],"selector":"div.seller-info-value.rating-positive","multiple":false,"regex":"","delay":0},{"id":"Distributor Ship on Time","type":"SelectorText","parentSelectors":["product links"],"selector":"div.info-content:nth-of-type(2) div.seller-info-value","multiple":false,"regex":"","delay":0},{"id":"cat1","type":"SelectorText","parentSelectors":["product links"],"selector":"li.breadcrumb_item:nth-of-type(1) a.breadcrumb_item_anchor span","multiple":false,"regex":"","delay":0},{"id":"cat2","type":"SelectorText","parentSelectors":["product links"],"selector":"li.breadcrumb_item:nth-of-type(2) a.breadcrumb_item_anchor span","multiple":false,"regex":"","delay":0},{"id":"cat3","type":"SelectorText","parentSelectors":["product links"],"selector":"li.breadcrumb_item:nth-of-type(3) a.breadcrumb_item_anchor span","multiple":false,"regex":"","delay":0},{"id":"Brand","type":"SelectorText","parentSelectors":["product links"],"selector":"a.pdp-link.pdp-product-brand__brand-link","multiple":false,"regex":"","delay":0},{"id":"Ratings Score ","type":"SelectorText","parentSelectors":["product links"],"selector":"span.score-average","multiple":false,"regex":"","delay":0},{"id":"Lazmall","type":"SelectorText","parentSelectors":["product links"],"selector":"img.pdp-seller-badge","multiple":false,"regex":"","delay":0},{"id":"Element Click","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.c2prKC div.c5TXIP","multiple":true,"delay":0,"clickElementSelector":"div.ant-pagination-item-link a","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"}]}

Try this one. Looks like it is working, although haven't tested it all the way through.

You need to add a bit of a delay for the click selector to give the page a chance to render completely.

{"_id":"lazada","startUrl":["https://www.lazada.com.my/panasonic/?from=input&q=water%20heater"],"selectors":[{"id":"product links","type":"SelectorLink","parentSelectors":["Element Click"],"selector":"div> div > div > div a","multiple":false,"delay":0},{"id":"Product Name","type":"SelectorText","parentSelectors":["product links"],"selector":"h1.pdp-product-title","multiple":false,"regex":"","delay":0},{"id":"Ratings (Qty)","type":"SelectorText","parentSelectors":["product links"],"selector":"div.pdp-review-summary a.pdp-link:nth-of-type(1)","multiple":false,"regex":"","delay":0},{"id":"Price","type":"SelectorText","parentSelectors":["product links"],"selector":"span.pdp-price.pdp-price_type_normal","multiple":false,"regex":"","delay":0},{"id":"Distributor","type":"SelectorText","parentSelectors":["product links"],"selector":"div.seller-name__detail a.pdp-link","multiple":false,"regex":"","delay":0},{"id":"Discount","type":"SelectorText","parentSelectors":["product links"],"selector":"span.pdp-product-price__discount","multiple":false,"regex":"","delay":0},{"id":"Original Price","type":"SelectorText","parentSelectors":["product links"],"selector":"div.origin-block span.pdp-price","multiple":false,"regex":"","delay":0},{"id":"Distributor Ratings","type":"SelectorText","parentSelectors":["product links"],"selector":"div.seller-info-value.rating-positive","multiple":false,"regex":"","delay":0},{"id":"Distributor Ship on Time","type":"SelectorText","parentSelectors":["product links"],"selector":"div.info-content:nth-of-type(2) div.seller-info-value","multiple":false,"regex":"","delay":0},{"id":"cat1","type":"SelectorText","parentSelectors":["product links"],"selector":"li.breadcrumb_item:nth-of-type(1) a.breadcrumb_item_anchor span","multiple":false,"regex":"","delay":0},{"id":"cat2","type":"SelectorText","parentSelectors":["product links"],"selector":"li.breadcrumb_item:nth-of-type(2) a.breadcrumb_item_anchor span","multiple":false,"regex":"","delay":0},{"id":"cat3","type":"SelectorText","parentSelectors":["product links"],"selector":"li.breadcrumb_item:nth-of-type(3) a.breadcrumb_item_anchor span","multiple":false,"regex":"","delay":0},{"id":"Brand","type":"SelectorText","parentSelectors":["product links"],"selector":"a.pdp-link.pdp-product-brand__brand-link","multiple":false,"regex":"","delay":0},{"id":"Ratings Score ","type":"SelectorText","parentSelectors":["product links"],"selector":"span.score-average","multiple":false,"regex":"","delay":0},{"id":"Lazmall","type":"SelectorText","parentSelectors":["product links"],"selector":"img.pdp-seller-badge","multiple":false,"regex":"","delay":0},{"id":"Element Click","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div[data-spm="list"] > div[data-tracking="product-card"]","multiple":true,"delay":"5000","clickElementSelector":"li.ant-pagination-next a","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueCSSSelector"}]}

Hi maryvene,
Looks like you have another one here and as webber said, delay is a most!
Give it a go:

{"_id":"lazada","startUrl":["https://www.lazada.com.my/panasonic/?from=input&q=water%20heater"],"selectors":[{"id":"product links","type":"SelectorLink","parentSelectors":["Element Click"],"selector":"a","multiple":true,"delay":0},{"id":"Product Name","type":"SelectorText","parentSelectors":["product links"],"selector":"h1.pdp-product-title","multiple":false,"regex":"","delay":0},{"id":"Ratings (Qty)","type":"SelectorText","parentSelectors":["product links"],"selector":"div.pdp-review-summary a.pdp-link:nth-of-type(1)","multiple":false,"regex":"","delay":0},{"id":"Price","type":"SelectorText","parentSelectors":["product links"],"selector":"span.pdp-price.pdp-price_type_normal","multiple":false,"regex":"","delay":0},{"id":"Distributor","type":"SelectorText","parentSelectors":["product links"],"selector":"div.seller-name__detail a.pdp-link","multiple":false,"regex":"","delay":0},{"id":"Discount","type":"SelectorText","parentSelectors":["product links"],"selector":"span.pdp-product-price__discount","multiple":false,"regex":"","delay":0},{"id":"Original Price","type":"SelectorText","parentSelectors":["product links"],"selector":"div.origin-block span.pdp-price","multiple":false,"regex":"","delay":0},{"id":"Distributor Ratings","type":"SelectorText","parentSelectors":["product links"],"selector":"div.seller-info-value.rating-positive","multiple":false,"regex":"","delay":0},{"id":"Distributor Ship on Time","type":"SelectorText","parentSelectors":["product links"],"selector":"div.info-content:nth-of-type(2) div.seller-info-value","multiple":false,"regex":"","delay":0},{"id":"cat1","type":"SelectorText","parentSelectors":["product links"],"selector":"li.breadcrumb_item:nth-of-type(1) a.breadcrumb_item_anchor span","multiple":false,"regex":"","delay":0},{"id":"cat2","type":"SelectorText","parentSelectors":["product links"],"selector":"li.breadcrumb_item:nth-of-type(2) a.breadcrumb_item_anchor span","multiple":false,"regex":"","delay":0},{"id":"cat3","type":"SelectorText","parentSelectors":["product links"],"selector":"li.breadcrumb_item:nth-of-type(3) a.breadcrumb_item_anchor span","multiple":false,"regex":"","delay":0},{"id":"Brand","type":"SelectorText","parentSelectors":["product links"],"selector":"a.pdp-link.pdp-product-brand__brand-link","multiple":false,"regex":"","delay":0},{"id":"Ratings Score ","type":"SelectorText","parentSelectors":["product links"],"selector":"span.score-average","multiple":false,"regex":"","delay":0},{"id":"Lazmall","type":"SelectorText","parentSelectors":["product links"],"selector":"img.pdp-seller-badge","multiple":false,"regex":"","delay":0},{"id":"Element Click","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.c2prKC div.c5TXIP","multiple":true,"delay":"1000","clickElementSelector":"li.ant-pagination-item:nth-of-type(n+2)","clickType":"clickMore","discardInitialElements":true,"clickElementUniquenessType":"uniqueText"}]}

Hello,

Thank you!
The pagination worked out fine.
However, it does not show the full results - meaning to say there is supposed to be 381 rows of data, but there is only 200 rows of data. Do you know what is wrong with it?

In addition - may I ask where do you insert the delay in ? (Eg. in the individual selector / parent / overall meta page delay)

Thank you!

Regards,

Mayvene