Element Click after infinite scroll

How to?
#1

Hello all,

The site I'm trying to scrape has an infinite scroll with a show more button at the bottom that doesn't appear until after a couple of scroll downs. How can I scroll down through all the items, click the show more button, then scroll again to include the rest of the items?

Thanks!

Url: https://www.potterybarn.com/shop/outdoor/chaise+sectional+lounge-chair+bench+outdoor-lounge-furniture/producttype-m-product-type-ff00060f161b272e36fe2020-4/?cm_type=gnav&isx=0.0.0

Sitemap:
{"_id":"poterry_barn_dimensions","startUrl":["https://www.potterybarn.com/shop/outdoor/chaise+sectional+lounge-chair+bench+outdoor-lounge-furniture/producttype-m-product-type-ff00060f161b272e36fe2020-4/?cm_type=gnav&isx=0.0.0"],"selectors":[{"id":"show more","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.product-cell-container","multiple":false,"delay":2000,"clickElementSelector":".show-me-more button","clickType":"clickOnce","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"scroll","type":"SelectorElementScroll","parentSelectors":["show more"],"selector":"parent","multiple":true,"delay":2000},{"id":"name","type":"SelectorText","parentSelectors":["scroll"],"selector":"a span","multiple":true,"regex":"","delay":0}]}

#2

For this site, it is possible to separate the scrollers and the data scrapers. Tweak the sitemap below for your needs. It doesn't quite work yet but can get 100+ items.

{"_id":"forum-potterybarn","startUrl":["https://www.potterybarn.com/shop/outdoor/outdoor-lounge-furniture/?cm_type=gnav&isx=0.0.0#"],"selectors":[{"id":"Separate scroller 1","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"div.grid-item:nth-of-type(n+3):nth-of-type(odd)","multiple":false,"delay":"5000"},{"id":"Separate scroller 2","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"div.grid-item:nth-of-type(n+3):nth-of-type(odd)","multiple":false,"delay":"5000"},{"id":"Click Show Me More","type":"SelectorElementClick","parentSelectors":["_root"],"selector":".show-me-more","multiple":false,"delay":"5000","clickElementSelector":".show-me-more button","clickType":"clickOnce","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"Separate scroller 3","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"div.grid-item:nth-of-type(n+3):nth-of-type(odd)","multiple":false,"delay":"5000"},{"id":"Item wrappers","type":"SelectorElement","parentSelectors":["_root"],"selector":"div > div.grid-item","multiple":true},{"id":"Title n Link","type":"SelectorLink","parentSelectors":["Item wrappers"],"selector":".product-name a","multiple":false}]}