Load More button / Link extraction

How to?
#1

I am trying to click the load more button till all elements are loaded and then use a link selector to select individual items. The Load More button is clicked once so few new elements are loaded but then it closes and no data or links are scrapped.

I have tried to follow the same approach as described in one on the questions on the forum but it works for that website and not this one. Can not understand why. Any and all help would be appreciated.

Url: https://www.pedigree.in/Pedigree/products-listing

Sitemap:
{"_id":"pedigreein005","startUrl":["https://www.pedigree.in/Pedigree/products-listing"],"selectors":[{"id":"loader","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.list-box","multiple":true,"delay":"5000","clickElementSelector":"a.load","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueHTML"},{"id":"clicker","type":"SelectorLink","parentSelectors":["loader"],"selector":"a#rptData_imgpackImageThumbnail_0","multiple":true,"delay":0},{"id":"title","type":"SelectorText","parentSelectors":["clicker"],"selector":"span#lblHeading","multiple":false,"regex":"","delay":0},{"id":"shortdesc","type":"SelectorText","parentSelectors":["clicker"],"selector":"span#lblDescription","multiple":false,"regex":"","delay":0}]}

Thanks,
Max

#2

You won't be able to automate it due to how the load-more function is executed.

This would require 'Element Click' selector in theory, but due to the fact that the whole page re-loads every time you click on the button, the selector won't work, as if the page reloads, the 'Element Click' selector stops working.

#3

Thank you for your input, I was going nuts with various combinations, now I will abandon this approach and think of a different strategy for this.