I'm trying to scrape a website's product page which uses both an automatic scroll/load and a load more button.
For example, when I first go on the page I can scroll down twice before the "load more" button appears. Then once I click the load more button, I can scroll down another 3 times before the load more button reappears. Rinse and repeat.
Is it possible to delay the element scroll down (or element click) enough so that they can work together in combination? There are over 1000 products on the page I want to scrape.
Happy to DM the website link if that helps.
Thank you