Hi there,
I'm trying to scrape an eCommerce site. An example of the link i am scraping is https://shopee.sg/search?keyword=drill&page=[1]&sortBy=relevancy
My issue is, there are 50 entries on each page. However, only 15 entries load on page load, the others show up only when i scroll down the page, i tried element scroll selector but i am only able to scrape 20 entries. Is there any way to mimic scrolling down a page to the end? ( Correct me if i am wrong but I think element scroll jumps to end of page?)
Has anyone come across a similar issue and how to scrape a page that loads on scrolling?
Thank you guys!