How to Scrape Data That Appears on scroll

How to?
#1

I was trying the scrap the below link

https://www.snapdeal.com/products/mens-footwear-sports-shoes?sort=plrty

which was load based on mouse scroll.

#2

"Hello" would be a nice word to start your conversation ...

Scraping scrolling pages is possible with Web Scraper.

You just need to use a selector like "Element Scrolls Down"

#3

Thanks for your value able reply

Could you please provide me the example or sample for "Element Scrolls Down" ...?

#4

Hello,

look at the site of the conceptor of this extension: [http://webscraper.io/]

Menu:
Learn / tutorial / you will find what you are looking for here.

#5

Thanks again for your valuable reply..

yes, i went through the documentation and based on my understanding i used below sitemap.

but this sitemap giving me only 1 result. could you please have a close look and point me out what mistake i made.

{"_id":"snapdeal","startUrl":["https://www.snapdeal.com/products/mens-footwear-sports-shoes?sort=plrty"],"selectors":[{"id":"items","type":"SelectorElementScroll","selector":"div.product-row","parentSelectors":["_root"],"multiple":true,"delay":"2000"},{"id":"product name","type":"SelectorText","selector":"div.col-xs-6:nth-of-type(1) div.tile-desc p.product-title","parentSelectors":["items"],"multiple":false,"regex":"","delay":0},{"id":"price","type":"SelectorText","selector":"div.col-xs-6:nth-of-type(1) div.product-price-row-adtech span.product-price","parentSelectors":["items"],"multiple":false,"regex":"","delay":0},{"id":"rating","type":"SelectorText","selector":"div.col-xs-6:nth-of-type(1) div.pdp-main-ratings div.grey-stars","parentSelectors":["items"],"multiple":false,"regex":"","delay":0}]}

#6

Hello,

I am afraid but I think that the coding of this site is too much complex to be scrapped with this extension.
I hope someone will try to help you.

#7

You have to change your element scroll down selector that it selects each item not the whole wrapper of the listing. It looks like that it will require element click selector after element scroll down to scrape all items.

1 Like