Scroller does not work on certain websites

Web Scraper version: Dev 0.4.2.3
Chrome version: 77.0.3865.90 (Official Build) (64-bit) (cohort: Stable
OS:

On certain websites with sections, the scroller does not activate, no matter which element is selected.

Examples:
https://partscatalog.deere.com/jdrc/search/type/parts/term/JD10436

https://super.walmart.com.mx/productos?Ntt=chocolates

Sitemap: None, scroller does not work on these sites.

{id:"my sitemap"}

Currently scroll element selector only tries to scroll down page body. It doesn't scroll the scroll bar of different elements. For example in the John Deere page you can actually see that the scroll bar isn't full height of the window but only for the list wrapper element.

There is a undocumented workaround that you can try. It is not that easy to do but it will make the scrolling work. In a future release we want to make the element scroll down selector automatically discover the scroll-able element. That is why we didn't publish this feature. Follow these steps:

  1. Generate a CSS selector for the wrapper element. The easiest way is to select the wrapper element while hovering the scroll bar.
  2. Create element scroll down selector
  3. Export the sitemap
  4. Find the element scroll down selector in the exported source
  5. Add an extra parameter to the selector ,"scrollElementSelector":"<CSS SELECTOR HERE>"
  6. Import the sitemap

Here is an example sitemap for the John Deere page:

{"_id":"scroll-example","startUrl":["https://partscatalog.deere.com/jdrc/search/type/parts/term/JD10436"],"selectors":[{"id":"scroll","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":".linkList a","multiple":true,"delay":2000,"scrollElementSelector":"div.content"}]}
1 Like

This works great, thank you.:+1:t3: