Infinite scroll problems

Hi all!
I have been reading several threads about infinite scrolling and I have tried various methods mentioned in this forum. I'm not sure if it's because the page I want to extract data from is different or if it's simply not possible.

Can you help me, please?
Thanks in advance

https://portalnow.com/es/venta-piso/castellon-provincia/venta-casa,venta-casa-independiente,venta-casa-adosada,venta-finca

Sitemap:

{"_id":"PortalNow","startUrl":["https://portalnow.com/es/venta-piso/castellon-provincia/venta-casa,venta-casa-independiente,venta-casa-adosada,venta-finca"],"selectors":[{"id":"scrolldown","parentSelectors":["_root"],"type":"SelectorElementScroll","selector":"div.page","multiple":true,"delay":5000,"elementLimit":0},{"id":"link","parentSelectors":["scrolldown"],"type":"SelectorLink","selector":"mat-card","multiple":true},{"id":"ref","parentSelectors":["link"],"type":"SelectorText","selector":"span.reference","multiple":false,"regex":""},{"id":"tipo","parentSelectors":["link"],"type":"SelectorText","selector":"div.asset-category","multiple":false,"regex":""},{"id":"poblacion","parentSelectors":["link"],"type":"SelectorText","selector":".flex div.location","multiple":false,"regex":""},{"id":"precio","parentSelectors":["link"],"type":"SelectorText","selector":"div.price.ng-star-inserted","multiple":false,"regex":""},{"id":"metros","parentSelectors":["link"],"type":"SelectorText","selector":"div.feature:nth-of-type(1) span","multiple":false,"regex":""},{"id":"dormitorios","parentSelectors":["link"],"type":"SelectorText","selector":"div.feature:nth-of-type(2) span","multiple":false,"regex":""},{"id":"banyos","parentSelectors":["link"],"type":"SelectorText","selector":"div:nth-of-type(3) span.value","multiple":false,"regex":""},{"id":"titulo","parentSelectors":["link"],"type":"SelectorText","selector":"h1","multiple":false,"regex":""},{"id":"foto","parentSelectors":["link"],"type":"SelectorImage","selector":".swiper-slide-visible img","multiple":true}]}

Seems is not reachable outside spain

@rubencf @3HAT0K Hello, to perform a scroll function for this page - a currently undocumented "scrollElementSelector"(inner scroll selector) will have to be used which requires manually adjusting the sitemaps JSON.

Please, note that the rendered listing amount within the page HTML is not consistent even after scrolling down to the very bottom, therefore the most viable way to scrape this data will require zooming out the page as far as you can.


Here's a sitemap example:

{"_id":"inner-scroll-test","startUrl":["https://portalnow.com/es/venta-piso/castellon-provincia/venta-casa,venta-casa-independiente,venta-casa-adosada,venta-finca"],"selectors":[{"id":"scrolldown","parentSelectors":["_root"],"type":"SelectorElementScroll","selector":"pn-asset-teaser","multiple":true,"delay":5000,"scrollElementSelector":"cdk-virtual-scroll-viewport","elementLimit":0},{"id":"scroll-to","parentSelectors":["scrolldown"],"type":"ActionScrollDown","delay":2000,"selectorScrollElement":"","selectorScrollDownIfElementNotVisible":"div.cdk-virtual-scroll-content-wrapper","selectorScrollToElement":"_parent_"},{"id":"link","parentSelectors":["link-wrapper"],"type":"SelectorLink","selector":"_parent_","multiple":false},{"id":"ref","parentSelectors":["link"],"type":"SelectorText","selector":"span.reference","multiple":false,"regex":""},{"id":"tipo","parentSelectors":["link"],"type":"SelectorText","selector":"div.asset-category","multiple":false,"regex":""},{"id":"poblacion","parentSelectors":["link"],"type":"SelectorText","selector":".flex div.location","multiple":false,"regex":""},{"id":"precio","parentSelectors":["link"],"type":"SelectorText","selector":"div.price.ng-star-inserted","multiple":false,"regex":""},{"id":"metros","parentSelectors":["link"],"type":"SelectorText","selector":"div.feature:nth-of-type(1) span","multiple":false,"regex":""},{"id":"dormitorios","parentSelectors":["link"],"type":"SelectorText","selector":"div.feature:nth-of-type(2) span","multiple":false,"regex":""},{"id":"banyos","parentSelectors":["link"],"type":"SelectorText","selector":"div:nth-of-type(3) span.value","multiple":false,"regex":""},{"id":"titulo","parentSelectors":["link"],"type":"SelectorText","selector":"h1","multiple":false,"regex":""},{"id":"foto","parentSelectors":["link"],"type":"SelectorImage","selector":".swiper-slide-visible img","multiple":true},{"id":"link-wrapper","parentSelectors":["scrolldown"],"type":"SelectorElement","selector":"a.mat-focus-indicator","multiple":true}]}