One page is big it has 4000+ entries, it is able to scroll, but I have put all other elements that need to be scrapped on the same level such as:
- name
- rank
- link
But above 3 are not extracted. Is there any fundamental mistake I am doing?
One page is big it has 4000+ entries, it is able to scroll, but I have put all other elements that need to be scrapped on the same level such as:
But above 3 are not extracted. Is there any fundamental mistake I am doing?
Yes, you need to create a wrapper (container) for your data scrapers. See
https://www.webscraper.io/how-to-video/element-scroll-selector
You can import the sample code and look at its structure.