Hi, there's a "load more" button on the page I'd like to scape and there're infinite records (new records append on same page), I only need the first 500 records, is there any way to add limit/maximum "load more" times in this case? Thanks.
please send your web site for exploration...
This is the link: (please delete the space)
coinmarketcap . com /currencies/volume/24-hour/
Hi, you can set a limit by disabling the button selector after a certain criteria is reached. Here's a quick fix:
{"_id":"coinmarketcap","startUrl":["https://coinmarketcap.com/currencies/volume/24-hour/"],"selectors":[{"id":"pagination","paginationType":"auto","parentSelectors":["_root","pagination"],"selector":"[class=\"cmc-main-section__content\"]:not(:contains(\"500. \")) .cmc-currencies-volume-daily__load-more button","type":"SelectorPagination"},{"id":"name","multiple":true,"parentSelectors":["pagination"],"regex":"","selector":"h3 a","type":"SelectorText"}]}
1 Like