I'm trying to scrap some products in a brand site, let me describe the problem.
I'm using Element Click to load more products clicking the Load More button. The starting page shows about 30 products, i need to scrap about 500 products, when i try to "scrape" it loads sometimes until about 150 products and stop clicking Load More.
I'm posting my sitemap, for now it won't select any important data, i'm just trying to load all itens first.
Sitemap:
{"_id":"sodahl2","startUrl":["https://b2b.fh-as.dk/produkter?ID=5357&PageNum=1&ViewPageID=5357&PageSize=24&fg=Brand&fg=CatalogueGroup%20da&fg=Color&fg=IsNews&q=&Brand=Södahl&reset-filter-Catalogueda=true&reset-filter-Color=true&reset-filter-IsNews=true"],"selectors":[{"id":"element","type":"SelectorElementClick","parentSelectors":["_root"],"selector":".column-width-first .e-products-item-name a","multiple":true,"delay":"0","clickElementSelector":"a.btn-block","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueCSSSelector"}]}
Sorry about english mistakes and sorry if i post in wrong category.