Hello, I try to scrap an other site from a research because any products are not displayed in categories but well by research. As the pagination is similar than the Web Scraper test site, I first tested on this one.
Pagination is like that : 1 2 3...17 Next
So I tried with Pagination beta -> Click on Next button. When I launch the data preview, the second page is launched and all items of the first page is displayed. But after that, it stops.
I tried with Links and other settings. But the better I got was datas from pages 1, 2, 17.
I tried with page=[0-17] in the main url but no change
I also tried with Pagination -> click on each pagination link. No more result.
I don't understand.
Is it possible it's due to "nofollow" on the links ?
Url: https://boutique.distk.fr/fr/jolisearch?s=figur
Sitemap:
{"_id":"distk-figurines-recherche","startUrl":["https://boutique.distk.fr/fr/jolisearch?s=figur"],"selectors":[{"id":"navigation-distk-recherche","paginationType":"clickMore","parentSelectors":["_root","navigation-distk-recherche"],"selector":"ul.page-list a.next","type":"SelectorPagination"},{"id":"fiche_prod-distk-recherche","multiple":true,"parentSelectors":["_root","navigation-distk-recherche"],"selector":"div.js-product:nth-of-type(n+2) .h3 a","type":"SelectorLink"},{"id":"Titre","multiple":false,"parentSelectors":["fiche_prod-distk-recherche"],"regex":"","selector":"h1","type":"SelectorText"}]}
Thanks a lot for your help