Describe the problem.
The next button on this site only adds +1 to the search result pages, and when trying to use the pages, it only allows me to do the first 5 pages..
I'd like the scraper to go to the end of the search results and then do it's think for every result page, it did work on the first 5 pages with the pages selector, but can't make it work with the next page
I found a similar problem in here that said to set the next button to a child of itself and make it recursive, but that didnt help either, in fact, it clicks the next button once, but then proceeds to scrape the first result page anyway...
Please help, thanks
Url: https://www.firmy.cz/?q=stříhání+psů
Sitemap:
{"_id":"psisalonyv2","startUrl":["https://www.firmy.cz/?q=st%C5%99%C3%ADh%C3%A1n%C3%AD+ps%C5%AF"],"selectors":[{"id":"PsiSalon","type":"SelectorLink","parentSelectors":["_root","Next"],"selector":"h3 a","multiple":true,"delay":0},{"id":"Name","type":"SelectorText","parentSelectors":["PsiSalon"],"selector":"h1","multiple":false,"regex":"","delay":0},{"id":"Street","type":"SelectorText","parentSelectors":["PsiSalon"],"selector":".sAddress div:nth-of-type(1)","multiple":false,"regex":"","delay":0},{"id":"PSC","type":"SelectorText","parentSelectors":["PsiSalon"],"selector":".sAddress div:nth-of-type(2)","multiple":false,"regex":"","delay":0},{"id":"City","type":"SelectorText","parentSelectors":["PsiSalon"],"selector":".sAddress div:nth-of-type(3)","multiple":false,"regex":"","delay":0},{"id":"Web","type":"SelectorText","parentSelectors":["PsiSalon"],"selector":"a.url","multiple":false,"regex":"","delay":0},{"id":"Phone","type":"SelectorText","parentSelectors":["PsiSalon"],"selector":"[itemprop='telephone'] span","multiple":false,"regex":"","delay":0},{"id":"e-mail","type":"SelectorText","parentSelectors":["PsiSalon"],"selector":"a.companyMail","multiple":false,"regex":"","delay":0},{"id":"Next","type":"SelectorElementClick","parentSelectors":["_root","Next"],"selector":"span.icof-doprava-navigace","multiple":false,"delay":0,"clickElementSelector":"span.icof-doprava-navigace","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueHTMLText"}]}