Hi,
The pagination work only for the page 1, 2, 3 and the last 1175.
After I try another method, using just the button Next, so I put pagination as parent of itself, so in this method, the webscrape just go next and next and do not execute the scrape of the info
Url: http://www.test.xyz/
Sitemap:
{"_id":"test","startUrl":["http://www.test.xyz/"],"selectors":[{"id":"titles","type":"SelectorLink","selector":"div.herald-post-thumbnail a","parentSelectors":["_root","pagination"],"multiple":true,"delay":0},{"id":"linkarq","type":"SelectorText","selector":"p:nth-of-type(4) code","parentSelectors":["titles"],"multiple":false,"regex":"","delay":0},{"id":"demo","type":"SelectorText","selector":"p:nth-of-type(3) code","parentSelectors":["titles"],"multiple":false,"regex":"","delay":0},{"id":"desc","type":"SelectorText","selector":"p:nth-of-type(2)","parentSelectors":["titles"],"multiple":false,"regex":"","delay":0},{"id":"pagination","type":"SelectorLink","selector":"a.page-numbers","parentSelectors":["_root"],"multiple":true,"delay":0}]}
My second method I have tried, using just button next as parent of itself, see the another sitemap:
{"_id":"testwithnext","startUrl":["http://www.test.xyz/"],"selectors":[{"id":"titles","type":"SelectorLink","selector":"div.herald-post-thumbnail a","parentSelectors":["_root","pagination"],"multiple":true,"delay":0},{"id":"linkarq","type":"SelectorText","selector":"p:nth-of-type(4) code","parentSelectors":["titles"],"multiple":false,"regex":"","delay":0},{"id":"demo","type":"SelectorText","selector":"p:nth-of-type(3) code","parentSelectors":["titles"],"multiple":false,"regex":"","delay":0},{"id":"desc","type":"SelectorText","selector":"p:nth-of-type(2)","parentSelectors":["titles"],"multiple":false,"regex":"","delay":0},{"id":"pagination","type":"SelectorLink","selector":"a.next","parentSelectors":["_root","pagination"],"multiple":false,"delay":0}]}