Describe the problem.
I have a site that I am struggling to capture more than the first page. I think I have a correctly structure site map using the pagination feature.
If you go here http://nro.adlibhosting.com/search/advanced and search for "ZB0568" in the reference field. It shows a list of results. Then go to the "Details" tab and the URL becomes http://nro.adlibhosting.com/Details/archive/110095435. This is where I want to scrape, this and the next 24 pages. But it only saves the first page.
Url: http://nro.adlibhosting.com/Details/archive/110095435
Sitemap:
`{"_id":"adlib3","startUrl":["http://nro.adlibhosting.com/Details/archive/110095435"],"selectors":[{"id":"title","parentSelectors":["next"],"type":"SelectorText","selector":"li:nth-of-type(1) div.value","multiple":false,"delay":0,"regex":""},{"id":"ref","parentSelectors":["next"],"type":"SelectorText","selector":"li:nth-of-type(2) div.value","multiple":false,"delay":0,"regex":""},{"id":"acc","parentSelectors":["next"],"type":"SelectorText","selector":"li:nth-of-type(3) div.value","multiple":false,"delay":0,"regex":""},{"id":"date","parentSelectors":["next"],"type":"SelectorText","selector":"li:nth-of-type(4) div.value","multiple":false,"delay":0,"regex":""},{"id":"scope","parentSelectors":["next"],"type":"SelectorText","selector":"li:nth-of-type(5) div.value","multiple":false,"delay":0,"regex":""},{"id":"level","parentSelectors":["next"],"type":"SelectorText","selector":"li:nth-of-type(6) div.value","multiple":false,"delay":0,"regex":""},{"id":"hierarchy","parentSelectors":["next"],"type":"SelectorLink","selector":".hierarchy-folder a","multiple":false,"delay":0},{"id":"next","parentSelectors":["_root","next"],"paginationType":"auto","selector":".next-page-script a","type":"SelectorPagination"}]}