Pagination problem . only scrapes visible pages

I am trying to scrape details of all the.. let's call them therapists, from this... website https://www.eurogirlsescort.com/escorts/uk/?backlink=fnavo :stuck_out_tongue:

and it does not get all the pages

sitemap:
{"_id":"eurogirlesescort_uk","startUrl":["https://www.eurogirlsescort.com/escorts/uk/?backlink=fnavo"],"selectors":[{"id":"therapists","type":"SelectorLink","parentSelectors":["_root","pagination"],"selector":"div.list-img a","multiple":true,"delay":0},{"id":"website","type":"SelectorText","parentSelectors":["therapists"],"selector":"div.detail-txt-list:nth-of-type(5) span.text a","multiple":false,"regex":"","delay":0},{"id":"number","type":"SelectorText","parentSelectors":["therapists"],"selector":"div.detail-txt-list:nth-of-type(5) p:nth-of-type(3) span.text","multiple":false,"regex":"","delay":0},{"id":"whatsapp number","type":"SelectorText","parentSelectors":["therapists"],"selector":"div.detail-txt-list:nth-of-type(5) p:nth-of-type(7) span.text","multiple":false,"regex":"","delay":0},{"id":"pagination","type":"SelectorLink","parentSelectors":["_root"],"selector":"div.pagination a:nth-of-type(n+3)","multiple":true,"delay":0}]}

It only gets pages shown on the first page in the pagination bar which are

data preview:

So instead of going 1, 2, 3, 4, 5...... until 183

It scraps only the visible pages... which is shown in the screens above.

  1. I tried to make the pagination selector a root of itself
    http://puu.sh/CptZ0/002c3bff48.png

contrary to just

but I dont think it made a difference

  1. I tried to use "element click" instead of "link" in pagination selector.. same structure as is now.. and I set the element selector on the "next" button, but did not work.. I think because the whatever value of "next" button changes on each page.. if you know what i mean..
    the "next" button on page 1 is this http://puu.sh/Cpu3d/c74a7244a2.png
    on page 2 its that http://puu.sh/Cpu3V/086349fca9.png

does that even matter?

sorry im a complete novice here.

any help will be appreciated!

sorry not all the pics seem to have uploaded themselves properly :frowning:

if there is no solution , then I will have to do 183 selectors for each single page.. I think that would work.

try this.. now i'm going to clean my computer

{"_id":"eurogirlesescort_uk","startUrl":["https://www.eurogirlsescort.com/escorts/uk/?backlink=fnavo"],"selectors":[{"id":"Pag","type":"SelectorLink","parentSelectors":["_root","Pag"],"selector":"a.prev-next:last","multiple":false,"delay":0},{"id":"Link In","type":"SelectorLink","parentSelectors":["_root","Pag"],"selector":"p.name a","multiple":true,"delay":0},{"id":"Name Agency ","type":"SelectorText","parentSelectors":["Link In"],"selector":"inside","multiple":false,"regex":"","delay":0},{"id":"phone","type":"SelectorText","parentSelectors":["Link In"],"selector":"div.detail-txt-list:nth-of-type(5) p:nth-of-type(n) span.name:contains(\"Phone\")+","multiple":false,"regex":"","delay":0},{"id":"website","type":"SelectorText","parentSelectors":["Link In"],"selector":"div.detail-txt-list:nth-of-type(5) p:nth-of-type(n) span.name:contains(\"Website\")+","multiple":false,"regex":"","delay":0},{"id":"viber","type":"SelectorText","parentSelectors":["Link In"],"selector":"div.detail-txt-list:nth-of-type(5) p:nth-of-type(n) span.name:contains(\"Viber\")+","multiple":false,"regex":"","delay":0},{"id":"Whatsps","type":"SelectorText","parentSelectors":["Link In"],"selector":"div.detail-txt-list:nth-of-type(5) p:nth-of-type(n) span.name:contains(\"Whats\")+","multiple":false,"regex":"","delay":0},{"id":"Country","type":"SelectorText","parentSelectors":["Link In"],"selector":"div.detail-txt-list:nth-of-type(5) p:nth-of-type(n) span.name:contains(\"Count\")+","multiple":false,"regex":"","delay":0},{"id":"City","type":"SelectorText","parentSelectors":["Link In"],"selector":"div.detail-txt-list:nth-of-type(5) p:nth-of-type(n) span.name:contains(\"City\")+","multiple":false,"regex":"","delay":0}]}
1 Like