I am trying to set up pagination for https://www.tripadvisor.com/Restaurants-g60763-zfz10992-New_York_City_New_York.html.
The pagination is not working it seems. Each page has 30 items, and my spider has fetched 36. For some reason it stopped on page 2 midaway.
Sitemap:
the selector I am using for my pagination is "a.pageNum.taLnk"
Is there a limit on the number of pages the scraper will get with the free version?
Thanks.
Hello there!
There is no limits in free version 
Please set your Element Click selector type to Click More in order for it to click Next button until it becomes disabled (it does become disabled on last page)
The correct selector for Next button is a.nav.next , you seem to have assigned it to a JavaScript action it does to change the page.
Happy scraping!
Hi there. Thanks very much for your suggestions. I will try it out.