Can't seem to get the scraper to do the next pages

How to?
#1

I am trying to scrape the next pages on this website. But for some reason I cannot get it to do the next pages correctly. I can get it to either click to the next page and not scrape, or scrape and not do following pages. It's probably something really simple. But I can't find it.

Kind regards and thank you in advance,

Hervé Maas

Url: https://www.ziggosport.nl/programmagids/

Sitemap:
{"_id":"ziggosporttotaal","startUrl":["https://www.ziggosport.nl/programmagids/"],"selectors":[{"id":"date","type":"SelectorText","selector":"span.js-tvguide-date","parentSelectors":["tvguide"],"multiple":false,"regex":"","delay":0},{"id":"channel","type":"SelectorElement","selector":"div.tv-guide__list__item","parentSelectors":["tvguide"],"multiple":true,"delay":0},{"id":"meer","type":"SelectorElementClick","selector":"a.btn-ghost","parentSelectors":["channel"],"multiple":false,"delay":0,"clickElementSelector":"a.btn-ghost","clickType":"clickOnce","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"},{"id":"channelname","type":"SelectorText","selector":"div.tv-guide__channelname span","parentSelectors":["channel"],"multiple":false,"regex":"","delay":0},{"id":"timeslot","type":"SelectorElement","selector":"div.tv-guide__item","parentSelectors":["channel"],"multiple":true,"delay":0},{"id":"time","type":"SelectorText","selector":"span.tv-guide__item__date","parentSelectors":["timeslot"],"multiple":false,"regex":"","delay":0},{"id":"program","type":"SelectorText","selector":"span.tv-guide__item__title","parentSelectors":["timeslot"],"multiple":false,"regex":"","delay":0},{"id":"live","type":"SelectorText","selector":"span.tv-guide__item__live","parentSelectors":["timeslot"],"multiple":false,"regex":"","delay":0},{"id":"tvguide","type":"SelectorElement","selector":"div.tv-guide","parentSelectors":["_root"],"multiple":true,"delay":0},{"id":"nextday","type":"SelectorElementClick","selector":"div.tv-guide","parentSelectors":["tvguide"],"multiple":true,"delay":"2000","clickElementSelector":"a.tv-guide__days-switch__link.tv-guide__days-switch__link--next","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"}]}

#2

A few errors here.

1 - Next Date (Pagination) need to be put in the root director
2 - You need to make it a child to it's self
3 - You need to make the main element selector (in root) a child to the aforementioned pagination link
4 - Delete the element-select link you created.

Here is the fix
{"_id":"test-test","startUrl":["https://www.ziggosport.nl/programmagids/"],"selectors":[{"id":"date","type":"SelectorText","selector":"span.js-tvguide-date","parentSelectors":["tvguide"],"multiple":false,"regex":"","delay":0},{"id":"channel","type":"SelectorElement","selector":"div.tv-guide__list__item","parentSelectors":["tvguide"],"multiple":true,"delay":0},{"id":"meer","type":"SelectorElementClick","selector":"a.btn-ghost","parentSelectors":["channel"],"multiple":false,"delay":0,"clickElementSelector":"a.btn-ghost","clickType":"clickOnce","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"},{"id":"channelname","type":"SelectorText","selector":"div.tv-guide__channelname span","parentSelectors":["channel"],"multiple":false,"regex":"","delay":0},{"id":"timeslot","type":"SelectorElement","selector":"div.tv-guide__item","parentSelectors":["channel"],"multiple":true,"delay":0},{"id":"time","type":"SelectorText","selector":"span.tv-guide__item__date","parentSelectors":["timeslot"],"multiple":false,"regex":"","delay":0},{"id":"program","type":"SelectorText","selector":"span.tv-guide__item__title","parentSelectors":["timeslot"],"multiple":false,"regex":"","delay":0},{"id":"live","type":"SelectorText","selector":"span.tv-guide__item__live","parentSelectors":["timeslot"],"multiple":false,"regex":"","delay":0},{"id":"tvguide","type":"SelectorElement","selector":"div.tv-guide","parentSelectors":["_root","ND-Page-Link"],"multiple":true,"delay":0},{"id":"ND-Page-Link","type":"SelectorLink","selector":"a.tv-guide__days-switch__link.tv-guide__days-switch__link--next","parentSelectors":["_root","ND-Page-Link"],"multiple":false,"delay":0}]}

However, ideally the pagination link should come BEFORE the element select. I'm not quite sure why that is but for some reason it scrapes bottom up and might change pages BEFORE it scrapes. I',m not entirely sure how to change that without rewriting the whole thing.