Pagination Link Variable for a[data-row='']?

How to?
#1

Howdy,

Attempting to paginate Events in Granbury TX | Visit Granbury | Event Calendar

The "Next" link selector is a[data-row='13'] on the first page, a[data-row='25'] on the next page, et cetera.

Is there a way to include a variable? For example a[data-row='*'] or a[data-row='?'] meaning any number that is in that attribute until no more data is scrapable.

Scrape is only collecting first page results because a[data-row='13'] changes to a[data-row='25'] on the next page, and to a[data-row='37'] and so on. How do I paginate to all pages?

visitGranbury_paginationSelector
visitGranbury_paginationSelector1136×247 20.1 KB

#2

I changed the pagination selector to a:contains("Next ") however, not all events are being captured.

{"_id":"vistiGranburyEvents","startUrl":["https://www.visitgranbury.com/events/?skip=0&categoryid=234%2C261%2C233%2C255%2C223%2C239%2C254%2C252%2C257%2C251%2C249%2C226%2C231%2C222%2C241%2C248%2C232%2C247%2C258%2C244%2C256%2C253%2C259%2C242%2C230%2C238&startDate=04%2F30%2F2023&endDate=12%2F31%2F2023&sort=date"],"selectors":[{"id":"pagination","parentSelectors":["_root","pagination"],"paginationType":"clickMore","selector":"a:contains(\"Next \")","type":"SelectorPagination"},{"id":"linkToEvent","parentSelectors":["pagination"],"type":"SelectorLink","selector":"h2 a","multiple":true},{"id":"eventTitle","parentSelectors":["event"],"type":"SelectorText","selector":"h1","multiple":false,"regex":""},{"id":"dates","parentSelectors":["event"],"type":"SelectorText","selector":"[data-name='dates'] span.info-list-value","multiple":false,"regex":""},{"id":"locationName","parentSelectors":["event"],"type":"SelectorText","selector":"[data-name='location'] a","multiple":false,"regex":""},{"id":"eventAddress","parentSelectors":["event"],"type":"SelectorText","selector":"[data-name='address'] span.info-list-value","multiple":false,"regex":""},{"id":"eventPhone","parentSelectors":["event"],"type":"SelectorText","selector":".info-list-value a[title]","multiple":false,"regex":""},{"id":"eventTime","parentSelectors":["event"],"type":"SelectorText","selector":"[data-name='time'] span.info-list-value","multiple":false,"regex":""},{"id":"eventPrice","parentSelectors":["event"],"type":"SelectorText","selector":"[data-name='price'] span.info-list-value","multiple":false,"regex":""},{"id":"eventPhoto","parentSelectors":["event"],"type":"SelectorImage","selector":".img-responsive img","multiple":false},{"id":"eventWebsite","parentSelectors":["event"],"type":"SelectorLink","selector":".action a[target]","multiple":false},{"id":"eventEmail","parentSelectors":["event"],"type":"SelectorLink","selector":"a[data-seo-email]","multiple":false},{"id":"eventDescription","parentSelectors":["event"],"type":"SelectorText","selector":".detail-content p:nth-of-type(2)","multiple":false,"regex":""},{"id":"event","parentSelectors":["linkToEvent"],"type":"SelectorElement","selector":"article","multiple":false}]}

Sure would appreciate a fresh, knowledgeable set of eyes on this.

#3

@KillerDesigner Hello, have you tried to change the pagination type to a 'Link' instead?

Here's a sitemap example:

{"_id":"vistiGranburyEvents","startUrl":["https://www.visitgranbury.com/events/?skip=0&categoryid=234%2C261%2C233%2C255%2C223%2C239%2C254%2C252%2C257%2C251%2C249%2C226%2C231%2C222%2C241%2C248%2C232%2C247%2C258%2C244%2C256%2C253%2C259%2C242%2C230%2C238&startDate=04%2F30%2F2023&endDate=12%2F31%2F2023&sort=date"],"selectors":[{"id":"pagination","paginationType":"linkFromHref","parentSelectors":["_root","pagination"],"selector":"a:contains(\"Next \")","type":"SelectorPagination"},{"id":"linkToEvent","multiple":true,"parentSelectors":["pagination"],"selector":"h2 a","type":"SelectorLink"}]}

#4

Thank you, ViestursWS. It seems to work, although it captures the link. I guess I can just delete that column when it completes. Appreciate you!