Pagination Scrape

How to?
#1

Hi

I am trying to to scrape the url below, but I am having trouble with it moving to the next page to scrape the details (name, number of rooms, phone,address,bubble rating, reviews)

Url: https://www.tripadvisor.com.au/Hotels-g255055-zfd2-Australia-Hotels.html

I've attached my sitemap for review.

Sitemap:

{"_id":"taaaa","startUrl":["https://www.tripadvisor.com.au/Hotels-g255055-zfd2-Australia-Hotels.html"],"selectors":[{"id":"tamotelau","type":"SelectorLink","parentSelectors":["_root","page"],"selector":"a.property_title","multiple":true,"delay":0},{"id":"name","type":"SelectorText","parentSelectors":["tamotelau"],"selector":"h1.hotels-hotel-review-atf-info-parts-Heading__heading--2ZOcD","multiple":false,"regex":"","delay":0},{"id":"rev","type":"SelectorText","parentSelectors":["tamotelau"],"selector":"span.hotels-hotel-review-atf-info-parts-Rating__reviewCount--1sk1X","multiple":false,"regex":"","delay":0},{"id":"tarating","type":"SelectorText","parentSelectors":["tamotelau"],"selector":"span.hotels-hotel-review-about-with-photos-Reviews__overallRating--vElGA","multiple":false,"regex":"","delay":0},{"id":"room","type":"SelectorText","parentSelectors":["tamotelau"],"selector":"div.hotels-hotel-review-about-addendum-AddendumItem__content--iVts5:nth-of-type(6)","multiple":false,"regex":"","delay":0},{"id":"page","type":"SelectorLink","parentSelectors":["_root"],"selector":".standard_pagination span.current","multiple":true,"delay":0},{"id":"add","type":"SelectorText","parentSelectors":["tamotelau"],"selector":"div.hotels-hotel-review-atf-info-parts-BusinessListingEntry__entry--210S0","multiple":false,"regex":"","delay":0}]}

Thank you for the help.

#2

The AU site seems to require a scroller. Something like this:

{"_id":"forum-tripadvisor-au-april","startUrl":["https://www.tripadvisor.com.au/Hotels-g255055-zfd2-Australia-Hotels.html"],"selectors":[{"id":"tamotelau","type":"SelectorLink","parentSelectors":["Scroller"],"selector":"a.property_title","multiple":false,"delay":0},{"id":"name","type":"SelectorText","parentSelectors":["tamotelau"],"selector":"h1.hotels-hotel-review-atf-info-parts-Heading__heading--2ZOcD","multiple":false,"regex":"","delay":0},{"id":"rev","type":"SelectorText","parentSelectors":["tamotelau"],"selector":"span.hotels-hotel-review-atf-info-parts-Rating__reviewCount--1sk1X","multiple":false,"regex":"","delay":0},{"id":"tarating","type":"SelectorText","parentSelectors":["tamotelau"],"selector":"span.hotels-hotel-review-about-with-photos-Reviews__overallRating--vElGA","multiple":false,"regex":"","delay":0},{"id":"room","type":"SelectorText","parentSelectors":["tamotelau"],"selector":"div.hotels-hotel-review-about-addendum-AddendumItem__content--iVts5:nth-of-type(6)","multiple":false,"regex":"","delay":0},{"id":"add","type":"SelectorText","parentSelectors":["tamotelau"],"selector":"div.hotels-hotel-review-atf-info-parts-BusinessListingEntry__entry--210S0","multiple":false,"regex":"","delay":0},{"id":"Scroller","type":"SelectorElementScroll","parentSelectors":["_root","Paginator Next"],"selector":"div[class^='prw_rup prw_meta']","multiple":true,"delay":"1500"},{"id":"Paginator Next","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.relWrap","multiple":false,"delay":"7500","clickElementSelector":"div > span[class^='nav next ui_button primary']","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueHTML"}]}

Trip Advisor Pagination