Scraping stops after few pages + mixed (tripadvisor)

How to?
#1

Hello everyone,

I have two problems trying to scrap tripadvisor data.

  1. When I run the scraping tool, it stops after 3 or 4 pages.

  2. Seems the scrapping don't start on the first page and the results are mixed. Is it possible to set the tool to start from the first page and scrap the results in order?

Sorry, my english is not very good. But you can find an image here for the second problem : https://ibb.co/vh0mq9M

Thank you very much for your help

Url: https://fr.tripadvisor.be/Restaurants-g188645-Hainaut_Province_Wallonia.html

Sitemap:
{"_id":"trip","startUrl":["https://fr.tripadvisor.be/Restaurants-g188645-Hainaut_Province_Wallonia.html"],"selectors":[{"id":"lien-page","type":"SelectorLink","parentSelectors":["_root","pagination"],"selector":"div.restaurants-list-ListCell__cellContainer--2mpJS:nth-of-type(n+2) a.restaurants-list-ListCell__restaurantName--2aSdo","multiple":true,"delay":0},{"id":"nom","type":"SelectorText","parentSelectors":["lien-page"],"selector":"h1.ui_header","multiple":false,"regex":"","delay":0},{"id":"telephone","type":"SelectorText","parentSelectors":["lien-page"],"selector":"span.detail.is-hidden-mobile","multiple":false,"regex":"","delay":0},{"id":"site web","type":"SelectorPopupLink","parentSelectors":["lien-page"],"selector":".website span.detail","multiple":false,"delay":0},{"id":"rue","type":"SelectorText","parentSelectors":["lien-page"],"selector":"span.street-address","multiple":false,"regex":"","delay":0},{"id":"ville","type":"SelectorText","parentSelectors":["lien-page"],"selector":"span.locality","multiple":false,"regex":"","delay":0},{"id":"pays","type":"SelectorText","parentSelectors":["lien-page"],"selector":"span.country-name","multiple":false,"regex":"","delay":0},{"id":"mail","type":"SelectorLink","parentSelectors":["lien-page"],"selector":".restaurants-detail-overview-cards-LocationOverviewCard__detailLink--iyzJI span a","multiple":false,"delay":0},{"id":"pagination","type":"SelectorLink","parentSelectors":["_root","pagination"],"selector":"a.nav","multiple":false,"delay":0}]}

Tripadvisor mail pagination
Tripadvisor pagination problem
#2

This will get you all of the results:

{"_id":"trip","startUrl":["https://fr.tripadvisor.be/Restaurants-g188645-Hainaut_Province_Wallonia.html"],"selectors":[{"id":"lien-page","type":"SelectorLink","parentSelectors":["_root","pagination"],"selector":"#EATERY_LIST_CONTENTS .title_wrap a","multiple":true,"delay":0},{"id":"nom","type":"SelectorText","parentSelectors":["lien-page"],"selector":"h1.ui_header","multiple":false,"regex":"","delay":0},{"id":"telephone","type":"SelectorText","parentSelectors":["lien-page"],"selector":"span.detail.is-hidden-mobile","multiple":false,"regex":"","delay":0},{"id":"site web","type":"SelectorPopupLink","parentSelectors":["lien-page"],"selector":".website span.detail","multiple":false,"delay":0},{"id":"rue","type":"SelectorText","parentSelectors":["lien-page"],"selector":"span.street-address","multiple":false,"regex":"","delay":0},{"id":"ville","type":"SelectorText","parentSelectors":["lien-page"],"selector":"span.locality","multiple":false,"regex":"","delay":0},{"id":"pays","type":"SelectorText","parentSelectors":["lien-page"],"selector":"span.country-name","multiple":false,"regex":"","delay":0},{"id":"mail","type":"SelectorLink","parentSelectors":["lien-page"],"selector":".restaurants-detail-overview-cards-LocationOverviewCard__detailLink--iyzJI span a","multiple":false,"delay":0},{"id":"pagination","type":"SelectorLink","parentSelectors":["_root","pagination"],"selector":"a.nav","multiple":true,"delay":0}]}

1 Like
#3

Thank you very much !