Only 8 results scraped

How to?
#1

It scrapes only the first 8 results even if in the preview I can see more. What am I doing wrong? thank you

Url: Stabilimenti balneari e spiagge Italia

Sitemap:
{"_id":"Stabilimenti_lazio","startUrl":["Stabilimenti balneari e spiagge Lazio"],"selectors":[{"id":"lazio","linkType":"linkFromHref","multiple":true,"parentSelectors":["_root"],"selector":".section-title > a","type":"SelectorLink"},{"id":"nome","multiple":false,"parentSelectors":["lazio"],"regex":"","selector":"h2.section-title","type":"SelectorText"},{"id":"indirizzi","multiple":false,"parentSelectors":["lazio"],"regex":"","selector":"header div a:nth-of-type(1)","type":"SelectorText"},{"id":"contatti","multiple":false,"parentSelectors":["lazio"],"regex":"","selector":".content header","type":"SelectorText"}]}

#2

Hi,

If you refresh the page, you should see that initially only 8 elements are loaded. The rest is loaded by clicking the 'Carica Altro' button.

The sitemap can be instructed to click the button with a pagination selector. The sitemap will start to return results only after all elements are loaded:

{"_id":"Stabilimenti_lazio","startUrl":["https://sunbrellaweb.it/spiagge/italia"],"selectors":[{"id":"lazio","linkType":"linkFromHref","multiple":true,"parentSelectors":["pagination"],"selector":".section-title > a","type":"SelectorLink"},{"id":"nome","multiple":false,"parentSelectors":["lazio"],"regex":"","selector":"h2.section-title","type":"SelectorText"},{"id":"indirizzi","multiple":false,"parentSelectors":["lazio"],"regex":"","selector":"header div a:nth-of-type(1)","type":"SelectorText"},{"id":"contatti","multiple":false,"parentSelectors":["lazio"],"regex":"","selector":".content header","type":"SelectorText"},{"id":"pagination","paginationType":"auto","parentSelectors":["_root","pagination"],"selector":"span#button-load","type":"SelectorPagination"}]}
#3

Hi,
thank you very much for the support.
I can see now that the scraper browses all pages but there are no results scraped.
I'm sorry I must be missing out something quite straightforward but I cannot understand what.
This is the sitemap (my objective is actually to get the contacts from each of the single pages uploaded):

{"_id":"Stabilimenti_lazio_prof","startUrl":["Stabilimenti balneari e spiagge Italia"],"selectors":[{"id":"lazio","linkType":"linkFromHref","multiple":true,"parentSelectors":["pagination"],"selector":".section-title > a","type":"SelectorLink"},{"id":"nome","multiple":false,"parentSelectors":["lazio"],"regex":"","selector":"h2.section-title","type":"SelectorText"},{"id":"indirizzi","multiple":false,"parentSelectors":["lazio"],"regex":"","selector":".content header","type":"SelectorText"},{"id":"pagination","paginationType":"auto","parentSelectors":["_root","pagination"],"selector":"span#button-load","type":"SelectorPagination"}]}

Thank you

#4

Hi,

Here is the same sitemap with limited pagination to 100 results as proof of concept:

{"_id":"Stabilimenti_lazio","startUrl":["https://sunbrellaweb.it/spiagge/italia"],"selectors":[{"id":"lazio","linkType":"linkFromHref","multiple":true,"parentSelectors":["pagination"],"selector":".section-title > a","type":"SelectorLink"},{"id":"nome","multiple":false,"parentSelectors":["lazio"],"regex":"","selector":"h2.section-title","type":"SelectorText"},{"id":"indirizzi","multiple":false,"parentSelectors":["lazio"],"regex":"","selector":"header div a:nth-of-type(1)","type":"SelectorText"},{"id":"contatti","multiple":false,"parentSelectors":["lazio"],"regex":"","selector":".content header","type":"SelectorText"},{"id":"pagination","paginationType":"auto","parentSelectors":["_root","pagination"],"selector":"body:not(:has(div.col-6:nth-of-type(100))) span#button-load","type":"SelectorPagination"}]}

You can increase the nr. in body:not(:has(div.col-6:nth-of-type(100))) to get more results.

#5

Thank you very much :grinning: