Simple procedure to scrape a companies database

Hello,

I have followed the videos and configured this website

https://annuario.lagenziadiviaggi.it/regioni

but it is not able to find any data.

This is root: https://annuario.lagenziadiviaggi.it/regioni/[1-20]

where you can find one link for any region.

Then I have set pagination as by video indication and then product.

It runs for about 10 minutes watching only the first page of any region then stops without finding any data.

What is the right configuration to make the simplest scrape that is only to record data page of any company indicated in a region link and then 10 companies per page sublink?

Many thanks,

Giuseppe

Hello @giuseppe

It seems that the best practise would be to use an element-click selector for the company pagination, altho I'm not so sure what are you trying to achieve since I haven't seen your sitemap and the data points which you are trying to get.

I managed to tweak something and this is the output I got in the Cloud Scraper.