Pagination problem / the "Next" button

How to?
#1

Hi folks,
I'm a new one to Web Scrapper. So I have a task to collect companies' names, websites, emails, and phone numbers. I've done some work and can collect the data from the first 10 pages, but I have a problem with the "Next" button. Please, help me.

Url: Полы и напольные покрытия в России - адреса, справочная информация, отзывы в справочнике компаний, предприятий и организаций рубрики "Полы и напольные покрытия"

Sitemap:
{"_id":"orgpagedata","startUrl":["https://www.orgpage.ru/rossiya/poly-i-napolnye-pokrytiya/"],"selectors":[{"id":"Listing URL","type":"SelectorLink","parentSelectors":["_root","Pagination"],"selector":".similar-item__title a","multiple":true,"delay":0},{"id":"Pagination","type":"SelectorLink","parentSelectors":["_root","Pagination"],"selector":"a.pageNum:nth-of-type(-n+30)","multiple":true,"delay":0},{"id":"name","type":"SelectorText","parentSelectors":["Listing URL"],"selector":"h1","multiple":false,"regex":"","delay":0},{"id":"site","type":"SelectorText","parentSelectors":["Listing URL"],"selector":"a.nofol-link","multiple":false,"regex":"","delay":0},{"id":"email","type":"SelectorText","parentSelectors":["Listing URL"],"selector":"a[itemprop='email']","multiple":false,"regex":"","delay":0},{"id":"phone","type":"SelectorText","parentSelectors":["Listing URL"],"selector":"span[itemprop='telephone']","multiple":false,"regex":"","delay":0}]}

#2

If the site uses zero paddings in URLs then add zero paddings to the range definition - [001-100]. If you want to skip some URLs then you can also specify incremental like this [0-100:10].

Use range URL like this http://example.com/page/[1-3] for links like these:

  • http://example.com/page/1
  • http://example.com/page/2
  • http://example.com/page/3

I've changed your site meta. Hope you understand.

New Sitemap:

{"_id":"orgpagedata","startUrl":["https://www.orgpage.ru/rossiya/poly-i-napolnye-pokrytiya/[1-10]/"],"selectors":[{"id":"Listing URL","type":"SelectorLink","parentSelectors":["_root"],"selector":".similar-item__title a","multiple":true,"delay":0},{"id":"name","type":"SelectorText","parentSelectors":["Listing URL"],"selector":"h1","multiple":false,"regex":"","delay":0},{"id":"site","type":"SelectorText","parentSelectors":["Listing URL"],"selector":"a.nofol-link","multiple":false,"regex":"","delay":0},{"id":"email","type":"SelectorText","parentSelectors":["Listing URL"],"selector":"a[itemprop='email']","multiple":false,"regex":"","delay":0},{"id":"phone","type":"SelectorText","parentSelectors":["Listing URL"],"selector":"span[itemprop='telephone']","multiple":false,"regex":"","delay":0}]}

#3

Thank you, @Asad ! I'll try it.