Problems with pagination ... I don`t get it

How to?
#1

Hello smart people,

I have been trying to scrape 72 pages of this website for more than 3 hours, but unfortunately no more than 14 pages are scrapped. I am at a loss :confused:

Can anyone help me?

Url: Transport - SkladiĆĄtenje i logistika | Poslovni Imenik-Adresar BiH

Sitemap:
{"_id":"poslovni-adresar","startUrl":["Transport - SkladiĆĄtenje i logistika | Poslovni Imenik-Adresar BiH a","multiple":true},{"id":"Pages","parentSelectors":["_root"],"type":"SelectorLink","selector":"a.page-link","multiple":true},{"id":"Name","parentSelectors":["links"],"type":"SelectorText","selector":"span[itemprop='name']","multiple":false,"regex":""},{"id":"Address","parentSelectors":["links"],"type":"SelectorText","selector":"span[itemprop='street-address']","multiple":false,"regex":""},{"id":"City","parentSelectors":["links"],"type":"SelectorText","selector":"span[itemprop='locality']","multiple":false,"regex":""},{"id":"Phone","parentSelectors":["links"],"type":"SelectorText","selector":"span[itemprop='tel']","multiple":false,"regex":""},{"id":"Website","parentSelectors":["links"],"type":"SelectorLink","selector":"dt:contains('Web') + dd","multiple":false},{"id":"Mobilni","parentSelectors":["links"],"type":"SelectorText","selector":"dt:contains('Mobilni') + dd","multiple":false,"regex":""}]}

#2

@GeorgPapa Hi, please, be sure to apply the preformatted text option on the JSON code of your sitemap, otherwise, it seems to be invalid.

Preformatted Text
Preformatted Text1096×81 6.83 KB

1 Like
#3

Sorry for the late reply ... did not realize that someone answered my question.
If you can help me, I would be very grateful. Thanks :smiley:

Does it work now properly with the JSON?

{"_id":"poslovni-adresar","startUrl":["https://www.poslovni-adresar.ba/prikazi.php?ktg=1&djelatnost=transport-skladistenje-i-logistika#gsc.tab=0"],"selectors":[{"id":"links","parentSelectors":["_root","Pages"],"type":"SelectorLink","selector":"h2 a","multiple":true},{"id":"Pages","parentSelectors":["_root"],"type":"SelectorLink","selector":"a.page-link","multiple":true},{"id":"Name","parentSelectors":["links"],"type":"SelectorText","selector":"span[itemprop='name']","multiple":false,"regex":""},{"id":"Address","parentSelectors":["links"],"type":"SelectorText","selector":"span[itemprop='street-address']","multiple":false,"regex":""},{"id":"City","parentSelectors":["links"],"type":"SelectorText","selector":"span[itemprop='locality']","multiple":false,"regex":""},{"id":"Phone","parentSelectors":["links"],"type":"SelectorText","selector":"span[itemprop='tel']","multiple":false,"regex":""},{"id":"Website","parentSelectors":["links"],"type":"SelectorLink","selector":"dt:contains('Web') + dd","multiple":false},{"id":"Mobilni","parentSelectors":["links"],"type":"SelectorText","selector":"dt:contains('Mobilni') + dd","multiple":false,"regex":""}]}```