Sitemap scraps 20 random products evert run

How to?
#1

I "build" the sitemap and tried scraping all the products from this site. As far as I can tell it works but it only scraps 20 random products from the site but not all of the content.

Tried a couple of different aproches for the sitemap, can't seem to figure it out. Any tips?

Url: https://www.vlaamsstripcentrum.shop

Sitemap:
{"_id":"vsc_shop","startUrl":["https://www.vlaamsstripcentrum.shop"],"selectors":[{"id":"pagnation","paginationType":"clickOnce","parentSelectors":["_root","pagnation"],"selector":".pager-next a","type":"SelectorPagination"},{"delay":0,"id":"Producten","multiple":true,"parentSelectors":["pagnation"],"selector":".field-item div a","type":"SelectorLink"},{"delay":0,"id":"Titel","multiple":false,"parentSelectors":["Producten"],"regex":"","selector":"a.active","type":"SelectorText"},{"delay":0,"id":"ean","multiple":false,"parentSelectors":["Producten"],"regex":"","selector":".field-name-field-strip-sku div.field-item","type":"SelectorText"},{"delay":0,"id":"prijs","multiple":false,"parentSelectors":["Producten"],"regex":"","selector":".group-product .field-name-commerce-price div.field-item","type":"SelectorText"},{"delay":0,"id":"Lange omschrijving","multiple":false,"parentSelectors":["Producten"],"regex":"","selector":".field-name-body div.field-item","type":"SelectorText"},{"delay":0,"id":"Reeks","multiple":false,"parentSelectors":["Producten"],"regex":"","selector":".field-name-field-strip-reeks a","type":"SelectorText"},{"delay":0,"id":"uitvoering","multiple":false,"parentSelectors":["Producten"],"regex":"","selector":".field-name-field-strip-uitvoering a","type":"SelectorText"},{"delay":0,"id":"Scenarist","multiple":false,"parentSelectors":["Producten"],"regex":"","selector":".field-name-field-strip-scenarist a","type":"SelectorText"},{"delay":0,"id":"tekenaar","multiple":false,"parentSelectors":["Producten"],"regex":"","selector":".field-name-field-strip-tekenaar a","type":"SelectorText"},{"delay":0,"id":"uitgeverij","multiple":false,"parentSelectors":["Producten"],"regex":"","selector":".field-name-field-strip-uitgeverij a","type":"SelectorText"},{"delay":0,"id":"Afbeelding","multiple":false,"parentSelectors":["Producten"],"selector":".group-left img","type":"SelectorImage"}]}

#2

@VSC Hi. Everything seems to be correct, however it doesn't seem like you are targeting any specific category. Try to update the start URLs accordingly to the targeted categories or add additional selectors for each of the category links.

1 Like
#3

Thanks, @viesturs
If I understand correctly I just need to change my root url to the specific category?
SO my start url should be [Preformatted text](https://www.vlaamsstripcentrum.shop/strips)

I will try that.

#4

@VSC Exactly. Your sitemap won't function with the current start URL you have used, therefore you have to implement an additional 'Link' selector that would lead to a specific category or simply update the start URL.

1 Like
#5

I honestly thought I had used the 'Link' selector correctly. I've been messing about before I found this support form/community. Thanks @ViestursWS I will try it again.