Website dosen't react to scraper

How to?
#1

Hi guys.

i have an question to the website below. It seems that I can't scrape it. It just dosen't react to anything. Do I miss something? Does the website block me or is my script false?

Url: Kinderwagen bequem online bestellen | baby-walz

Sitemap:
{"_id":"estst","startUrl":["https://www.baby-walz.de/kinderwagen/"],"selectors":[{"delay":0,"id":"next","multiple":true,"parentSelectors":["_root","next"],"selector":".bw-pagination--small a.bw-pagination__element:nth-of-type(n+3)","type":"SelectorLink"},{"clickElementSelector":".image img.img-responsive","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":2000,"discardInitialElements":"do-not-discard","id":"element","multiple":true,"parentSelectors":["_root","next"],"selector":"section","type":"SelectorElementClick"},{"clickElementSelector":"label","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":2000,"discardInitialElements":"do-not-discard","id":"element2","multiple":false,"parentSelectors":["element"],"selector":"_parent_","type":"SelectorElementClick"},{"delay":0,"id":"name","multiple":true,"parentSelectors":["element2"],"regex":"","selector":".hidden-sm h1","type":"SelectorText"}]}

#2

@Robinn Hi, it appears that your sitemap configuration is not set quite properly as it seems to lead to an infinite loop.

Working example:

{"_id":"estst","startUrl":["https://www.baby-walz.de/kinderwagen/"],"selectors":[{"delay":0,"id":"product-link","multiple":true,"parentSelectors":["_root"],"selector":"a[data-catentry]","type":"SelectorLink"},{"delay":0,"id":"price","multiple":false,"parentSelectors":["product-link"],"regex":"","selector":"span.priceValue","type":"SelectorText"}]}

1 Like
#3

nice thx for the help!!