Why my Pagination does not work? :(

[Casper]

Hello all,
I am a newbie in web scraper and very eager to learn. I checked the video tutorial however even I tried doing the same my scraping does not pull data.

The website that I am after is https://www.woolworths.com.au/shop/browse/fruit-veg

My exported sitemap looks below:

{"_id":"woolworths","startUrl":["https://www.woolworths.com.au/shop/browse/fruit-veg"],"selectors":[{"id":"pagination","type":"SelectorLink","parentSelectors":["_root"],"selector":"a.paging-next","multiple":true,"delay":0},{"id":"productlist","type":"SelectorLink","parentSelectors":["_root","pagination"],"selector":"a.shelfProductTile-descriptionLink","multiple":true,"delay":0}]}

Thanks all.

[ivanoung]

I actually have the same problem, but that didn't happen last week. I'm guessing it has to do with the latest push to production. Reason: Web Scraper updated their UI too.

[ivanoung]

I figured out the reason why for my case.

Trip advisor used href without the domain
<a class="things" href="/product/1">

rather than the typical a tag link
<a class="things" href="https://www.buy.com/product/1">

In that case, I would just use the attributor selector rather than anything else.

[leemeng]

I have covered woolworths a couple of times. Refer to

All elements are selected but only limited results returned

Turns out it also needs a scroller, and longer delays. Try this with Page load delay 9000: {"_id":"coles-test2","startUrl":["https://shop.coles.com.au/a/a-national/everything/browse/pantry/breakfast?pageNumber=1"],"selectors":[{"id":"Item wrappers n scroller","type":"SelectorElementScroll","parentSelectors":["_root","pageination"],"selector":"header.product-header","multiple":true,"delay":"4000"},{"id":"name","type":"SelectorText","parentSelectors":["Item wrappers n scroller"],"selector":".prod…

Can't scrape HTML Source Hidden

{"_id":"forum-woolworths","startUrl":["https://www.woolworths.com.au/shop/browse/pantry/snacks-confectionery/chocolate-blocks"],"selectors":[{"id":"Product n Link","type":"SelectorLink","parentSelectors":["_root"],"selector":".tile-container a.shelfProductTile-descriptionLink","multiple":true,"delay":0},{"id":"Energy per serving","type":"SelectorText","parentSelectors":["Product n Link"],"selector":"tr:contains('Energy') td:nth-of-type(2)","multiple":false,"regex":"","delay":0},{"id":"Energy per…

[Casper]

https://www.woolworths.com.au/shop/browse/pantry/snacks-confectionery/chocolate-blocks

hi @leemeng

Image below is the selector graph. However, when I perform Scrape it does not return any data at all.

Sitemap:

Checking the Product n Link

Check the detail:

Pretty sure I am doing something terribly wrong.

Thank you in advance for the help.