Unable to scrape all image URLs in gallery slider

How to?
#1

Trying to scrape image data from the below mentioned page. Data preview shows me all the image urls. But final csv file just provides me the url of first image in slider. I am not sure if I am doing the correct approach.

Url: https://www.rakuten.com/shop/bestchoiceproducts/product/SKY1666/

Sitemap:
{
"_id":"random_data",
"startUrl":[
"https://www.rakuten.com/category/434/?h=3"
],
"selectors":[
{
"id":"category",
"type":"SelectorLink",
"parentSelectors":[
"_root"
],
"selector":"li.r-search-page__category-item li.r-search-page__category-item li.r-search-page__category-item a",
"multiple":true,
"delay":0
},
{
"id":"pagination",
"type":"SelectorLink",
"parentSelectors":[
"category",
"pagination"
],
"selector":"li.r-pagination__item:nth-of-type(n+3) a",
"multiple":true,
"delay":0
},
{
"id":"item",
"type":"SelectorLink",
"parentSelectors":[
"pagination"
],
"selector":"div.r-items div.r-product__name a",
"multiple":true,
"delay":0
},
{
"id":"title",
"type":"SelectorText",
"parentSelectors":[
"item"
],
"selector":"h1.r-product-details__name",
"multiple":false,
"regex":"",
"delay":0
},
{
"id":"price",
"type":"SelectorText",
"parentSelectors":[
"item"
],
"selector":"span.r-product__price-text",
"multiple":false,
"regex":"",
"delay":0
},
{
"id":"description",
"type":"SelectorText",
"parentSelectors":[
"item"
],
"selector":"div.r-product-page__description div.r-accordion:nth-of-type(1) div.r-accordion__child",
"multiple":false,
"regex":"",
"delay":0
},
{
"id":"seller",
"type":"SelectorText",
"parentSelectors":[
"item"
],
"selector":"div.r-product-page__seller-info a.r-button:nth-of-type(1)",
"multiple":false,
"regex":"",
"delay":0
},
{
"id":"rating",
"type":"SelectorHTML",
"parentSelectors":[
"item"
],
"selector":"button.bv_avgRating",
"multiple":false,
"regex":"",
"delay":0
},
{
"id":"no_of_reviews",
"type":"SelectorHTML",
"parentSelectors":[
"item"
],
"selector":"button.bv_numReviews_text",
"multiple":false,
"regex":"",
"delay":0
},
{
"id":"images",
"type":"SelectorImage",
"parentSelectors":[
"item"
],
"selector":"div.r-gallery-slider__full img.slide-image",
"multiple":true,
"delay":"0"
}
]
}

#2

Try this - It should make it run smooth and extract everything you want. It's going to pagnate through every single page before it scrapes

{"_id":"random_data","startUrl":["https://www.rakuten.com/category/434/?h=3"],"selectors":[{"id":"category","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.r-items","multiple":true,"delay":0,"clickElementSelector":"li.r-pagination__next","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"},{"id":"item","type":"SelectorLink","parentSelectors":["category"],"selector":"div.r-items div.r-product__name a","multiple":true,"delay":0},{"id":"title","type":"SelectorText","parentSelectors":["item"],"selector":"h1.r-product-details__name","multiple":false,"regex":"","delay":0},{"id":"price","type":"SelectorText","parentSelectors":["item"],"selector":"span.r-product__price-text","multiple":false,"regex":"","delay":0},{"id":"description","type":"SelectorText","parentSelectors":["item"],"selector":"div.r-product-page__description div.r-accordion:nth-of-type(1) div.r-accordion__child","multiple":false,"regex":"","delay":0},{"id":"seller","type":"SelectorText","parentSelectors":["item"],"selector":"div.r-product-page__seller-info a.r-button:nth-of-type(1)","multiple":false,"regex":"","delay":0},{"id":"rating","type":"SelectorText","parentSelectors":["item"],"selector":"div.r-shop__review-rating","multiple":false,"regex":"","delay":0},{"id":"no_of_reviews","type":"SelectorText","parentSelectors":["item"],"selector":"a.r-shop__review-link","multiple":false,"regex":"\d+(?=\s*)","delay":0},{"id":"images","type":"SelectorImage","parentSelectors":["item"],"selector":"div.r-gallery-slider__full img.slide-image","multiple":true,"delay":"0"}]}

#4

Importing sitemap shows invalid Json. Finds regex text as invalid characters. But, still the image urls are not getting stored in the csv file.

#5

Hi there!

It doesn't extract any images on some pages because you've set your image selector to only pick data from gallery slides to the left of the enlarged image.

image
image.jpg955×751 82.5 KB

If you select elements few levels up, up to it's wrapper, it will pick any images contained inside no matter how it's designed (i.e. gallery or sliders):

image
image.png1545×953 139 KB

Try to set your Image selector to:

div.r-shop__top-content img

(img selector added to pick images)

And it will pick all possible item images in the gallery.