The image URLs I extracted are all the same. What could be the reason for this, and how can I fix it?

How to?
#1

Hi,
I am mic.
I’m an economics student conducting research on market prices and product information of rings. To collect the data, I’m using web scraping techniques to extract information from relevant websites.

But The image URLs I extracted are all the same. What could be the reason for this, and how can I fix it?(I’m able to scrape the information from each product page, but although every page contains multiple images, the scraper only retrieves the same single image from each product page.)

Pls if you know how to solve this problem, help me!

Url: www.mollyjewelryus.com

The Sitemap:

{"_id":"mollyjewelry","startUrl":["https://mollyjewelryus.com/"],"selectors":[{"id":"engagement","parentSelectors":["_root"],"type":"SelectorLink","selector":".menu-item-30338.c-top-menu__item > a","multiple":false,"linkType":"linkFromHref"},{"id":"collectionpage","parentSelectors":["pagination"],"type":"SelectorLink","selector":".c-product-grid__title-wrap a:nth-of-type(1)","multiple":true,"linkType":"linkFromHref"},{"id":"title","parentSelectors":["collectionpage"],"type":"SelectorText","selector":"h1","multiple":false,"regex":"","multipleType":"singleColumn"},{"id":"price","parentSelectors":["collectionpage"],"type":"SelectorText","selector":"bdi","multiple":false,"regex":"","multipleType":"singleColumn"},{"id":"description","parentSelectors":["collectionpage"],"type":"SelectorText","selector":".c-product__short-description p","multiple":false,"regex":"","multipleType":"singleColumn"},{"id":"image1","parentSelectors":["collectionpage"],"type":"SelectorImage","selector":".active img.c-product__slider-img","multiple":false,"multipleType":"singleColumn"},{"id":"image2","parentSelectors":["collectionpage"],"type":"SelectorImage","selector":".active img.c-product__slider-img","multiple":false,"multipleType":"singleColumn"},{"id":"image3","parentSelectors":["collectionpage"],"type":"SelectorText","selector":".active img.c-product__slider-img","multiple":false,"regex":"","multipleType":"singleColumn"},{"id":"image4","parentSelectors":["collectionpage"],"type":"SelectorImage","selector":".active img.c-product__slider-img","multiple":false,"multipleType":"singleColumn"},{"id":"image5","parentSelectors":["collectionpage"],"type":"SelectorImage","selector":".active img.c-product__slider-img","multiple":false,"multipleType":"singleColumn"},{"id":"image6","parentSelectors":["collectionpage"],"type":"SelectorImage","selector":".active img.c-product__slider-img","multiple":false,"multipleType":"singleColumn"},{"id":"image7","parentSelectors":["collectionpage"],"type":"SelectorImage","selector":".active img.c-product__slider-img","multiple":false,"multipleType":"singleColumn"},{"id":"image8","parentSelectors":["collectionpage"],"type":"SelectorImage","selector":".active img.c-product__slider-img","multiple":false,"multipleType":"singleColumn"},{"id":"pagination","parentSelectors":["engagement","pagination"],"paginationType":"auto","type":"SelectorPagination","selector":"a.next"}]}

#2

You can gather all large images from each product page by this setting:
image

#3

Thanks for your reply ,don.

Are you using the Professional or Enterprise version? I don’t see the “grouped” type on my side.

mic

#4

I use an ordinary free version of Webscraper...

#5

:cold_sweat:

Really sad!!!!!! I am not in USA.
Maybe that's why The version I donwloaded is different with you

So sad!

Mic

#6

I'm not from USA )))))

#7

Really？
Where are u from？

#8

Hi,

Please see the reference below for scraping the image URLs:

{"_id":"mollyjewelry","startUrl":["https://mollyjewelryus.com/"],"selectors":[{"id":"engagement","linkType":"linkFromHref","multiple":false,"parentSelectors":["_root"],"selector":".menu-item-30338.c-top-menu__item > a","type":"SelectorLink"},{"id":"collectionpage","linkType":"linkFromHref","multiple":true,"parentSelectors":["pagination"],"selector":".c-product-grid__title-wrap a:nth-of-type(1)","type":"SelectorLink"},{"id":"title","multiple":false,"multipleType":"singleColumn","parentSelectors":["collectionpage"],"regex":"","selector":"h1","type":"SelectorText"},{"id":"price","multiple":false,"multipleType":"singleColumn","parentSelectors":["collectionpage"],"regex":"","selector":"bdi","type":"SelectorText"},{"id":"description","multiple":false,"multipleType":"singleColumn","parentSelectors":["collectionpage"],"regex":"","selector":".c-product__short-description p","type":"SelectorText"},{"id":"image8","multiple":false,"multipleType":"singleColumn","parentSelectors":["collectionpage"],"selector":".active img.c-product__slider-img","type":"SelectorImage"},{"id":"pagination","paginationType":"auto","parentSelectors":["engagement","pagination"],"selector":"a.next","type":"SelectorPagination"},{"id":"images-in-one-cell","multipleType":"singleColumnWithSeparator","parentSelectors":["collectionpage"],"selector":".c-product__thumbs-img","type":"SelectorImage"},{"columnCount":"10","id":"images-separate","multipleType":"multipleColumns","parentSelectors":["collectionpage"],"selector":".c-product__thumbs-img","type":"SelectorImage"}]}

You can use 'Find and replace' in Excel to remove '-100x100' from the links to get the full size image URLs.

#10

Thanks so much
Is a good way!