Scraping multiple wp-image on different pages

How to?
#1

I am trying to scrape a number of sites that all use Wordpress but I keep coming up to a problem from time-to-time which is that each page has a product image with a dedicated number attached to it.

For example img.wp-image-5522, img.wp-image-5523, img.wp-image-2571 and this is the same for each individual product.

Now when the scrape is started it just picks up that one image that was picked up by the selector.

How do I make sure that it selects the image from the product page that it is scraping?

This is one of the sites

#2

You can use ElementAttribute to extract the value you need... Easy )

#3

I tried ElementAttribute and src but it keeps referring to that specific image so it does not scrape any of the others that are needed

#4

send your sitemap, will check what's wrong

#5

thank you, much appreciated!

{"_id":"virto","startUrl":["https://www.virto.es/todos-los-productos/"],"selectors":[{"id":"cat","parentSelectors":["_root"],"type":"SelectorLink","selector":".products_list_item a","multiple":true,"linkType":"linkFromHref"},{"id":"prod","parentSelectors":["cat"],"type":"SelectorLink","selector":".products_list_item a","multiple":true,"linkType":"linkFromHref"},{"id":"style","parentSelectors":["prod"],"type":"SelectorLink","selector":".products_list_item a","multiple":true,"linkType":"linkFromHref"},{"id":"name","parentSelectors":["style"],"type":"SelectorText","selector":"h1","multiple":false,"regex":""}]}

#6

here you go...

{"_id":"VIRTO","startUrl":["https://www.virto.es/todos-los-productos/"],"selectors":[{"id":"cat","linkType":"linkFromHref","multiple":true,"parentSelectors":["_root"],"selector":".products_list_item a","type":"SelectorLink"},{"id":"prod","linkType":"linkFromHref","multiple":true,"parentSelectors":["cat"],"selector":".products_list_item a","type":"SelectorLink"},{"id":"style","linkType":"linkFromHref","multiple":true,"parentSelectors":["prod"],"selector":".products_list_item a","type":"SelectorLink"},{"id":"name","multiple":false,"parentSelectors":["style"],"regex":"","selector":"h1","type":"SelectorText"},{"extractAttribute":"class","id":"id_","multiple":false,"parentSelectors":["style"],"selector":"div.et_pb_section_0 span[class*=\"image_wrap\"] img","type":"SelectorElementAttribute"}]}
#7

Sorry, what I meant is that I cannot get the dedicated URL for each image on each product.

#8

You wrote that you need only ID number from image class? Isn't it ?
You need a picture URL?

#9

I think I did not write it properly but I meant the URL.

I can only scrape the image that is selected by the selector which shows the ID. However, I need the product image URLs to import the image to my site.

#10

Am I right? You need picture URLs of sub-categories...

image
image858×435 96.9 KB

or exactly - picture of products?
image

#11

URL of product pictures, like this for example https://www.virto.es/wp-content/uploads/2021/07/aceituna-negra-entera-1.jpg

#12

try to add this selector:
image

#13

You are a hero! Thank you that works :grinning:

#14

Have a nice day ))))