How to scrap a list of product images?

How to?
#1

Describe the problem.

I have a website that lists multiple t-shirts.
I've successfully extracted the Brand, SKU, and Item Name.
However, I cannot seem to extract the list of colours, and image URL's.
The scraper would need to loop through the swatches, and extract the and

Url: https://wescanedmonton.com/utilities/tscredirect.php?id=1

Sitemap:
{"_id":"technosport-wescanphp","startUrl":["https://wescanedmonton.com/utilities/tscredirect.php?id=1,"selectors":[{"id":"Brand","type":"SelectorText","parentSelectors":["product-wrapper"],"selector":"div.browseMillDesc","multiple":false,"regex":"\s(.*)","delay":0},{"id":"SKU","type":"SelectorText","parentSelectors":["product-wrapper"],"selector":"div.productID","multiple":false,"regex":"","delay":0},{"id":"ItemDescription","type":"SelectorText","parentSelectors":["product-wrapper"],"selector":".browseProdDesc","multiple":false,"regex":"","delay":0},{"id":"product-wrapper","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.thumbnail","multiple":true,"delay":"2000","clickElementSelector":"a.viewAll","clickType":"clickOnce","discardInitialElements":"discard-when-click-element-exists","clickElementUniquenessType":"uniqueText"},{"id":"imageURL","type":"SelectorElementClick","parentSelectors":["product-wrapper"],"selector":"div.colorOuter","multiple":true,"delay":0,"clickElementSelector":"img.colorSwatch","clickType":"clickOnce","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"}]}

#2

A side question - is it possible for webscraper to:

  • Scrape data from the products list page (multiple products)
  • Click into a product, scrape that page
  • Return to the previous page
  • Repeat until done

?

#3

I got this to work -- thank you!