Scrape Public Amazon wish list

How to?
#1

Hi everyone,

I would like to export my Amazon wish list for use on another site. Unfortunately, Amazon only lets you download a printable version of your wish list, which does not include the item URL. I need the URL so that I can link back to Amazon.

It looks like I am getting the correct number of items, but none of their data! Amazon uses an infinite scroll, so I have tried to use the Element scroll down selector, without much luck.

How should I go about scraping my Amazon wish list?

Url: https://www.amazon.co.uk/registry/wishlist/WS5TGJQ9K8BS/

Sitemap:
{"_id":"wishlist","startUrl":["https://www.amazon.co.uk/registry/wishlist/WS5TGJQ9K8BS/"],"selectors":[{"id":"mls_url","type":"SelectorLink","selector":"h3.a-size-base","parentSelectors":["items"],"multiple":false,"delay":"100"},{"id":"mls_price","type":"SelectorText","selector":"div#item_IK5TP726YTAQJ.a-fixed-left-grid span.a-price > span:nth-of-type(2)","parentSelectors":["mls_url"],"multiple":false,"regex":"","delay":""},{"id":"items","type":"SelectorElementScroll","selector":"h3.a-size-base","parentSelectors":["_root"],"multiple":true,"delay":"5000"}]}

#2

I got you 90% of the way there. I worked out how to scrape all the names, prices and Unique ID number for each product. I can't figure out how to get the URL for the listing. However, you can append the Unique ID to "https://www.amazon.co.uk/dp/" post scrape to get the URL

I am sure someone else will have a better example. @iconoclast?

{"_id":"amazon","startUrl":["https://www.amazon.co.uk/registry/wishlist/WS5TGJQ9K8BS/"],"selectors":[{"id":"Scroll DOwn","type":"SelectorElementScroll","selector":"div.a-fixed-right-grid-col > div.a-row","parentSelectors":["_root"],"multiple":true,"delay":"5000"},{"id":"Name","type":"SelectorText","selector":"h3","parentSelectors":["Scroll DOwn"],"multiple":false,"regex":"","delay":0},{"id":"Product URL","type":"SelectorHTML","selector":"parent","parentSelectors":["Scroll DOwn"],"multiple":false,"regex":"(?<=dp/)[A-Z0-9]+","delay":0},{"id":"Price","type":"SelectorText","selector":"div.a-column div.a-row div.a-row:nth-of-type(2) div.a-section","parentSelectors":["Scroll DOwn"],"multiple":false,"regex":"[\$\u20AC\u00A3]{1}\d+\.?\d{0,2}","delay":0}]}

#3

Hi!

Sorry for belated answer, just having a rough week at my job lol.

You just need to pick a right wrapper for Scroll down for all the items, as the wish list is not big at all.

Again, you should at least know how to properly use CSS selectors (you can look @ W3Schools)

Each item has an id coded into it's selector, you can pick all items just by shortening it's classname.

Please try this sitemap:
{"_id":"wishlist","startUrl":["https://www.amazon.co.uk/registry/wishlist/WS5TGJQ9K8BS/"],"selectors":[{"id":"mls_url","type":"SelectorElementAttribute","selector":"h3.a-size-base a.a-link-normal","parentSelectors":["items"],"multiple":false,"extractAttribute":"href","delay":"100"},{"id":"mls_price","type":"SelectorText","selector":"div.a-fixed-left-grid span.a-offscreen","parentSelectors":["items"],"multiple":false,"regex":"","delay":""},{"id":"items","type":"SelectorElementScroll","selector":"li.a-spacing-none","parentSelectors":["_root"],"multiple":true,"delay":"2000"},{"id":"Name","type":"SelectorText","selector":"h3.a-size-base","parentSelectors":["items"],"multiple":false,"regex":"","delay":0}]}

P.S. there's a less time-consuming workaround for this -- create an element selector to group results, and scroll down manually until whole list is shown. Then hit Preview data and copy-paste the results.

P.P.S. nice wishlist!