Missing Image link

How to?
#1

Hi,
I have been able to scrape successfully. Only issue that I am facing is when I download the CSV, certain image links are missing.

Url: https://www.amazon.ae/s?k=maybelline&rh=n%3A11497859031%2Cn%3A12149670031&dc&qid=1566927327&rnid=15199045031&ref=sr_nr_n_4

Sitemap:
{"_id":"maybellinemascara","startUrl":["https://www.amazon.ae/s?k=maybelline&rh=n%3A11497859031%2Cn%3A12149670031&dc&qid=1566927327&rnid=15199045031&ref=sr_nr_n_4"],"selectors":[{"id":"pagelink","type":"SelectorLink","parentSelectors":["_root","pagelink"],"selector":".a-pagination a","multiple":true,"delay":0},{"id":"productlink","type":"SelectorLink","parentSelectors":["_root","pagelink"],"selector":".a-size-mini a","multiple":true,"delay":0},{"id":"productname","type":"SelectorText","parentSelectors":["productlink"],"selector":"span#productTitle","multiple":false,"regex":"","delay":0},{"id":"price","type":"SelectorText","parentSelectors":["productlink"],"selector":".olp-padding-right span","multiple":false,"regex":"","delay":0},{"id":"image","type":"SelectorImage","parentSelectors":["productlink"],"selector":"img.a-stretch-vertical","multiple":false,"delay":0}]}

#2

Hi, your scraper looks fine. I'm guessing you're using the default delays (2000) for WS so some pages may not have enough time to load properly, hence the null values. I'd suggest these settings for e-commerce sites:

Request interval (ms): 2500
Page load delay (ms): 4500

If you have an unreliable connection, increase the Page load delay further.

1 Like