(SOLVED) Showing NULL when scraping

How to?
#1

Hello,

I would like to scrap few data from that website:
www.ss.com

Do not hesitate to change the language in English with google chrome.

I have returned the information Null in every data.

Could someone help me with that?
Thank you

08
Capture d’écran 2019-04-24 à 13.57.08.jpg2244×1322 1020 KB

Here is my sitemap:

{"_id":"automobile","startUrl":["https://www.ss.com/lv/transport/cars/"],"selectors":[{"id":"cars_models","type":"SelectorLink","parentSelectors":["_root"],"selector":"table[align] [align='left'] td a","multiple":true,"delay":0},{"id":"page_products","type":"SelectorLink","parentSelectors":["cars_models"],"selector":"a.am","multiple":true,"delay":0},{"id":"model","type":"SelectorText","parentSelectors":["page_products"],"selector":".ads_opt b font font","multiple":false,"regex":"","delay":0},{"id":"Year","type":"SelectorText","parentSelectors":["page_products"],"selector":"#tdo_18 font font","multiple":false,"regex":"","delay":0},{"id":"Engine","type":"SelectorText","parentSelectors":["page_products"],"selector":"#tdo_15 font font","multiple":false,"regex":"","delay":0},{"id":"Price","type":"SelectorElementClick","parentSelectors":["page_products"],"selector":"#tdo_8 font font","multiple":false,"delay":0,"clickElementSelector":"#tdo_8 font font","clickType":"clickOnce","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"Image","type":"SelectorImage","parentSelectors":["page_products"],"selector":"img.pic_thumbnail","multiple":true,"delay":0}]}

#2

This should work:

{"_id":"automobile","startUrl":["https://www.ss.com/lv/transport/cars/"],"selectors":[{"id":"cars_models","type":"SelectorLink","parentSelectors":["_root"],"selector":"table[align] a","multiple":true,"delay":0},{"id":"page_products","type":"SelectorLink","parentSelectors":["cars_models"],"selector":"a.am","multiple":true,"delay":0},{"id":"model","type":"SelectorText","parentSelectors":["page_products"],"selector":"td.ads_opt_name:contains('Marka') +","multiple":false,"regex":"","delay":0},{"id":"Year","type":"SelectorText","parentSelectors":["page_products"],"selector":"td.ads_opt_name:contains('Izlaiduma gads') +","multiple":false,"regex":"","delay":0},{"id":"Engine","type":"SelectorText","parentSelectors":["page_products"],"selector":"td.ads_opt_name:contains('Motors') +","multiple":false,"regex":"","delay":0},{"id":"Price","type":"SelectorText","parentSelectors":["page_products"],"selector":".ads_price .ads_price","multiple":false,"regex":"","delay":0},{"id":"Image","type":"SelectorImage","parentSelectors":["page_products"],"selector":"img.pic_thumbnail","multiple":true,"delay":0}]}

Before scraping, make sure you double check the items that you have selected with the 'Element Preview' button. Pages that are not structured properly with tags and attributes need extra vigilance to make sure that the selectors you select work on all of the product pages and not just the one that you created the selectors on.

1 Like
#3

Thank you very much for your help. its working.

I do not know why, i tried many times, by clicking exactly the same way, and it was not working. Now im trying.. and its woking. i do not know what i am doing differently.

Thank you anyway!

#4