Please someone help me scraping this website

How to?
#1

The website has to scroll down to see more products, and I have to click each link to get the individual product links

I tried using the element scroll-down but, still does not work for me.
I don't know much about scrapping.
Or is this site come with the site map, I could not see it.

Please, someone, help me get the product link, please?

https://www.yss.co.th/th/products/list?vehicleTypes=&productTypes=SHOCK%20ABSORBER&productSubTypes=SHOCK%20GAS&series=&brand=&model=&year=&cc=&engine=&drive=&vinId=&order=priceDesc&minPrice=0&maxPrice=79000&searchKeyword=

download (2)
download (2)1276×675 115 KB

#2

@tortor55 Hi, it does not appear as if the product links could be found within the page HTML - they are generated by JavaScript.

#3

You can use the entire item as your scrape and just use "enter/return" as a delimiter later

{"_id":"testing","startUrl":["https://www.yss.co.th/th/products/list?vehicleTypes&productTypes=SHOCK%20ABSORBER&productSubTypes=SHOCK%20GAS&series&brand&model&year&cc&engine&drive&vinId&order=priceDesc&minPrice=0&maxPrice=79000&searchKeyword"],"selectors":[{"id":"table","multiple":false,"parentSelectors":["_root"],"selector":"div.col-lg-9","type":"SelectorElement"},{"id":"items","multiple":true,"parentSelectors":["table"],"regex":"","selector":"div.card-body","type":"SelectorText"}]}

image
image588×682 18.4 KB

#4

Thank you very much, you guys!
I really appreciate that :grinning:

1 Like
#5

Your welcome, I'm new to this scraping stuff but I've spent about 50 hrs these past few weeks trying to figure it out. :slight_smile: