Https://www.ikh.fi/en/home

How to?
#1

Describe the problem.
Can this site be scraped ????

Links not working, data selected after pop-up but stops
Click attribute not bring back values
Cannot create select on item page

Url: https://www.ikh.fi/en/home

Sitemap:
{"_id":"ikh","startUrl":["https://www.ikh.fi/en/spare-parts-for-tractors"],"selectors":[{"id":"main","type":"SelectorPopupLink","parentSelectors":["_root"],"selector":"div.owl-item.owl-fade-out img, div.main-menu-desktop li.menu-item.textProd2 button.title","multiple":true,"delay":0},{"id":"link2","type":"SelectorElementClick","parentSelectors":["link"],"selector":"div.dnsListImg img","multiple":true,"delay":"100","clickElementSelector":"div.sortingWrap.dnsListBottomSortingWrap div.dnsListPager","clickType":"clickMore","discardInitialElements":true,"clickElementUniquenessType":"uniqueHTMLText"},{"id":"link","type":"SelectorLink","parentSelectors":["main"],"selector":"div.main-menu-desktop li.menu-item.textProd2 a.menu-link","multiple":true,"delay":0},{"id":"","type":"SelectorText","parentSelectors":["link2"],"selector":"","multiple":false,"regex":"","delay":0}]}

#2

Yes, the site can be scraped, there was just a whole lot of thing wrong with the sitemap.

  1. The initial ink is not a pop-up link. A pop-up link means, that the link opens in a new window. In this case, this is just a simple drop-down,
  2. The first set of links can be found in the HTML, so you can start off by going straight into them with the first selector.
  3. The Click Selector that paginates through the pages are not clicking on any particular button, so it won't iterate through the pages.

There are some slight improvements made to the sitemap, so you should be able to build out from here:

{"_id":"ikh","startUrl":["https://www.ikh.fi/en/spare-parts-for-tractors"],"selectors":[{"id":"main","type":"SelectorLink","parentSelectors":["_root"],"selector":".menu-item a","multiple":true,"delay":0},{"id":"link2","type":"SelectorElementClick","parentSelectors":["main"],"selector":"a.dnsListItem","multiple":true,"delay":"1500","clickElementSelector":".dnsListPager .active +","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueHTMLText"},{"id":"product-link","type":"SelectorLink","parentSelectors":["link2"],"selector":"_parent_","multiple":false,"delay":0},{"id":"product-name","type":"SelectorText","parentSelectors":["product-link"],"selector":"div.phone-up-show h1.prod-item-title","multiple":false,"regex":"","delay":0}]}

#3

Thanks for the code but, still facing some unusual issues

a) Element click not bringing back any records
b) Product page will not allow items selected and I get the below
image