Hello everyone,
I'm looking for help because I'm stuck.
The website I'm trying to scrape is done a bit strangely and I cannot make it work.
What I want to do is scrape the title and brand on the product page, that's it.
> like on this page
So for that it seems I would need to have the category menu "opened" but it doesn't seem to be clickable via the selector on the main page. However if you go on a random product page it works?!
https://www.selver.ee/oun-paulared-kg
Then, some categories have sub-categories which then depending on the amount of products there could be some pagination with up to 10 pages.
But, on some categories there also are sub-sub-categories (see photo because here it's not clickable)
Honeslty this is really hard to map, I'm not sure anyone will figure it out.
But if there is a genius around here, maybe he or she could help me!
Thanks in advance!
Sitemap:
{"_id":"slver","startUrl":["https://www.selver.ee/oun-kanzi-kg"],"selectors":[{"extractAttribute":"class","id":"click","parentSelectors":["_root"],"selector":"li:nth-of-type(n+7) > button","type":"SelectorGroup"},{"id":"sub-category","linkType":"linkFromHref","multiple":true,"parentSelectors":["_root","sub-category"],"selector":".SidebarMenu__item.is-open a","type":"SelectorLink"},{"id":"page","paginationType":"auto","parentSelectors":["sub-category","page"],"selector":".Category__toolbar a.sf-pagination__item","type":"SelectorPagination"},{"id":"link","linkType":"linkFromHref","multiple":true,"parentSelectors":["page"],"selector":".ProductCard > a","type":"SelectorLink"},{"id":"title","multiple":false,"parentSelectors":["page"],"regex":"","selector":"h1","type":"SelectorText"},{"id":"SKU","multiple":false,"parentSelectors":["page"],"regex":"","selector":"tr:contains('SKU') td","type":"SelectorText"}]}