Im at an endpass with learning on my own

How to?
#1

I'm trying to scrape the information prior to entering into the different url's but I'm only either getting no data scraped or just all of it jumbled up and not comprehensive at all, what i want scraped are each article under the different subcategories, i've been trying for 3 days now on my own just trying different things and it refuses to do what i want and so here i am asking for help.

https://www.brincksafe.se/shop/view

Sitemap:
Got no sitemap cause i've only managed pagination and then over and over again testing to scrape the info i want in various ways :frowning:

#2

Not quite sure what you mean by scraping 'articles', but if you are after the product, this sitemap should work for you as a starting point.

{"_id":"brinck","startUrl":["https://www.brincksafe.se/shop/view"],"selectors":[{"id":"category","type":"SelectorLink","parentSelectors":["_root"],"selector":"li.has_sub li a","multiple":true,"delay":0},{"id":"product-url","type":"SelectorLink","parentSelectors":["element-click"],"selector":"h5 a","multiple":true,"delay":0},{"id":"element-click","type":"SelectorElementClick","parentSelectors":["category"],"selector":"div.item","multiple":true,"delay":"2000","clickElementSelector":".page_button","clickType":"clickOnce","discardInitialElements":false,"clickElementUniquenessType":"uniqueCSSSelector"},{"id":"product-name","type":"SelectorText","parentSelectors":["product-url"],"selector":"h1.title","multiple":false,"regex":"","delay":0}]}

#3

Thanks, its hard doing this blind, getting a platform to learn on helps, btw where did u find div.item in element-selector from ? Element Preview shows nothing

There's alot of HTML-digging to find certain elements as well because i've only done clicking on the homepage so far and the buttons aren't clickable, they just switch pages

... Oh i had it on List and not as blocks

#5

To make sure that you always select the correct element you do have to navigate through the Element part of the console, although every item gets highlighted as you go through them so that makes it a bit easier.

You can select items by using the keyboard so that you do not have to click on items. When you click on 'Select' there will pop up a small box just above the console on the left hand side, there you can click on 'Enable key evens' and then you will be able to select items by hovering over them and using the 'S' key.

1 Like