One product in different categories (breadcrumbs)

#1

I try to scrape the different categories of one product.
But i only have one row in the csv, with only one category.....

example book:
[Kontrollierte Ohrakupunktur bei Hund und Pferd]

category "hund"
https://www.thieme.de/shop/Alle-Fachgebiete/Aerzte/Tiermedizin/c/100117?q=:relevance:subjectCategory:10011704&page=5&show=Page25&contributor=&subject=

category "pferd"
https://www.thieme.de/shop/Alle-Fachgebiete/Aerzte/Tiermedizin/Pferde/c/10011702?q=:relevance&page=2&show=Page25&contributor=&subject=

i want to scrape the different categories...or breadcrumbs:
Tiermedizin | Spezialbereich: Hunde, Katzen
and
Tiermedizin | Pferde

but i only get one row, with the main categeory "pferde"....

the links, text, images, price etc. is no problem.....

can anybody help?

#2

The scraper will only enter a URL once to avoid duplicates, so if this item is found in multiple categories, the scraper will only grab the first one it is encountered. There is no great way of going about this.

The easiest way of dealing with this would be create multiple start URLs for each of the categories in the metadata. This way the scraper will treat each item as unique URL due to it having a seperate start URL.

#3

Hi webber,

ok. in this case i do it with 2 different scrapes.
But i have other scrapes with 50 or 100 categories.... i cant make so much different scrapes :frowning:

@webscraper
can you make an option for these problem?
for example by the "link" type the option "duplicates authorized".....
i need this for scraping manufacturer shops and the categorizing for my shop after the scrape :slight_smile:

#4

I am assuming more people are encountering the problem with duplicates. Since it's been a while after the last response here, is there maybe a way to allow the mentioned duplicates?