Describe the problem
Hello, first of all, I apologize if my English is not good. I've just started using Web Scraper and I'm encountering a lot of difficulties. While I can usually resolve my errors, I've been facing many issues that I can't solve for the past few days.
In fact, I wanted to practice scraping for my personal use and for testing, on the Genshin Impact game wiki site (more specifically, images of characters at this URL: Character List | Genshin Impact Wiki | Fandom). My goal is to collect the following images from the character pages: talent icons, constellation icons, required material icons, and the image called "drip marketing," which is the main character image on the right side of the page (where you can see the character's appearance). Additionally, I wanted to scrape all the data from each character's gallery page. This process is very time-consuming, and I'm facing many problems. Firstly, most of the data is not being collected. For example, for talent icons, I can only collect a few images, but not all of them, which is frustrating. The same issue occurs with images in the gallery and many other categories.
Furthermore, some categories are not even collected. For instance, Web Scraper skips the books and materials category (the book category is a specific type of material used to increase talents). One of my biggest issues is that the drip marketing image isn't even collected during scraping. I can see that Web Scraper displays the image, but it doesn't collect the URL, no matter what I try. I confess I don't know much about scraping, so I must have made a lot of mistakes.
Currently, this sitemap collects the most information, but there's too much, and I really can't figure it out. I'm not very knowledgeable in coding, and I've tried using CSS selectors, which has helped me somewhat, but I would greatly appreciate help in analyzing my sitemap and how to collect all the data I want. I apologize for the trouble, and I wish you a good day in advance!
Url: http://example.com
Sitemap:
{"_id":"ListCharacterGenshin","startUrl":["https://genshin-impact.fandom.com/wiki/Character/List"],"selectors":[{"id":"PageCharacterLink","parentSelectors":["_root"],"type":"SelectorLink","selector":".table-wide-inner td:nth-of-type(2) a, .mw-parser-output > table:nth-of-type(1) td:nth-of-type(2) a","multiple":true,"linkType":"linkFromHref"},{"id":"Eleements","parentSelectors":["_root"],"type":"SelectorImage","selector":".table-wide-inner a img.hoverZoomLink[data-relevant='0']","multiple":true},{"id":"Anniv","parentSelectors":["_root"],"type":"SelectorText","selector":".sortable td:nth-of-type(8)","multiple":true,"regex":""},{"id":"DripMarketingLink","parentSelectors":["PageCharacterLink"],"type":"SelectorLink","selector":".wds-is-current a.image","multiple":false,"linkType":"linkFromHref"},{"id":"LivresIconsLinks","parentSelectors":["PageCharacterLink"],"type":"SelectorLink","selector":"td:nth-of-type(n+5) .card-image a","multiple":true,"linkType":"linkFromHref"},{"id":"TalentsIconsLink","parentSelectors":["PageCharacterLink"],"type":"SelectorLink","selector":".talent-table td:nth-of-type(1) > a:nth-of-type(1)","multiple":true,"linkType":"linkFromHref"},{"id":"ConstellationiconsLinks","parentSelectors":["PageCharacterLink"],"type":"SelectorLink","selector":".constellation-table td:nth-of-type(1) > a","multiple":true,"linkType":"linkFromHref"},{"id":"MaterialsLink","parentSelectors":["PageCharacterLink"],"type":"SelectorLink","selector":"tr.ascension:nth-of-type(n+7) a","multiple":true,"linkType":"linkFromHref"},{"id":"Gallery","parentSelectors":["PageCharacterLink"],"type":"SelectorLink","selector":"#mw-content-text > div > div.custom-tabs-default.custom-tabs > span:nth-child(6) > a","multiple":false,"linkType":"linkFromHref"},{"id":"TalentsGifslink","parentSelectors":["Gallery"],"type":"SelectorLink","selector":"a.lightbox","multiple":true,"linkType":"linkFromHref"},{"id":"NomsPersonnages","parentSelectors":["_root"],"type":"SelectorText","selector":".table-wide-inner td:nth-of-type(2) a, .mw-parser-output > table:nth-of-type(1) td:nth-of-type(2) a","multiple":true,"regex":""},{"id":"Rareté","parentSelectors":["_root"],"type":"SelectorImage","selector":".table-wide-inner img.ls-is-cached[alt='5 Stars']","multiple":true},{"id":"GalleryTestImgOffical art","parentSelectors":["TalentsGifslink"],"type":"SelectorImage","selector":".media img","multiple":false},{"id":"TalentsGalerrySeeFulLSizeLinks","parentSelectors":["TalentsGifslink"],"type":"SelectorLink","selector":"a.see-full-size-link","multiple":true,"linkType":"linkFromHref"},{"id":"ImgGallery","parentSelectors":["TalentsGalerrySeeFulLSizeLinks"],"type":"SelectorImage","selector":"img","multiple":true},{"id":"fullsizedripmarketinglink","parentSelectors":["DripMarketingLink"],"type":"SelectorLink","selector":"a.see-full-size-link","multiple":false,"linkType":"linkFromHref"},{"id":"fullsizeimagedripmarkeitng","parentSelectors":["fullsizedripmarketinglink"],"type":"SelectorImage","selector":"img","multiple":false},{"id":"MaterialsPageLink","parentSelectors":["MaterialsLink"],"type":"SelectorLink","selector":"a.image","multiple":true,"linkType":"linkFromHref"},{"id":"MaterialsImgLink","parentSelectors":["MaterialsPageLink"],"type":"SelectorLink","selector":"a.see-full-size-link","multiple":false,"linkType":"linkFromHref"},{"id":"MaterialsImgFullSize","parentSelectors":["MaterialsImgLink"],"type":"SelectorImage","selector":"img","multiple":false},{"id":"TalentsIocnPageLinks","parentSelectors":["TalentsIconsLink"],"type":"SelectorLink","selector":"a.image-thumbnail","multiple":false,"linkType":"linkFromHref"},{"id":"SeeFullSizeLinkTalentsIconsImage","parentSelectors":["TalentsIocnPageLinks"],"type":"SelectorLink","selector":"a.see-full-size-link","multiple":false,"linkType":"linkFromHref"},{"id":"TalentsIconsImg","parentSelectors":["SeeFullSizeLinkTalentsIconsImage"],"type":"SelectorImage","selector":"img","multiple":false},{"id":"ConstellationPageLink","parentSelectors":["ConstellationiconsLinks"],"type":"SelectorLink","selector":"a.image","multiple":true,"linkType":"linkFromHref"},{"id":"SeeFullSizeLinkConstell","parentSelectors":["ConstellationPageLink"],"type":"SelectorLink","selector":"a.see-full-size-link","multiple":false,"linkType":"linkFromHref"},{"id":"ConstellIcon","parentSelectors":["SeeFullSizeLinkConstell"],"type":"SelectorImage","selector":"img","multiple":true},{"id":"PagesLivresLink","parentSelectors":["LivresIconsLinks"],"type":"SelectorLink","selector":"a.image","multiple":false,"linkType":"linkFromHref"},{"id":"SeeFullSizeLivresLinks","parentSelectors":["PagesLivresLink"],"type":"SelectorLink","selector":"a.see-full-size-link","multiple":false,"linkType":"linkFromHref"},{"id":"LivresIcons","parentSelectors":["SeeFullSizeLivresLinks"],"type":"SelectorImage","selector":"img","multiple":false},{"id":"TestDripImg","parentSelectors":["DripMarketingLink"],"type":"SelectorImage","selector":".media img","multiple":false},{"id":"TalentIconTestImg","parentSelectors":["TalentsIocnPageLinks"],"type":"SelectorImage","selector":".media img","multiple":false},{"id":"TestLivresIconsImg","parentSelectors":["PagesLivresLink"],"type":"SelectorImage","selector":".media img","multiple":false},{"id":"TestConstellIconsImg","parentSelectors":["ConstellationPageLink"],"type":"SelectorImage","selector":".media img","multiple":false},{"id":"TestMaterialsIconsImg","parentSelectors":["MaterialsPageLink"],"type":"SelectorImage","selector":".media img","multiple":false}]}