Grab TEXT then click Link and get New Page Data

How to?
#1

I am trying to scrape a webpage and so far have gotten really good results,

I have everything i need other than 1 pesky thing, The Genre or TAG (which is displayed when hovering the main image before link click)

I cannot grab the genre then click the link then scrape the clicked page and have the results all in 1 row of data, I have tried all methods i know and so far it has failed me. I will provide the SiteMap i have so far, if you run it , you will see that the genre is being caught however it is separated on separate rows, rather than being at the side of the Link.

Can anybody help me fuigure this 1 out, as i would really appreciate it. Thank you.

Url: Sound Libraries and Audio Samples which sorted by genre free download

Sitemap:

{"_id":"als","startUrl":["https://audiolove.me/audio-samples/page/[700-1444]/"],"selectors":[{"id":"linker","multiple":true,"parentSelectors":["_root"],"selector":"h2 a","type":"SelectorLink"},{"id":"title","multiple":false,"parentSelectors":["linker"],"regex":"","selector":"h1","type":"SelectorText"},{"id":"image","multiple":false,"parentSelectors":["linker"],"regex":"https://audiolove.me/uploads/[^ ]+","selector":"div.textfull","type":"SelectorHTML"},{"id":"file info","multiple":false,"parentSelectors":["linker"],"regex":"","selector":"div.subtitle","type":"SelectorText"},{"id":"info","multiple":false,"parentSelectors":["linker"],"regex":"","selector":"div.articletxt","type":"SelectorText"},{"id":"catagory","multiple":false,"parentSelectors":["linker"],"regex":"","selector":"div.category","type":"SelectorText"},{"id":"dateadded","multiple":false,"parentSelectors":["linker"],"regex":"","selector":"time","type":"SelectorText"},{"id":"video","multiple":false,"parentSelectors":["linker"],"regex":"YouTube[^ ]+","selector":"div.articletxt","type":"SelectorHTML"},{"id":"soundcloud","multiple":false,"parentSelectors":["linker"],"regex":"https://w.soundcloud.com/player/[^ ]+","selector":".soundcloudclass","type":"SelectorHTML"},{"id":"mp3","multiple":false,"parentSelectors":["linker"],"regex":"https://cdn-prd.sounds.com[^ ]+","selector":".dleaudioplayer","type":"SelectorHTML"},{"id":"home","multiple":false,"parentSelectors":["linker"],"selector":"span.hidden-linkHP","type":"SelectorPopupLink"},{"id":"genre","multiple":true,"parentSelectors":["_root"],"regex":"","selector":"span[itemprop='genre']","type":"SelectorText"}]}

The Results from this scrape are as follows...

image
image1920×1040 54.2 KB

However i want for the Genre to be along side the Link. so that it is all in 1 result after the scrape

I have managed to do what i want but it is not collecting Each Genre, instead it is simply providing just 1 genre

image
image1920×1040 70.8 KB

I would like for the data to be output as follows

Genre -> Click the link -> All the page details of the link
Genre -> Click the link -> All the page details of the link
Genre -> Click the link -> All the page details of the link
Genre -> Click the link -> All the page details of the link
Genre -> Click the link -> All the page details of the link
Genre -> Click the link -> All the page details of the link

and so on..

Thank you.

#2

Nobody Upto the Challenge then?

And there's me thinking this place would be full of Knowledgeable people.

#3

@mysterdee888 Hi, it seems that most of the data appear in a scattered manner(most of the unique records for each selector appear in a separate row).

The issue lies in the sitemap selector setup itself, therefore, you should update your sitemap by using an 'Element' selector set as a 'parent' with the 'multiple' option checked and all of the remaining selectors set as it's 'child' with 'multiple' option not checked.

Learn more: Web Scraper << How to >> Scrape multiple items within a listings page
​
Example:

{"_id":"als","startUrl":["https://audiolove.me/audio-samples/page/700"],"selectors":[{"id":"linker","multiple":false,"parentSelectors":["wrapper"],"selector":"h2 a","type":"SelectorLink"},{"id":"title","multiple":false,"parentSelectors":["linker"],"regex":"","selector":"h1","type":"SelectorText"},{"id":"image","multiple":false,"parentSelectors":["linker"],"regex":"https://audiolove.me/uploads/[^ ]+","selector":"div.textfull","type":"SelectorHTML"},{"id":"file info","multiple":false,"parentSelectors":["linker"],"regex":"","selector":"div.subtitle","type":"SelectorText"},{"id":"info","multiple":false,"parentSelectors":["linker"],"regex":"","selector":"div.articletxt","type":"SelectorText"},{"id":"catagory","multiple":false,"parentSelectors":["linker"],"regex":"","selector":"div.category","type":"SelectorText"},{"id":"dateadded","multiple":false,"parentSelectors":["linker"],"regex":"","selector":"time","type":"SelectorText"},{"id":"video","multiple":false,"parentSelectors":["linker"],"regex":"YouTube[^ ]+","selector":"div.articletxt","type":"SelectorHTML"},{"id":"soundcloud","multiple":false,"parentSelectors":["linker"],"regex":"https://w.soundcloud.com/player/[^ ]+","selector":".soundcloudclass","type":"SelectorHTML"},{"id":"mp3","multiple":false,"parentSelectors":["linker"],"regex":"https://cdn-prd.sounds.com[^ ]+","selector":".dleaudioplayer","type":"SelectorHTML"},{"id":"home","multiple":false,"parentSelectors":["linker"],"selector":"span.hidden-linkHP","type":"SelectorPopupLink"},{"id":"genre","multiple":false,"parentSelectors":["wrapper"],"regex":"","selector":"span[itemprop='genre']","type":"SelectorText"},{"id":"wrapper","multiple":true,"parentSelectors":["_root"],"selector":"article","type":"SelectorElement"}]}

#4

Thank you for your help, glad some1 had a look for me. pretty important project i have running.

Works amazingly. still i need to get my head around it and re-create it for myself, Thank you very appreciative.