Help with sourcing website info from a list

How to?
#1

Describe the problem.

Hi, there is a list of 2000 crypto currency information. Once you click on a link within the list, it will direct you to more information. Within this new page there is a link that will direct you to its specific website. I want to source all of these websites but am having trouble doing so.

(For example: Click on bitcoin from the list- it opens up a new page with more information - you see a "website" link on the page that will direct you to the bitcoin website) I need gathering all these website links from the list.

Url: https://coinmarketcap.com/all/views/all/

Sitemap:
{"_id":"crypto","startUrl":["https://coinmarketcap.com/all/views/all/"],"selectors":[{"id":"crypto list","type":"SelectorLink","parentSelectors":["_root"],"selector":"a.currency-name-container","multiple":true,"delay":0},{"id":"Website","type":"SelectorLink","parentSelectors":["_root","crypto list"],"selector":"div.details-panel li:nth-of-type(2) a","multiple":false,"delay":0}]}

#2

Save your $5.00 and invest in bitcoin.

You need to set your page load delay super high, 13000-15000, which will make this painfully slow but it works

{"_id":"crypto","startUrl":["https://coinmarketcap.com/all/views/all/"],"selectors":[{"id":"crypto list","type":"SelectorLink","parentSelectors":["_root"],"selector":"a.currency-name-container","multiple":true,"delay":""},{"id":"Website","type":"SelectorLink","parentSelectors":["crypto list"],"selector":"div.details-panel li:contains("Website") a","multiple":false,"delay":0}]}

#3

it says invalid JSON when trying to import your sitemap, any tips?

#4
#5

I think you were mistaken. I was looking for the website links that you are to click on once you are in the list of links you sent.

#6

for example: your link https://coinmarketcap.com/currencies/bgogo-token/

if you go to that link you can see that it says "website" in the left. once you click "website," it will redirect you to its specific website. not the coinmarketcap website - https://bgogo.com/

#7

Yep. Now look at the CSV

1 Like
#8

wow you are the man! thank you