Site changes start page parameter

How to?
#1

Hi,

Can anyone think of a way to scrape all fiats for this site?
https:// www.coinex. com/en/p2p?fiat=usd

It should be rather easy: just create a list of fiats, and use that list to generate the list of start pages.

The problem is that once a start page is visited, the site reads your IP, and always changes the fiat to that of the local currency it reads from your IP. Once you're past that step though, you can use the dropdownbox and change the desired fiat.

I've looked into denying access to my location or changing my http headers, but that made no change.
I've even tried setting up a very long sitemap to tell webscraper to click on the dropdownbox and then click on the fiats one by one, but that can't work for all: the fiat list gets generated only when you scroll down inside the dropdownbox. When I try webscraper's scroll feature, it scrolls the main page, and not inside the dropdownbox.

So I guess I'm stuck. I can't find any way to iterate through all currencies.

Maybe somebody else can think of something?

Thank you!

#2

For this type of website, and for your use case, it is probably best to use their API instead:

#3

Hi leemeng, thank you for your reply.

I was just looking into that. But it seems to me that they only have 4 modules they offer API data on: Account, Assets, Spot, Futures. So no P2P information, which is what I was looking for.

So I'm still stuck? Is there nothing anyone can think of?
Some way to force the site to use the URL parameter would mean all the help, but I don't know whether that's possible.

Thanks again