Use URLs as selectors

How to?
#1

Hi!
I would like to scrap datas from several pages from the NBA website, they are all on different addresses but same domain.

  • I cannot use multiple starting URL (from metadatas) as the content is different on each page : I need to have separate selectors (tables) for each URL.
  • They are not reachable through links on the starting page : they are all under complicated dropdown menus (different types of dropdowns, I've tried almost everything on that end).

Some of the pages :
https://www.nba.com/stats/teams/traditional
https://www.nba.com/stats/teams/advanced
https://www.nba.com/stats/teams/opponent

Sitemap:
I ain't got a sitemap to show for the moment, since all my tries have failed

Thanks in advance if you can help me ! Happy holidays :slight_smile:

#2

So far I've managed by putting these URLs on a website page and scrapping from that, but is there a way to avoid that middle step ?

#3

Hi, if you require to scrape different data points from each link, then it makes sense to create a separate sitemap for each. Otherwise, what is the reason to do it all in one sitemap?