Hello everybody,
I was hoping somebody could help me with a specific style of pagination. I am having a hard time figuring it out.
I am trying to collect delivery company social media accounts in California by using WS to search each city tab, to search every company tab, to go in the details and extract the social media accounts.
The pagination style in the city/area page is a drop-down from 1-13 and when I try to select any of the page tabs, it won't select. I tried using link selector, element and played around with a couple of other options. Nothing seemed to work.
Also, I do understand that I can start the root here and just insert [1-13] in my starting URL but I have to scrape all cities/regions in California and it would be a long long process.
If I could learn how to direct WS to go into each city in Cali and every company in each city/region, and then their details to pull the social media accounts, it would be a huge help and I would greatly appreciate it.
My desired starting URL
https://weedmaps.com/deliveries/in/united-states/california
Where I get stuck
https://weedmaps.com/deliveries/in/united-states/california/san-gabriel-valley