Webscraper looks really great but i am having a problem scraping this kind of page:
https://developers.google.com/speed/pagespeed/insights/?url=https%3A%2F%2Fwww.proximus.be%2Fen%2Fid_cr_samsung-galaxy-s10-128gb-prism-black%2Fpersonal%2Fproducts%2Fequipment%2Fshop%2Fsamsung-galaxy-s10-128gb-prism-black.html&tab=mobile
Basically i will submit several pages to google page speed test and i will get an output (like the one above) that i want to scrape to get all the time data. Of course the output URL will be different based on the webpage that i will submit to the test.
My first question is: which start url should i use?
The selectors i built retrieve the right data but how can i make it in such a way that it scrapes the different output results instead of the one i set as start url?
Is there anyway to submit a list of url that can be scraped for the same selectors?
Thanks in advance for the help