Hi,
I'm trying to scrap data from this website :
I need information from every store so if I were doing it manually, I would click "View Detail" for each one of them and then collect data.
Problem is : they only show 5 stores on this URL. To display more, you need to click "View more" button.
To do the scraping, I use a click selector (unique CSS) to display all stores, but here is what happens :
. first the scraper clicks on "view more" until all stores are displayed : works fine
. then it clicks on "view detail" for the first store, and collects the data : works fine
. then it comes back to the store list but only 5 stores are visible now (the ones loaded before have disappeared) : HERE IS THE ISSUE
. the scraper collects data for the 5 displayed stores, and stops after 5 only.
How to solve this ?
Everytime the scraper comes back to the main store list, all hidden stores have disappeared, except the 5 first ones.
Thanks for your help