Hello I wanted to select only one option from the dropdown option.
So the website is https://sansad.in/ls/members. I wanted to collect all the data related to current members of Loksabha. I am facinng issues using the pagination, as it stops after extracting 180 data, but there are a total of 540 current members.
Then I tried using the Element Click selector, which doesnot work either because of a very unique issue. The issue is the the page numbers do not appear. That is the pages are shown as
1 2 3 4 .... 53 54
the page number 5 does not appear when I reach page 4. Hence it jumps to page 53 immediately.
Then I tried using the next button instead. But the issue here is that the button does not get clicked and no new elements are seen. I can click it manually but after trying to do the clicking with webscraper technique, it just stays ideal and shows that scraping is done. So I get only 10 sets of data.
Now the other option that I am thinking of doing is by using the dropdown option. So the idea is to click the dropdown button and select 100 data at a time. Doing this the pagination becomes 1 2 3 4 5 6.
So I will be able to navigate through all the pages and extract the required data.
Here the issue is that I am not being able to select the dropdown option. There are turials to iterate through the data but cannot select only one option.
Can someone tell me how to achieve this?