Describe the problem.
I'm trying to scrape the following website (https://priceposting.abc.ca.gov/publicPricePosts). I would first like to change the "rows per page" to 100, then cycle through the pages (or at least a subset). I've watched the 1.5minute video on dropdown menus but was not able to get it to work. In python, it will work using
driver.find_elements(By.CLASS_NAME,'MuiSelect-root')[1].click()
driver.find_elements(By.CLASS_NAME,'MuiTablePagination-menuItem')[3].click()
Follow up question: What should be the "family tree" for this?
Parent: Click rows per page
Child: Pagination
Grandchild: Table
???
Thanks so much for your help -- this has been a frustrating project.
Url: https://priceposting.abc.ca.gov/publicPricePosts
Sitemap:
ct":true,"he{"_id":"cabeer","startUrl":["https://priceposting.abc.ca.gov/publicPricePosts"],"selectors":[{"clickElementSelector":"div.MuiTablePagination-menuItem[3]","clickElementUniquenessType":"uniqueHTML","clickType":"clickOnce","delay":2000,"discardInitialElements":"do-not-discard","id":"rows","multiple":false,"parentSelectors":["_root"],"selector":"select","type":"SelectorElementClick"},{"columns":[{"extract":true,"header":"Manufacturer","name":"Manufacturer"},{"extract":true,"header":"Trade Name","name":"Trade Name"},{"extract":true,"header":"Product Name","name":"Product Name"},{"extract":true,"header":"Package Configuration","name":"Package Configuration"},{"extract":true,"header":"Size","name":"Size"},{"extract":true,"header":"County","name":"County"},{"extract":true,"header":"Prices To","name":"Prices To"},{"extract":true,"header":"Receiving Method","name":"Receiving Method"},{"extract":true,"header":"Price($)","name":"Price"},{"extract":true,"header":"Container Charge($)","name":"Container Charge"},{"extract":true,"header":"Posted By","name":"Posted By"},{"extraader":"Effective Date","name":"Effective Date"},{"extract":true,"header":"Status","name":"Status"}],"delay":0,"id":"data","multiple":true,"parentSelectors":["rows"],"selector":"table","tableDataRowSelector":"tr.sc-fzppip","tableHeaderRowSelector":"tr.MuiTableRow-head","type":"SelectorTable"}]}