I want to know how to scrape sites which have the following properties:
- Pages have a "Next Page" for pagination (loads a completely new page)
- Each page has a table of XX number of rows, where each row is a link to a new "profile" page
- Each row link is not an href, but rather an "onclick" element
- Each row link opens a new separate profile page, where I would like to scrape contents from.
The best example I can find is this:
https://www.mywsba.org/PersonifyEbusiness/LegalDirectory.aspx?ShowSearchResults=TRUE&LicenseType=Lawyer&EligibleToPractice=Y&Status=Active