Hi!
For some reason it just stops after second coach. There is a workaround, since every coach has a coach key kept on a compare button, you can collect all the keys and then create a sitemap to scrape particular profiles using scraped keys.
Here's a sitemap that will paginate through all pages and pick coach keys and names accordingly:
{"_id":"coach_fed","startUrl":["https://apps.coachfederation.org/eweb/CCFDynamicPage.aspx?webcode=ccfsearch"],"selectors":[{"id":"test","type":"SelectorElementClick","selector":"div.ui.content div div.ui > div.content","parentSelectors":["_root"],"multiple":true,"delay":"4000","clickElementSelector":"a.icon.borderless","clickType":"clickMore","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"},{"id":"coach_key","type":"SelectorElementAttribute","selector":"div.ui.custom.right.floated.checkbox > input","parentSelectors":["test"],"multiple":false,"extractAttribute":"value","delay":0},{"id":"name","type":"SelectorText","selector":"div.header","parentSelectors":["test"],"multiple":false,"regex":"","delay":0}]}
Then you will have to create a different sitemap using collected keys and below URL as a prefix for them.
https://apps.coachfederation.org/eweb/CCFDynamicPage.aspx?webcode=ccfcoachprofileview&coachcstkey=
I strongly recommend you to narrow the results to maybe a particular state or any other specific criteria you would like to sort coaches by.
I can help you with the macro to create URL list for WebScraper, I believe you don't want to add thousand+ of URLs just by [ + ] button in Metadata.
P.S. if you want to stop scraping manually, you have to call Developer tools within Scrape window, and delete 'next page' button (shown as a right arrow on a page), that will result in successfull scraping finish and results will be properly shown.
