Describe the problem.
I am trying to scrape the course provider and its classes. Starting first with grabbing the course provider name. After that I would like to click the drop down that displays courses provided and grab those as well. The courses provided should be linked with the course provider.
First Problem: Grabbing the course provider is not difficult, but you end up grabbing extra information such as the license numbers when you shift+click to grab the providers that were not selected initially. Could not figure out how to avoid grabbing those.
Second Problem: Element click selector will click after it has selected, so then I won't be able to grab the classes as the classes are loaded after the click.
To fix these problems, I have the element click selector grabbing the course provider and then clicking the drop down to display the classes. Then a selector that will grab all the classes. The problem is that again I am grabbing some of the license numbers when selecting providers and now I have a list of classes after my list of providers, but no association. I am also not able to make the course list a child of the click id. Any guidance would be helpful. Thanks in advance.
Url: https://www.trec.texas.gov/education/approved-qualifying-real-estate-courses
Sitemap:
{"_id":"recourses","startUrl":["https://www.trec.texas.gov/education/approved-qualifying-real-estate-courses"],"selectors":[{"id":"click","type":"SelectorElementClick","parentSelectors":["_root"],"selector":".provider-name a span, div:nth-of-type(n+7) .provider-name > span:nth-of-type(1)","multiple":true,"delay":2000,"clickElementSelector":"button.btn-link","clickType":"clickOnce","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueHTMLText"},{"id":"classes","type":"SelectorText","parentSelectors":["_root"],"selector":".in .col-xs-10 span","multiple":true,"regex":"","delay":0}]}