I am trying to build a history of the stock picks from guests on a business news site. (I'm curious if any of them provide better-than-chance advice...)
The show's landing page is a static URL [Market Call - Shows - BNN Bloomberg], (Market Call - Shows - BNN Bloomberg) and so all of the navigation is dynamic HTML, vs page-by-page.
One thing that has me stumped is that a calendar 'drawer' slides open to reveal a month's show dates (which are distinctively styled, thankfully); each clickable date brings up that episode's date/guest/picks and 'closes' the calendar...I eventually realized the date links are available even if hidden.
(The banner above the calendar is of no use, here; it slides back and forth only over a week.)
I've had success getting a month scraped with the Pagination - 'Click once on multiple buttons' selector. Where I'm running aground is advancing the month (backwards) after looping through the days.
What isn't clear to me--and the interface and documentation aren't especially helpful on this--is how loops work. E.g., 'pagination selectors need to be their own parents' is enforced by the interface, but not indicated in the graph. (I'm always reluctant to moan about software that is flexible and useful and free...)
{"_id":"bnn_mktcall_0_2","startUrl":["404 div.date.ng-scope","type":"SelectorText"},{"id":"get_guest","multiple":false,"parentSelectors":["cal_dates"],"regex":".(?=[^\w]s)","selector":"li:nth-of-type(1) article:contains(Top Picks) h3.ng-binding","type":"SelectorText"},{"id":"get_top_picks","multiple":false,"parentSelectors":["cal_dates"],"regex":"(?<=:\s).","selector":"li:nth-of-type(1) p","type":"SelectorText"},{"id":"cal_dates","paginationType":"clickOnce","parentSelectors":["_root","cal_dates"],"selector":"a.ui-state-default","type":"SelectorPagination"},{"clickActionType":"real","clickElementSelector":"a.ui-datepicker-prev","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":2000,"discardInitialElements":"do-not-discard","id":"prev_month","multiple":true,"parentSelectors":["_root"],"selector":"a.ui-datepicker-prev","type":"SelectorElementClick"}]}
Thanks in advance!
