Hi, I could sure use some help with Wep Scraper. I am new to scraping, and I am trying to scrape team defense vs opponent averages for NBA, but I cannot seem to get this to scrape properly from this site which is dynamic and the tables paginate via tabs. The first table, PG, does not get scraped. It utilizes jQuery 2.0 table sorter with sticky headers (table.tablesorter.hasStickyHeaders). So, I can only scrape the SG, SF, PF, and C position. The PG table is stuck as the primary first link with the DVP, DraftKings, and Season auto page start. I have tried several site maps, but to no avail. The last sitemap was my least effective, and I abandoned ship at that point.
Any help would be appreciated!
URL: https://www.rotowire.com/daily/nba/defense-vspos.php?site=DraftKings&sport=NBA
-Nathan Marek
Sitemap:
{"_id":"rotowire_dvp","startUrl":["https://www.rotowire.com/daily/nba/defense-vspos.php?site=FanDuel&sport=NBA"],"selectors":[{"id":"DK_DailyGameSite","type":"SelectorLink","selector":"div.sites-nav div.span43 p:nth-of-type(3) a","parentSelectors":["_root"],"multiple":false,"delay":"2000"},{"id":"PG_selector","type":"SelectorLink","selector":"div.offset1.span47 div.span43 p:nth-of-type(2) a","parentSelectors":["DK_DailyGameSite"],"multiple":false,"delay":"2000"},{"id":"PG_DVP Averages","type":"SelectorTable","selector":"table.tablesorter.hasStickyHeaders","parentSelectors":["PG_selector"],"multiple":false,"columns":[{"header":"Avg DraftKings Pts Against","name":"Avg DraftKings Pts Against","extract":true},{"header":"Averages Stats Allowed – Season","name":"Averages Stats Allowed – Season","extract":true}],"delay":"2000","tableDataRowSelector":"","tableHeaderRowSelector":"tr.tablesorter-headerRow:nth-of-type(2)"}]}