Hi there,
I am having trouble scraping tables from a website. I want to scrape a table from each year (chosen from a drop down link), but when I use the sitemap attached below, none of the tables are scraped.
Is there any problem with the sitemap? I have added the delays as the table does not show up immediately.
When trying to scrape the table from an INDIVIDUAL page [i.e. without setting the "year" as the parent of the "table"], I am able to scrape the individual table.
Url: https://www.premierleague.com/stats/top/clubs/att_obox_goal?se=210
Sitemap:
{"_id":"single-export","startUrl":["https://www.premierleague.com/stats/top/clubs/att_obox_goal?se=210"],"selectors":[{"id":"table","type":"SelectorTable","parentSelectors":["Year"],"selector":"table","multiple":true,"columns":[{"header":"Rank","name":"Rank","extract":true},{"header":"Club","name":"Club","extract":true},{"header":"Stat","name":"Stat","extract":true}],"delay":"3000","tableDataRowSelector":"tbody.statsTableContainer tr","tableHeaderRowSelector":"thead tr"},{"id":"Year","type":"SelectorPopupLink","parentSelectors":["_root"],"selector":"section.pageFilter li","multiple":true,"delay":"4000"}]}