How to scrape page with multiple drop-down lists

Hi there, I am fairly new to https://webscraper.io/ and I am trying to scrape a website that has 2 drop- down menus, once you select the items in the 2 drop-down menus, a table pops up, each row has a link that takes you to a seperate table, I am trying to scrape the information in these tables for every item combination in the 2 drop-down menus. So for example: The 2 drop down menus are "Year" and "Security description starts with", I am trying to scrape the tables in the links from the original table that pops up after selecting each letter for each year. However, I cannot seem to get it to quite work.

Url: Request Rejected
Sitemap:

{id:"sitemap code"}
{"_id":"dividend_eleigibility","startUrl":["https://services.cds.ca/applications/taxforms/Eligible.nsf/All_en?OpenForm&_ga=2.24829818.1759967740.1614597020-1736766021.1611296722"],"selectors":[{"id":"dividend","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"td:nth-of-type(n+2)","multiple":true,"delay":2000,"clickElementSelector":"td:nth-of-type(n+2) select","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"table","type":"SelectorTable","parentSelectors":["dividend"],"selector":"table.sort-table","multiple":false,"columns":[{"header":"Tax Year","name":"Tax Year","extract":true},{"header":"Last Update (m/d/y)","name":"Last Update (m/d/y)","extract":true},{"header":"Security Description","name":"Security Description","extract":true},{"header":"Status","name":"Status","extract":true}],"delay":0,"tableDataRowSelector":"tbody tr","tableHeaderRowSelector":"thead tr"},{"id":"info","type":"SelectorTable","parentSelectors":["dividend"],"selector":"table.Label2","multiple":false,"columns":[{"header":"Period","name":"Period","extract":true},{"header":"Dividend Designation","name":"Dividend Designation","extract":true},{"header":"Record Date (m/d/y)","name":"Record Date (m/d/y)","extract":true},{"header":"Payment Date (m/d/y)","name":"Payment Date (m/d/y)","extract":true},{"header":"Amount Per Share","name":"Amount Per Share","extract":true}],"delay":0,"tableDataRowSelector":"tr:nth-of-type(n+2)","tableHeaderRowSelector":"tr:nth-of-type(1)"}]}

1 Like