Scrape data that a Dropdown Box displays

How to?
#1

Describe the problem.
I'm trying setup a scraper that selects "5 years" from the dropdown box in the link, then scrapes the data in table below. I tried replicating a similar sitemap that was described in this thread, but it didn't work:

Url: https://www.nasdaq.com/symbol/hio/historical

Sitemap:
{"_id":"test2","startUrl":["https://www.nasdaq.com/symbol/hio/historical"],"selectors":[{"id":"test1","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div#left-column-div","multiple":true,"delay":"5000","clickElementSelector":"div.floatL.marginT10px select","clickType":"clickOnce","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"},{"id":"test5","type":"SelectorElement","parentSelectors":["test1"],"selector":"parent","multiple":true,"delay":0}]}

#2

You can do this using a table selector but if you scroll down it provides all the data in a CSV already. Why not use that?

For your initial element click selector, use #ddlTimeFrame > option:nth-child(10)

#3

Ok, so I've managed to get the dropdown box selected for 5 years with the code you sent, but I still can't get it to scrape the data in the table (once the table has been updated to show 5 years). Right now it still just scrapes the data for 3 months. Here is my sitemap (updated):

{"_id":"forum","startUrl":["https://www.nasdaq.com/symbol/hio/historical"],"selectors":[{"id":"wrapper","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div#left-column-div","multiple":true,"delay":"10000","clickElementSelector":"#ddlTimeFrame > option:nth-child(10)","clickType":"clickOnce","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"},{"id":"table","type":"SelectorElement","parentSelectors":["wrapper"],"selector":"tr:nth-of-type(n+2)","multiple":true,"delay":"10000"},{"id":"date","type":"SelectorText","parentSelectors":["table"],"selector":"td:nth-of-type(1)","multiple":false,"regex":"","delay":0},{"id":"close","type":"SelectorText","parentSelectors":["table"],"selector":"td:nth-of-type(5)","multiple":false,"regex":"","delay":0}]}

To reply to your other question, I'm not using the CSV download option because I'm looking to do this for many different stocks -- I just kept the sitemap limited to one to keep the question easiest -- and I'm only look for specific data (Date and Close / Last).

#4

Never mind, got it working. Thanks for the help! Here's the sitemap code that worked for anyone wondering.

{"_id":"stockquotes","startUrl":["https://www.nasdaq.com/symbol/hio/historical"],"selectors":[{"id":"wrapper","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div#left-column-div","multiple":true,"delay":"15000","clickElementSelector":"#ddlTimeFrame > option:nth-child(10)","clickType":"clickOnce","discardInitialElements":false,"clickElementUniquenessType":"uniqueText"},{"id":"elementtable","type":"SelectorElement","parentSelectors":["_root"],"selector":"tr:nth-of-type(n+2)","multiple":true,"delay":"15000"},{"id":"date","type":"SelectorText","parentSelectors":["elementtable"],"selector":"td:nth-of-type(1)","multiple":false,"regex":"","delay":0},{"id":"close","type":"SelectorText","parentSelectors":["elementtable"],"selector":"td:nth-of-type(5)","multiple":false,"regex":"","delay":0},{"id":"volume","type":"SelectorText","parentSelectors":["elementtable"],"selector":"td:nth-of-type(6)","multiple":false,"regex":"","delay":0}]}