Not reading JS Button

Bug Reports
#1

Hi,
I'm trying to use the Link Selector for scrapping Annual and Quarterly data on the Income Statement for Apple on Yahoo Finance
https://finance.yahoo.com/quote/AAPL/financials?p=AAPL&.tsrc=fin-srch

something is not working as it should, when I select the Quarterly link (button.P(0px) span) and click on data preview the _href and _follow fields are empty.

It seems that the Link selector does not read the JS button... "Annual" and "Quarterly", I believe it is a bug!

PS. Only the Annual data gets loaded because that is the default options when the page is loaded. However, it does not switch to Quarterly.

image
image.png1825×523 36.9 KB

Thanks, Mark

#2

Please the sitemap, to view it. Thanks

#3

Here you go
{"_id":"apple","startUrl":["https://finance.yahoo.com/quote/AAPL/financials?p=AAPL&.tsrc=fin-srch"],"selectors":[{"id":"finance","type":"SelectorLink","parentSelectors":["_root"],"selector":"li.IbBox:nth-of-type(7) a.Lh\(50px\)","multiple":false,"delay":"2000"},{"id":"select quarterly","type":"SelectorLink","parentSelectors":["finance"],"selector":"button.P\(0px\) span","multiple":false,"delay":"2000"},{"id":"income_statement_quarterly","type":"SelectorTable","parentSelectors":["select quarterly"],"selector":"table.Lh\(1\.7\)","multiple":true,"columns":[{"header":"Revenue","name":"Revenue","extract":true},{"header":"9/30/2018","name":"9/30/2018","extract":true},{"header":"6/30/2018","name":"6/30/2018","extract":true},{"header":"3/31/2018","name":"3/31/2018","extract":true},{"header":"12/31/2017","name":"12/31/2017","extract":true}],"delay":"10000","tableDataRowSelector":"tr.H\(36px\):nth-of-type(n+2)","tableHeaderRowSelector":"tr.Bdbw\(1px\):nth-of-type(1)"}]}
thanks!

#4

:confused: invalid JSON

#5

Interesting though is that when I select 'Element Preview' the Quarterly Button is highlighted however nothing appear in 'Data Preview' :frowning_man:

#6

I read one of the posts in the forum Selector doesn't actually select and I tried to replicate the same solution. I've copied the selector and pasted into the path but I was able to extract only the first column of Quarterly data.

{"_id":"yahoo_test1","startUrl":["https://finance.yahoo.com/quote/AAPL/financials?p=AAPL&.tsrc=fin-srch"],"selectors":[{"id":"finance","type":"SelectorLink","parentSelectors":["_root"],"selector":"li.IbBox:nth-of-type(7) a.Lh\(50px\)","multiple":false,"delay":"2000"},{"id":"button_test","type":"SelectorLink","parentSelectors":["finance"],"selector":"#Col1-1-Financials-Proxy > section > div.Mt\28 18px\29.Mb\28 14px\29 > div.Fl\28 end\29.smartphone_Mt\28 4px\29 > button > div > span","multiple":false,"delay":"2000"},{"id":"quarterly_data","type":"SelectorTable","parentSelectors":["button_test"],"selector":"table.Lh\(1\.7\)","multiple":true,"columns":[{"header":"Revenue","name":"Revenue","extract":true},{"header":"9/29/2018","name":"9/29/2018","extract":true},{"header":"6/30/2018","name":"6/30/2018","extract":true},{"header":"3/31/2018","name":"3/31/2018","extract":true},{"header":"12/30/2017","name":"12/30/2017","extract":true}],"delay":"2000","tableDataRowSelector":"tr.H\(36px\):nth-of-type(n+2)","tableHeaderRowSelector":"tr.Bdbw\(1px\):nth-of-type(1)"}]}

#7

image
image.png579×567 6.02 KB

#8

image
image.png1351×223 17.5 KB

i dont know.... :frowning_face:

#9

please, try out this one:
{"_id":"yahoo_finance5","startUrl":["https://finance.yahoo.com/quote/AAPL/financials?p=AAPL&.tsrc=fin-srch"],"selectors":[{"id":"table_data","type":"SelectorTable","parentSelectors":["quarterly_button"],"selector":"table.Lh\(1\.7\)","multiple":true,"columns":[{"header":"Revenue","name":"Revenue","extract":true},{"header":"9/29/2018","name":"9/29/2018","extract":true},{"header":"6/30/2018","name":"6/30/2018","extract":true},{"header":"3/31/2018","name":"3/31/2018","extract":true},{"header":"12/30/2017","name":"12/30/2017","extract":true}],"delay":"4000","tableDataRowSelector":"tr.H\(36px\):nth-of-type(n+2)","tableHeaderRowSelector":"tr.Bdbw\(1px\):nth-of-type(1)"},{"id":"quarterly_button","type":"SelectorPopupLink","parentSelectors":["_root"],"selector":"button.P\(0px\)","multiple":false,"delay":"4000"}]}