Site does not update after click in dropdown

How to?
#1

The page does not update when I use the click selector on the dropdown menu. The text that is selected in the dropdown menu changes but not the table. In inspection I can see that it becomes selected, but it is the "aria-selected"=true/false that controls the table. How do I make it work?

Thanks for the help and sorry for the swedish site.

Url: Allsvenskan Fantasy

Sitemap:
{"_id":"valj","startUrl":["https://fantasy.allsvenskan.se/statistics"],"selectors":[{"id":"position","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"body","multiple":false,"delay":2000,"clickElementSelector":"div.FieldRenderers__SelectWrap-sc-749fm-4.bOhjpi option:contains(\"Målvakter\")","clickType":"clickOnce","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueCSSSelector"},{"id":"nr1","type":"SelectorText","parentSelectors":["position"],"selector":"tr:nth-of-type(1) div.Statistics__Name-sc-1iyfcjc-8","multiple":false,"regex":"","delay":0}]}

#2

@mrjoel Hi. Your sitemap did not work but i hope that i managed to figure out what you are trying to get.

My example:

{"_id":"allsvenskan","startUrl":["https://fantasy.allsvenskan.se/statistics"],"selectors":[{"id":"click-1","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"body","multiple":true,"delay":"900","clickElementSelector":"select#filter option:contains(\"Försvarar\")","clickType":"clickOnce","discardInitialElements":"discard-when-click-element-exists","clickElementUniquenessType":"uniqueText"},{"id":"click-2","type":"SelectorElementClick","parentSelectors":["click-1"],"selector":"_parent_","multiple":true,"delay":"700","clickElementSelector":"select#sort option:contains(\"Pris\"):nth(0)","clickType":"clickOnce","discardInitialElements":"discard-when-click-element-exists","clickElementUniquenessType":"uniqueText"},{"id":"player","type":"SelectorText","parentSelectors":["click-2"],"selector":"div.Statistics__Name-sc-1iyfcjc-8","multiple":true,"regex":"","delay":0}]}

#3

Hi

Thank you!
That is close enough to what I am trying to get but you are running into the same problem as I am, namely that the left dropdown menu does not apply it's filter when using the click selector. If you change "Försvarar" to "AIK" in your sitemap and run it you will see that it grabs the non-AIK players too.

#4

@mrjoel It seems like an issue with the website itself or maybe there is some anti scraping mechanism behind this.

#5

Alright, tyvm, I will have to sort it in excel then. My next problem is collect the data I need from each page. Sadly the stats I need are not in the main table, instead I need to click on each player name and on the "historia" tab and extract that table for each player. I cant figure out a way to get the next-page click to start after all the players on the page has been extracted and then start the process over for the new page. Any suggestions?

sitemap:
{"_id":"statistik","startUrl":["https://fantasy.allsvenskan.se/statistics"],"selectors":[{"id":"spelare","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"body","multiple":true,"delay":"1000","clickElementSelector":"div.Statistics__Name-sc-1iyfcjc-8","clickType":"clickOnce","discardInitialElements":"discard-when-click-element-exists","clickElementUniquenessType":"uniqueCSSSelector"},{"id":"historia","type":"SelectorElementClick","parentSelectors":["spelare"],"selector":"div.Dialog__Overlay-sc-1y0w57i-4","multiple":false,"delay":"500","clickElementSelector":"li:nth-of-type(2) a.Tab__Link-sc-1xkij2k-1","clickType":"clickOnce","discardInitialElements":"discard-when-click-element-exists","clickElementUniquenessType":"uniqueCSSSelector"},{"id":"stats","type":"SelectorTable","parentSelectors":["historia"],"selector":".ElementDialog__ScrollTable-sc-112m54e-6.ism-overflow-scroll table","multiple":true,"columns":[{"header":"Omg.","name":"Omg","extract":true},{"header":"MOT","name":"MOT","extract":false},{"header":"PNG","name":"PNG","extract":true},{"header":"SM","name":"SPM","extract":true},{"header":"GM","name":"GMx","extract":false},{"header":"A","name":"Axx","extract":false},{"header":"HN","name":"HNx","extract":false},{"header":"IM","name":"IMx","extract":false},{"header":"RS","name":"RSx","extract":false},{"header":"MS","name":"MSx","extract":false},{"header":"GK","name":"GKx","extract":false},{"header":"RK","name":"RKx","extract":false},{"header":"R","name":"Rxx","extract":false},{"header":"S","name":"Sxx","extract":false},{"header":"OB","name":"OBx","extract":false},{"header":"DB","name":"DBx","extract":false},{"header":"I","name":"Ixx","extract":false},{"header":"N","name":"Nxx","extract":false},{"header":"SKC","name":"SKC","extract":false},{"header":"RBOB","name":"RBOB","extract":false},{"header":"B","name":"Bxx","extract":false},{"header":"NO","name":"NOx","extract":false},{"header":"VA","name":"VAx","extract":false},{"header":"kr","name":"krx","extract":false}],"delay":0,"tableDataRowSelector":"tbody tr","tableHeaderRowSelector":"thead tr"},{"id":"namn","type":"SelectorText","parentSelectors":["historia"],"selector":"div.DialogHeading__StyledDialogHeading-sc-2y5bxu-0","multiple":false,"regex":"","delay":0}]}