Issue with SelectorElementClick and then navigating to particular data to scrape

How to?
#1

Hi there,

I'm trying to scrape data for a particular football league on flashscores, the full url i'm using is: https://www.flashscore.co.uk/football/norway/eliteserien/results/

I need to click on each game, then to stats >>> 1st half and scrape the Expected Goals for both the home and away teams, as per the attached screenshot.

Screenshot_1
Screenshot_1680×954 44 KB

I've managed to get this working to the point where it will cycle through and open up the link for each game, however it does not appear to navigate through to stats > 1st half and then scrape the required text.

Sitemap is:

{"_id":"flashscore_norway_xg","startUrl":["https://www.flashscore.co.uk/football/norway/eliteserien/results/"],"selectors":[{"clickElementSelector":"div.event__match:nth-of-type(n+3)","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":500,"discardInitialElements":"discard","id":"games","multiple":true,"parentSelectors":["_root"],"selector":"body","type":"SelectorElementClick"},{"clickElementSelector":".tabs__detail--nav a:nth-of-type(2)","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":500,"discardInitialElements":"do-not-discard","id":"stats","multiple":false,"parentSelectors":["games"],"selector":"parent","type":"SelectorElementClick"},{"clickElementSelector":"a[title='1st Half']","clickElementUniquenessType":"uniqueCSSSelector","clickType":"clickOnce","delay":500,"discardInitialElements":"do-not-discard","id":"1st half","multiple":false,"parentSelectors":["stats"],"selector":"parent","type":"SelectorElementClick"},{"id":"home xG 45","multiple":false,"parentSelectors":["1st half"],"regex":"","selector":"div.stat__row:nth-of-type(1) div.stat__homeValue","type":"SelectorText"},{"id":"away xG 45","multiple":false,"parentSelectors":["1st half"],"regex":"","selector":"div.stat__row:nth-of-type(1) div.stat__awayValue","type":"SelectorText"}]}

I am also getting the following error:

A listener indicated an asynchronous response by returning true, but the message channel closed before a response was received *

Hopefully someone can help, thanks in advance.

#3

image
image965×124 5.93 KB

I've changed this to links rather than element click, but it still doesn't pull any data :frowning:

{"_id":"norway_league_links","startUrl":["https://www.flashscore.co.uk/football/norway/eliteserien/results/"],"selectors":[{"id":"links_to_games","parentSelectors":["_root"],"type":"SelectorElementClick","clickElementSelector":"div.event__match:nth-of-type(n+3)","clickElementUniquenessType":"uniqueHTMLText","clickType":"clickOnce","delay":2000,"discardInitialElements":"do-not-discard","multiple":true,"selector":"html"},{"id":"click_on_stats","parentSelectors":["links_to_games"],"type":"SelectorLink","selector":".tabs__detail--nav a:nth-of-type(2)","multiple":false},{"id":"click_on_1sthalf","parentSelectors":["click_on_stats"],"type":"SelectorLink","selector":"a[title='1st Half']","multiple":false},{"id":"get_xG","parentSelectors":["click_on_1sthalf"],"type":"SelectorText","selector":"div.stat__row:nth-of-type(1) .stat__category > div","multiple":true,"regex":""}]}
#4

The issue appears to be with popup links as per the below error from chrome console:

content_script.js:18245 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'self' 'wasm-unsafe-eval' 'inline-speculation-rules'". Either the 'unsafe-inline' keyword, a hash ('sha256-98WtSDVz6vQBAKIsqhH3ddzHJETVMGxYbUXMf1+JpoI='), or a nonce ('nonce-...') is required to enable inline execution.