Which country voted the best at Eurovision?

Eurovision was on yesterday. I’ve never been interested much in the musical side but the weird political dynamics of Eurovision voting have always fascinated me; I tune in each year just for them and somewhat snarky commentary of Graham Norton, the UK commentator.

As I was watching the jury votes come in, a question popped into my head: Which country has voted the best in Eurovision? That is, which country was best at picking the eventual top 10 and in the right order?

Strangely enough, while there’s plenty of work on voting blocs and bilateral biases at Eurovision, most of it asks who votes for whom; I wanted to ask who votes accurately. I couldn’t find anyone asking the question that way, so I decided to do some data analysis myself.

The metric#

To begin to answer this question, I first needed to formalize what “best” even means. That is, some mathematical notion of “good” and “bad”.

The simplest measure I could come up with is “of the 10 countries you gave points to, how many were in the actual top 10?”. The problem is that it can’t tell apart a voter who gave the eventual winner 12 from one who gave them 1. That feels wrong: an allocation is a ranking, not just a set, so position ought to matter.

To weight position, I needed some scheme for how much position 1 matters compared to position 10. Turns out Eurovision itself has already answered this question: the 12, 10, 8, 7, 6, 5, 4, 3, 2, 1 it hands out is exactly such a scheme. So I just reused it.

So I tried the next simplest thing: for each country, I have two numbers: what the voter awarded it, and how many points it actually received at the end. Multiply them together, sum across all countries, and divide by the maximum value that sum could possibly take if the voter had ranked everything perfectly (awarded 12 to the actual winner, 10 to second place, and so on). The result is between 0 and 1, where 1 is a perfect vote.

A worked example. The actual jury top 5 in 2023, by points received, was Sweden (340), Israel (177), Italy (176), Finland (150), Estonia (146). Imagine a voter’s jury panel awarded (12 → Italy, 10 → Sweden, 8 → Estonia, 7 → Israel, 6 → Finland).

Here’s the voter’s score:

Voter awarded Country × Actual points =
12 Italy × 176 2,112
10 Sweden × 340 3,400
8 Estonia × 146 1,168
7 Israel × 177 1,239
6 Finland × 150 900
Sum 8,819

And here’s the perfect score for this voter, what they’d have got if they had awarded the 12 to the actual top scorer, the 10 to second, and so on:

Voter awarded Country × Actual points =
12 Sweden × 340 4,080
10 Israel × 177 1,770
8 Italy × 176 1,408
7 Finland × 150 1,050
6 Estonia × 146 876
Sum 9,184

So this voter’s score is 8,819 / 9,184 = 0.96. Close to perfect: the same five countries are there, just slightly out of order.

Is it the right metric?#

Obviously this is not the only metric I could have used and there are many other candidates out there: least-squares distance to the perfect vote, NDCG@10 (a standard ranking measure used in search), and Pearson correlation.

I went with the one above because I wanted the simplest thing which still worked. Least-squares is the only “simpler” alternative I can think of, but its scores end up squashed into a narrow range. The best voter across nine contests only reaches around 0.42 out of a theoretical max of 1.0, which is the highest score in the data but doesn’t read like a good number. The metric above sits more naturally on a 0-to-1 scale: the best voters land in the 0.8s, the worst in the 0.6s, and 1.0 still means a perfect vote.

In any case, I did run all the metrics listed above and they mostly agreed, with the same countries clustered at the top and bottom regardless of which one I used. But the headline #1 did shift between the top three or four countries depending on which metric I picked.

The answer#

I picked 2016 as the start because that’s when Eurovision split each country’s contribution into separate jury and televote slates, each awarding their own 12, 10, 8, … points. Older contests used a single combined vote, so the data doesn’t decompose the same way.

Across these nine contests, here’s the full table:

Rank Country Score
1 Spain 0.815
2 Lithuania 0.810
3 Belgium 0.804
4 Germany 0.798
5 Netherlands 0.797
6 Malta 0.792
7 Sweden 0.790
8 Austria 0.789
9 Iceland 0.788
10 Norway 0.783
11 Israel 0.778
12 Latvia 0.777
13 Finland 0.777
14 Moldova 0.774
15 Poland 0.773
16 Romania 0.771
17 Estonia 0.770
18 San Marino 0.770
19 Ireland 0.762
20 Armenia 0.762
21 Cyprus 0.761
22 Denmark 0.757
23 Albania 0.754
24 Slovenia 0.751
25 Australia 0.749
26 Azerbaijan 0.746
27 Serbia 0.745
28 Portugal 0.743
29 Switzerland 0.739
30 Czechia 0.735
31 Croatia 0.733
32 United Kingdom 0.723
33 France 0.712
34 Georgia 0.707
35 North Macedonia 0.706
36 Greece 0.691
37 Bulgaria 0.688
38 Ukraine 0.675
39 Italy 0.666
40 Montenegro 0.625

Spain edges it, but only barely. The top seven are within 0.025 of each other, narrower than the year-to-year variation of any individual country, so calling Spain “the” best voter is too strong a statement.

A few countries often discussed in bloc-voting analyses do show up near the bottom; parts of the Balkans (Croatia, North Macedonia, Bulgaria, Montenegro) and Greece. But it’s only suggestive: others from the same blocs (Cyprus, Albania, Serbia, Armenia) sit comfortably mid-table, so this metric isn’t really measuring bloc voting; it’s measuring accuracy, which is a different thing. Properly disentangling the two would need more analysis work I don’t really want to do!

A note on data#

All voting data is from EurovisionAPI/dataset, a scraped mirror of the EBU’s published results. As a sanity check on the two most recent contests I parsed the Wikipedia voting tables for 2024 and 2025 and diffed every cell against the dataset and got no differences.

All my code is available on GitHub.

添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论