What does it mean to be #1 on an AI leaderboard?

I saw that Opus 5 is supposedly top of some leaderboard, and I keep wondering: what are these metrics actually measuring? Is it about raw performance, or something more like who can afford the most compute? I'm not trying to dismiss the achievement, but I'm curious how much these rankings reflect real-world usefulness vs. a kind of arms race.