Dominion Strategy Forum

Please login or register.

Login with username, password and session length
Pages: [1]

Author Topic: TrueSkill questions  (Read 3289 times)

0 Members and 1 Guest are viewing this topic.

Quadell

  • Scout
  • ****
  • Offline Offline
  • Posts: 44
  • Respect: +107
    • View Profile
TrueSkill questions
« on: April 19, 2012, 08:27:10 am »
0

1. If I win a game 41-40, or if I win a game 62-10, do these both affect my "skill range" on the leaderboard the same? (In other words, are all wins equal for the purpose of TrueSkill evaluation?)

2. If I come in second in a 3-player game, or if I come in third, to these both affect my "skill range" the same?

Thanks!
Logged

DStu

  • Margrave
  • *****
  • Offline Offline
  • Posts: 2627
  • Respect: +1490
    • View Profile
Re: TrueSkill questions
« Reply #1 on: April 19, 2012, 08:32:39 am »
+3

1. If I win a game 41-40, or if I win a game 62-10, do these both affect my "skill range" on the leaderboard the same? (In other words, are all wins equal for the purpose of TrueSkill evaluation?)
Yes
Quote
2. If I come in second in a 3-player game, or if I come in third, to these both affect my "skill range" the same?
Every n player game is splitted into 1/2*n*(n-1) 2-player games for isotropics TS, so it's the same as if you played each one 2player game against the winner and the loser, and lose/win this game.
Logged

rspeer

  • Witch
  • *****
  • Offline Offline
  • Posts: 469
  • Respect: +877
    • View Profile
Re: TrueSkill questions
« Reply #2 on: May 09, 2012, 09:50:33 pm »
+3

The thing about 3p games is not quite right. That's how my crappy prototype version worked, but DougZ implemented the more probabilistically correct version that takes the entire ordering into account.

TrueSkill assumes that there is an un-observable "actual rating" that comes from playing a game, and that players finish in order of their actual rating. The actual rating is in a fuzzy range around your mean skill rating (the 99% margin of error for that range is shown on the leaderboard), but nobody can actually tell where it is in the range because you might be lucky or unlucky, or having an on or off day.

But if A beats B, that says that A's actual rating (whatever it is) was higher than B's (whatever it is) for that game. TrueSkill takes that into account and updates their skill ranges to make that more probable.

In a three-player game where A > B > C, it actually gets a lot of information about the actual rating of B, because it's in a narrow window between A and C. I'm not entirely clear what the practical difference is between this and doing the pairwise comparisons, except that your variance decreases more when you rank in the middle.
Logged

ehunt

  • Torturer
  • *****
  • Offline Offline
  • Posts: 1528
  • Shuffle iT Username: ehunt
  • Respect: +1855
    • View Profile
Re: TrueSkill questions
« Reply #3 on: May 10, 2012, 10:20:33 am »
0

If I tie someone ranked better/worse than me, does my ranking go up/down?
Logged

blueblimp

  • Margrave
  • *****
  • Offline Offline
  • Posts: 2849
  • Respect: +1559
    • View Profile
Re: TrueSkill questions
« Reply #4 on: May 10, 2012, 10:51:37 am »
0

TrueSkill assumes that there is an un-observable "actual rating" that comes from playing a game, and that players finish in order of their actual rating. The actual rating is in a fuzzy range around your mean skill rating (the 99% margin of error for that range is shown on the leaderboard), but nobody can actually tell where it is in the range because you might be lucky or unlucky, or having an on or off day.

I think this might be a little misleading. The 99% uncertainty range on the leaderboard is uncertainty about the true skills of the players. But within a game, the standard deviation of performance is assumed to be the same for every player, since it comes from the parameter beta=25.

The implication is that the rating system doesn't distinguish between consistent players (about the same performance every game) and inconsistent players (wildly different performance every game).
Logged
Pages: [1]
 

Page created in 0.045 seconds with 22 queries.