Dominion Strategy Forum

Please login or register.

Login with username, password and session length
Pages: [1]

Author Topic: A win but rating drops?  (Read 6781 times)

0 Members and 1 Guest are viewing this topic.

ArjanB

  • Spy
  • ****
  • Offline Offline
  • Posts: 82
  • Respect: +28
    • View Profile
A win but rating drops?
« on: September 25, 2013, 07:24:46 am »
+2

Is there a reason why your rating can drop while you won the game?
It happened in three games now.
Logged

DG

  • Governor
  • *****
  • Offline Offline
  • Posts: 4074
  • Respect: +2624
    • View Profile
Re: A win but rating drops?
« Reply #1 on: September 25, 2013, 08:20:13 am »
+2

I think three in a row is a record. I think the scores can be buggy in at least three different ways.

- give you 0 for a win against an opponent
- show you a +rating but also show your old unadjusted total rating (might be correct but not shown)
- give you a rating change for a loss when you won the match

It's quite likely that all those bugs have been there since open beta.
Logged

LastFootnote

  • Adventurer
  • ******
  • Offline Offline
  • Posts: 7495
  • Shuffle iT Username: LastFootnote
  • Respect: +10722
    • View Profile
Re: A win but rating drops?
« Reply #2 on: September 25, 2013, 10:38:00 am »
+4

If your rating is high and you beat an opponent with a very low rating, your rating can drop. Goko insists that this is not a bug.
Logged

Awaclus

  • Adventurer
  • ******
  • Offline Offline
  • Posts: 11815
  • Shuffle iT Username: Awaclus
  • (´。• ω •。`)
  • Respect: +12868
    • View Profile
    • Birds of Necama
Re: A win but rating drops?
« Reply #3 on: September 25, 2013, 10:56:14 am »
0

If your rating is high and you beat an opponent with a very low rating, your rating can drop. Goko insists that this is not a bug.
Didn't they also say that they fixed it already, even though it isn't a bug?
Logged
Bomb, Cannon, and many of the Gunpowder cards can strongly effect gameplay, particularly in a destructive way

The YouTube channel where I make musicDownload my band's Creative Commons albums for free

DG

  • Governor
  • *****
  • Offline Offline
  • Posts: 4074
  • Respect: +2624
    • View Profile
Re: A win but rating drops?
« Reply #4 on: September 25, 2013, 11:02:13 am »
+2

Ok, if that still happens it is bugged in at least 4 different ways!
Logged

LastFootnote

  • Adventurer
  • ******
  • Offline Offline
  • Posts: 7495
  • Shuffle iT Username: LastFootnote
  • Respect: +10722
    • View Profile
Re: A win but rating drops?
« Reply #5 on: September 25, 2013, 11:14:17 am »
0

Ok, if that still happens it is bugged in at least 4 different ways!

Actually I think it may just explain #1 and #3 on your list. So it's bugged in at least two different ways.
Logged

SCSN

  • Mountebank
  • *****
  • Offline Offline
  • Posts: 2227
  • Respect: +7140
    • View Profile
Re: A win but rating drops?
« Reply #6 on: September 25, 2013, 11:17:49 am »
+1

No, I've had #1 happen seemingly at random against opponents both higher and lower rated than me.
Logged

DG

  • Governor
  • *****
  • Offline Offline
  • Posts: 4074
  • Respect: +2624
    • View Profile
Re: A win but rating drops?
« Reply #7 on: September 25, 2013, 11:20:37 am »
+10

I think we should stop making excuses for this. It is just a faulty system with numerous errors.
Logged

LastFootnote

  • Adventurer
  • ******
  • Offline Offline
  • Posts: 7495
  • Shuffle iT Username: LastFootnote
  • Respect: +10722
    • View Profile
Re: A win but rating drops?
« Reply #8 on: September 25, 2013, 11:21:07 am »
0

No, I've had #1 happen seemingly at random against opponents both higher and lower rated than me.

Crazy! I wonder if that only happens in Pro games. I can't remember it happening to me, at least not recently.
Logged

WrathOfGlod

  • Navigator
  • ****
  • Offline Offline
  • Posts: 72
  • Respect: +23
    • View Profile
Re: A win but rating drops?
« Reply #9 on: September 25, 2013, 12:46:22 pm »
+5

What I'm fairly sure is happening (at least some of the time) is that the ratings display page gets scores from two different sources. The game engine which calculates your new score, and some separate database which stores the old score. The score page queries both and displays the difference. The problem is that a race condition is introduced here, where sometimes the two score sources are updated separately. The most common symptom of this bug is the +0 ratings display when the db containing the new score has already been updated, but there are weirder interactions.

This explanation does require extraordinary levels of incompetence by Goko programmers, but  that it sadly makes it more likely to be true.

(I think there are separate bugs where the score is never updated but that might just be that their db is so bad that the updates timeout)
Logged

michaeljb

  • Board Moderator
  • *
  • Offline Offline
  • Posts: 1422
  • Shuffle iT Username: michaeljb
  • Respect: +2114
    • View Profile
Re: A win but rating drops?
« Reply #10 on: September 25, 2013, 03:25:23 pm »
+1

I think we should stop making excuses for this. It is just a faulty system with numerous errors.

But are we able to write down all of the errors??
Logged
🚂 Give 18xx games a chance 🚂

StrongRhino

  • Witch
  • *****
  • Offline Offline
  • Posts: 468
  • Shuffle iT Username: StrongRhino
  • Respect: +247
    • View Profile
Re: A win but rating drops?
« Reply #11 on: September 25, 2013, 05:40:20 pm »
+3

I think we should stop making excuses for this. It is just a faulty system with numerous errors.

But are we able to write down all of the errors??
There are so many they can't be written down in a simple formula.
Logged

SirPeebles

  • Cartographer
  • *****
  • Offline Offline
  • Posts: 3249
  • Respect: +5460
    • View Profile
Re: A win but rating drops?
« Reply #12 on: September 25, 2013, 05:57:22 pm »
+1

If your rating is computed as some variant on "expected value - standard deviation", then it is possible for a match to result in both the "expected value" and "standard deviation" to increase in such a way that the rating drops.
Logged
Well you *do* need a signature...

DG

  • Governor
  • *****
  • Offline Offline
  • Posts: 4074
  • Respect: +2624
    • View Profile
Re: A win but rating drops?
« Reply #13 on: September 25, 2013, 06:04:52 pm »
+1

Quote
But are we able to write down all of the errors??

If someone was determined to put their time into finding errors that Goko could find with a simple trace then it would be possible. As mentioned before, it would need human vs human games since bots have unobserved rating changes (and their shifting ratings could be the cause of some errors). If we pull a number out of the air and say that 5% of games have a rating error, then the observers will have to play a lot of games to find strong evidence of errors. They could then easily miss some potential problem conditions such as timing out a match then playing again.
Logged

Warfreak2

  • Saboteur
  • *****
  • Offline Offline
  • Posts: 1149
  • KC->KC->[Scavenger, Scavenger, Lookout]
  • Respect: +1324
    • View Profile
    • Music what I do
Re: A win but rating drops?
« Reply #14 on: September 26, 2013, 05:58:16 am »
0

some variant on "expected value - standard deviation"
This made me think that they're using Cauchy distributions for the ratings (which, of course, have "location" and "scale" parameters, but undefined mean and variance), which would explain some things.
Logged
If the only engine on the board is Procession->Conspirator, I will play it.

GeoLib

  • Jester
  • *****
  • Offline Offline
  • Posts: 965
  • Respect: +1265
    • View Profile
Re: A win but rating drops?
« Reply #15 on: October 13, 2013, 03:05:36 pm »
0

I just played a great couple of games against a higher ranked opponent (Eevee, 6238. I'm currently 5292). He won the first, and I won the second. I was really pleased because I managed to win on a three-pile megaturn right after he made me take 6 curses in one turn with torturer. And then I saw the rating screen say I'd gone down 53 points. What the hell? I had a 0 ranking change last week for a win as well. This is a really frustrating bug and they need to fix it.
Logged
"All advice is awful"
 —Count Grishnakh

SirPeebles

  • Cartographer
  • *****
  • Offline Offline
  • Posts: 3249
  • Respect: +5460
    • View Profile
Re: A win but rating drops?
« Reply #16 on: October 13, 2013, 03:17:50 pm »
0

The bug is curious, but why does it frustrate people so much?  It doesn't impact the gameplay at all.  I would rank this bug really, really low on my priorities list.
Logged
Well you *do* need a signature...

GeoLib

  • Jester
  • *****
  • Offline Offline
  • Posts: 965
  • Respect: +1265
    • View Profile
Re: A win but rating drops?
« Reply #17 on: October 13, 2013, 03:29:59 pm »
0

The bug is curious, but why does it frustrate people so much?  It doesn't impact the gameplay at all.  I would rank this bug really, really low on my priorities list.

Not all of it is rational, but I have a visceral negative reaction to winning and seeing a negative number. It also does affect gameplay in the sense that your rating affects whom you can play with. I think the most annoying part is goko's reaction to it though, and their insistence that their magic ineffable algorithm isn't screwing something up.
Logged
"All advice is awful"
 —Count Grishnakh

Watno

  • Margrave
  • *****
  • Offline Offline
  • Posts: 2745
  • Shuffle iT Username: Watno
  • Respect: +2983
    • View Profile
Re: A win but rating drops?
« Reply #18 on: October 13, 2013, 03:42:23 pm »
0

But your rating does actually do the correct thing when the wrong change is displayed (not for the 0 change bug though). Doesn't change the fact that Goko sucks.
Logged

Ozle

  • Cartographer
  • *****
  • Offline Offline
  • Posts: 3625
  • Sorry, this text is personal.
  • Respect: +3360
    • View Profile
Re: A win but rating drops?
« Reply #19 on: October 13, 2013, 04:19:03 pm »
+2

Logged
Try the Ozle Google Map Challenge!
http://forum.dominionstrategy.com/index.php?topic=7466.0

Sullying players Enjoyment of Innovation since 2013 Apparently!

SirPeebles

  • Cartographer
  • *****
  • Offline Offline
  • Posts: 3249
  • Respect: +5460
    • View Profile
Re: A win but rating drops?
« Reply #20 on: October 13, 2013, 04:48:33 pm »
+1

Your rating determines who you can play against?  When did Goko implement that?
Logged
Well you *do* need a signature...

yed

  • Minion
  • *****
  • Offline Offline
  • Posts: 620
  • Shuffle iT Username: yed
  • Respect: +571
    • View Profile
Re: A win but rating drops?
« Reply #21 on: October 13, 2013, 05:00:33 pm »
+1

Your rating determines who you can play against?  When did Goko implement that?
Technically they did, they implemented kick button.
Practically extension autokick and automatch does that.
Logged

SCSN

  • Mountebank
  • *****
  • Offline Offline
  • Posts: 2227
  • Respect: +7140
    • View Profile
Re: A win but rating drops?
« Reply #22 on: October 13, 2013, 05:13:45 pm »
0

Your rating determines who you can play against?  When did Goko implement that?

I was going to upvote this because it seemed like such an excellent joke, but then I recalled you posting somewhere (Rebuild article thread?) that you almost exclusively play irl, so you're probably genuinely curious. I'm upvoting anyway because you made me laugh, but it's what yed said: the extension has an option to auto-kick people from your games when they have a rating lower than what you specify in the title. It also produces a "ping" sound when someone who has a high enough rating sits down, so that you don't have to constantly check that hideous lobby.
Logged

SirPeebles

  • Cartographer
  • *****
  • Offline Offline
  • Posts: 3249
  • Respect: +5460
    • View Profile
Re: A win but rating drops?
« Reply #23 on: October 13, 2013, 05:46:12 pm »
+4

Your rating determines who you can play against?  When did Goko implement that?

I was going to upvote this because it seemed like such an excellent joke, but then I recalled you posting somewhere (Rebuild article thread?) that you almost exclusively play irl, so you're probably genuinely curious. I'm upvoting anyway because you made me laugh, but it's what yed said: the extension has an option to auto-kick people from your games when they have a rating lower than what you specify in the title. It also produces a "ping" sound when someone who has a high enough rating sits down, so that you don't have to constantly check that hideous lobby.

Well that's a confusing mess. Part of me wants to say that it isn't Goko's fault that players are choosing you to use a bugged feature to automate these decisions.  On the other hand, players are doing this only because Goko has failed to implement their system (or so is my understanding).

I can sympathize with why Goko isn't making much progress on Dominion these days.  They probably have a small staff, and they are working on other games and well the iOS version of Dominion.  What really gets to me is that they didn't just do things right in the first place.  An automatch feature should gave been in the works even before they began beta testing.  They never should have even had that ridiculous lobby system in the first place. 
Logged
Well you *do* need a signature...

kylar

  • Salvager
  • ****
  • Offline Offline
  • Posts: 60
  • Respect: +13
    • View Profile
Re: A win but rating drops?
« Reply #24 on: November 15, 2013, 12:33:25 am »
+3

Hi,

   I have just seen a new way to lose points while supposedly winning

 http://dom.retrobox.eu/?/20131114/log.50d804c7e4b0b34255505855.1384490982851.txt

  This game ended on my opponents turn 12. I assumed that while he was ahead, he saw that I was most likely going to win and ended it. If you look at the bottom of the log there are two game over boxes, one with my opponent winning and one with me winning. I noticed something was wrong when I went to the leaderboard post game and saw that while there was a +21 next to my name, I had lost about 20 points. I would have lost about 40 if he had won because of rating differences. Its like we played two games in that one and split them.

   Has anyone seen this before or is it new?
Logged
Pages: [1]
 

Page created in 0.104 seconds with 20 queries.