Dominion Strategy Forum

Please login or register.

Login with username, password and session length
Pages: [1] 2 3 ... 8  All

Author Topic: Log Search Engine  (Read 74136 times)

0 Members and 1 Guest are viewing this topic.

ragingduckd

  • Board Moderator
  • *
  • Offline Offline
  • Posts: 1059
  • Respect: +3527
    • View Profile
Log Search Engine
« on: May 29, 2013, 09:42:35 pm »
+41

Search engine for Goko game logs: http://gokologs.drunkensailor.org

Please post feature requests and bug reports in this thread.

------------------
Status (AFAIK): Online
- Downloading new logs every 10 minutes

Known limitations:
- Some 2012 games can't be unambiguously parsed
- Can't distinguish unrated/casual/pro before May 15, 2013

Outstanding feature requests:
- display number of copies of each card gained
- save default search options
- more elegant UI generally
- bring back the win-loss results summary
« Last Edit: August 01, 2013, 09:00:21 pm by ragingduckd »
Logged
Salvager Extension | Isotropish Leaderboard | Game Data | Log Search & other toys | Salvager Bug Reports

Salvager not working for me at all today. ... Please help! I can't go back to playing without it like an animal!

StrongRhino

  • Witch
  • *****
  • Offline Offline
  • Posts: 468
  • Shuffle iT Username: StrongRhino
  • Respect: +247
    • View Profile
Re: Log Search Engine
« Reply #1 on: May 29, 2013, 09:57:04 pm »
0

This is great!
I just learned I do badly with potions (4-9 record not counting the solitaire game I played)
I'm also good with looters (5-0)
And average with colonies (3-2)
« Last Edit: May 29, 2013, 10:00:36 pm by StrongRhino »
Logged

heatthespurs

  • Spy
  • ****
  • Offline Offline
  • Posts: 82
  • Respect: +61
    • View Profile
Re: Log Search Engine
« Reply #2 on: May 30, 2013, 04:23:45 am »
+1

This is EXCELLENT! Thank you very much!

We keep doing things that is supposed to be done by Goko staff (in-game log, log finder, etc.)... anyone could write a auto-match system?  :-\
Logged

loppo

  • 2014 Austrian Champion
  • *
  • Offline Offline
  • Posts: 176
  • Respect: +194
    • View Profile
Re: Log Search Engine
« Reply #3 on: May 30, 2013, 05:02:11 am »
+1

that is superb. And besides the useful information i found out that i have an Doppelgänger on goko. There is a "loppo" and a "Loppo".

Fortunately the wrong one has only losses, so its quite easy to distinguish.
Logged

Davio

  • 2012 Dutch Champion
  • *
  • Offline Offline
  • Posts: 4787
  • Respect: +3413
    • View Profile
Re: Log Search Engine
« Reply #4 on: May 30, 2013, 05:22:18 am »
0

that is superb. And besides the useful information i found out that i have an Doppelgänger on goko. There is a "loppo" and a "Loppo".

Fortunately the wrong one has only losses, so its quite easy to distinguish.
Oh my, case-sensitive usernames... :'(
Or is that a capital i?  ;)
Logged

BSG: Cagprezimal Adama
Mage Knight: Arythea

ragingduckd

  • Board Moderator
  • *
  • Offline Offline
  • Posts: 1059
  • Respect: +3527
    • View Profile
Re: Log Search Engine
« Reply #5 on: May 30, 2013, 05:32:52 am »
+2

that is superb. And besides the useful information i found out that i have an Doppelgänger on goko. There is a "loppo" and a "Loppo".

Fortunately the wrong one has only losses, so its quite easy to distinguish.
Oh my, case-sensitive usernames... :'(
Or is that a capital i?  ;)

And here I thought I was doing people a favor by making it case insensitive.  I'll add a toggle.

You can't imagine how many places I had to add code to deal with goko bugs.  They're all commented with "F U Goko."
Logged
Salvager Extension | Isotropish Leaderboard | Game Data | Log Search & other toys | Salvager Bug Reports

Salvager not working for me at all today. ... Please help! I can't go back to playing without it like an animal!

yed

  • Minion
  • *****
  • Offline Offline
  • Posts: 620
  • Shuffle iT Username: yed
  • Respect: +571
    • View Profile
Re: Log Search Engine
« Reply #6 on: May 30, 2013, 05:35:49 am »
0

You can't imagine how many places I had to add code to deal with goko bugs.  They're all commented with "F U Goko."
How about a few examples? Humor us :)
Logged

Davio

  • 2012 Dutch Champion
  • *
  • Offline Offline
  • Posts: 4787
  • Respect: +3413
    • View Profile
Re: Log Search Engine
« Reply #7 on: May 30, 2013, 06:00:49 am »
+3

Yes, as a fellow programmer, I love seeing someone else's misery code. :)
Logged

BSG: Cagprezimal Adama
Mage Knight: Arythea

ragingduckd

  • Board Moderator
  • *
  • Offline Offline
  • Posts: 1059
  • Respect: +3527
    • View Profile
Re: Log Search Engine
« Reply #8 on: May 30, 2013, 07:04:36 am »
+8

You can't imagine how many places I had to add code to deal with goko bugs.  They're all commented with "F U Goko."
How about a few examples? Humor us :)

Here's me parsing a log where Outpost makes Goko counts the turns wrong.  In tied games, the wrong player would win because of it.

Code: [Select]
Now handling log.5021d3b637e80b087f124420.1346557284089.txt
Success!
Now handling log.503e653a4e423bf9f6fe53c2.1346546032904.txt
Success!
Now handling log.503fc49fde403bf99ee37a2b.1346534477235.txt
TurnCountException in log.503fc49fde403bf99ee37a2b.1346534477235.txt.  Fuck you, Goko.
Logged
Salvager Extension | Isotropish Leaderboard | Game Data | Log Search & other toys | Salvager Bug Reports

Salvager not working for me at all today. ... Please help! I can't go back to playing without it like an animal!

ragingduckd

  • Board Moderator
  • *
  • Offline Offline
  • Posts: 1059
  • Respect: +3527
    • View Profile
Re: Log Search Engine
« Reply #9 on: May 30, 2013, 07:29:02 am »
+4

This was a fun one too.  Here's are two excerpts from the same game log:

Code: [Select]
------------ Game Over ------------
guest2836 - cards: 2 Remodel, 1 Rabble, 1 Shanty Town, 7 Copper, 2 Silver, 1 Hoard, 1 Gold, 1 Bank, 2 Estate
guest2836 - total victory points: 2
guest2836 - turns: 8
 
Rotkäppchen - cards: 2 Farming Village, 1 Upgrade, 4 Copper, 1 Silver
Rotkäppchen - total victory points: 0
Rotkäppchen - turns: 7
 
1st place: guest2836
2nd place: Rotkäppchen

Code: [Select]
------------ Game Over ------------
Rotkäppchen - cards: 2 Farming Village, 1 Upgrade, 4 Copper, 1 Silver
Rotkäppchen - total victory points: 0
Rotkäppchen - turns: 7
 
guest2836 - quit
guest2836 - cards: 2 Remodel, 1 Rabble, 1 Shanty Town, 7 Copper, 2 Silver, 1 Hoard, 1 Gold, 1 Bank, 2 Estate
guest2836 - total victory points: 2
guest2836 - turns: 8
 
1st place: Rotkäppchen
2nd place: guest2836
Logged
Salvager Extension | Isotropish Leaderboard | Game Data | Log Search & other toys | Salvager Bug Reports

Salvager not working for me at all today. ... Please help! I can't go back to playing without it like an animal!

Watno

  • Margrave
  • *****
  • Offline Offline
  • Posts: 2745
  • Shuffle iT Username: Watno
  • Respect: +2983
    • View Profile
Re: Log Search Engine
« Reply #10 on: May 30, 2013, 07:50:17 am »
0

Those are old logs, aren't they?
Can't wait to have them all.
Logged

ragingduckd

  • Board Moderator
  • *
  • Offline Offline
  • Posts: 1059
  • Respect: +3527
    • View Profile
Re: Log Search Engine
« Reply #11 on: May 30, 2013, 02:20:28 pm »
+1

Those are old logs, aren't they?
Can't wait to have them all.

The second one is from March.  I had to deal with that before I could parse those logs.  My parser is none too zippy, but it'll probably get through the March files sometime today.
Logged
Salvager Extension | Isotropish Leaderboard | Game Data | Log Search & other toys | Salvager Bug Reports

Salvager not working for me at all today. ... Please help! I can't go back to playing without it like an animal!

ragingduckd

  • Board Moderator
  • *
  • Offline Offline
  • Posts: 1059
  • Respect: +3527
    • View Profile
Re: Log Search Engine
« Reply #12 on: June 01, 2013, 02:01:48 pm »
+4

Update:
- All logs back to March 1 are now included.  February is in progress.
- Can now search by number of players
- Can now search by Colonies vs. Provinces
- Can now exclude games played with bots/guests

Support for shelters/estates and rating system is coming.

I'm not happy with the speed, but I think I can improve it with some database re-jiggering.  FYI, the second search you run on your username will generally be a lot faster than the first.
Logged
Salvager Extension | Isotropish Leaderboard | Game Data | Log Search & other toys | Salvager Bug Reports

Salvager not working for me at all today. ... Please help! I can't go back to playing without it like an animal!

AdamH

  • Margrave
  • *****
  • Offline Offline
  • Posts: 2833
  • Shuffle iT Username: Adam Horton
  • You make your own shuffle luck
  • Respect: +3879
    • View Profile
    • My Dominion Videos
Re: Log Search Engine
« Reply #13 on: June 06, 2013, 08:40:10 am »
0

So this thing is amazing.

Does it take a day or so for logs to show up on here? For example if I played a game yesterday and want to get the log using this, I wasn't able to find any of them yet; does that just take a couple of days?
Logged
Visit my blog for links to a whole bunch of Dominion content I've made.

loppo

  • 2014 Austrian Champion
  • *
  • Offline Offline
  • Posts: 176
  • Respect: +194
    • View Profile
Re: Log Search Engine
« Reply #14 on: June 06, 2013, 08:42:16 am »
+2

this thread should get stickied, just like nutkis online extension.
Logged

ragingduckd

  • Board Moderator
  • *
  • Offline Offline
  • Posts: 1059
  • Respect: +3527
    • View Profile
Re: Log Search Engine
« Reply #15 on: June 06, 2013, 12:32:47 pm »
0

Does it take a day or so for logs to show up on here? For example if I played a game yesterday and want to get the log using this, I wasn't able to find any of them yet; does that just take a couple of days?

It's even worse than that.  It takes until I get around to manually running a script to download the logs and parse them.  I had a script that parsed them in real time, but it was badly written and it sucked up all my disk I/O and that interfered with my downloading illegal media.

Anyway, sorry about that.  Logs for the last few days are going in now, and I promise I'll fix the automated updating as soon as I feel like it.
Logged
Salvager Extension | Isotropish Leaderboard | Game Data | Log Search & other toys | Salvager Bug Reports

Salvager not working for me at all today. ... Please help! I can't go back to playing without it like an animal!

AdamH

  • Margrave
  • *****
  • Offline Offline
  • Posts: 2833
  • Shuffle iT Username: Adam Horton
  • You make your own shuffle luck
  • Respect: +3879
    • View Profile
    • My Dominion Videos
Re: Log Search Engine
« Reply #16 on: June 06, 2013, 12:34:52 pm »
0

Hey no problem. You don't owe us anything for doing this. I was just curious if I was doing something wrong.
Logged
Visit my blog for links to a whole bunch of Dominion content I've made.

ragingduckd

  • Board Moderator
  • *
  • Offline Offline
  • Posts: 1059
  • Respect: +3527
    • View Profile
Re: Log Search Engine
« Reply #17 on: June 09, 2013, 02:46:06 am »
0

Hey no problem. You don't owe us anything for doing this. I was just curious if I was doing something wrong.

No worries.  I was just feeling a little frustrated with my code.  I very much enjoy working on this stuff (it's a welcome break from my real work) and I appreciate getting feature requests, even when the request is basically "make it work right." :)

I'm actually parsing the logs automatically every hour now, but for reasons I don't understand, the MySQL database doesn't seem to refresh the data that it sends to my Python web server without manual intervention.  I'm really not sure why, though I know it's not a query cache issue and I think it may have something to do with the InnoDB buffer.  If anyone out there has some clue, I'd be grateful for any assistance.
Logged
Salvager Extension | Isotropish Leaderboard | Game Data | Log Search & other toys | Salvager Bug Reports

Salvager not working for me at all today. ... Please help! I can't go back to playing without it like an animal!

ragingduckd

  • Board Moderator
  • *
  • Offline Offline
  • Posts: 1059
  • Respect: +3527
    • View Profile
Re: Log Search Engine
« Reply #18 on: June 09, 2013, 12:20:48 pm »
+3

Sweet!  Now updating every 15 minutes. :D
Logged
Salvager Extension | Isotropish Leaderboard | Game Data | Log Search & other toys | Salvager Bug Reports

Salvager not working for me at all today. ... Please help! I can't go back to playing without it like an animal!

ragingduckd

  • Board Moderator
  • *
  • Offline Offline
  • Posts: 1059
  • Respect: +3527
    • View Profile
Re: Log Search Engine
« Reply #19 on: June 09, 2013, 07:31:35 pm »
+1

I've been thinking -- perhaps a little too late -- about the privacy issues with the log search.  Yes, I know the logs are already public information b/c Goko is posting them, but there's a big difference between having a window in your bedroom and having someone set up a webcam outside it.

I'm considering adding a feature that would allow players to block searches for their name specifically.  If player X were blocked but player Y wasn't, it would work like this:

Search for player X: get nothing
Search for player X vs Y: get games between X and Y (like usual)
Search for player Y: get all of Y's games, including games with X (like usual)

Please let me know how you feel about this and/or vote in the poll above.
Logged
Salvager Extension | Isotropish Leaderboard | Game Data | Log Search & other toys | Salvager Bug Reports

Salvager not working for me at all today. ... Please help! I can't go back to playing without it like an animal!

StrongRhino

  • Witch
  • *****
  • Offline Offline
  • Posts: 468
  • Shuffle iT Username: StrongRhino
  • Respect: +247
    • View Profile
Re: Log Search Engine
« Reply #20 on: June 09, 2013, 08:58:15 pm »
0

It says its a discrete poll- but I can see the results  ???
Logged

sudgy

  • Cartographer
  • *****
  • Offline Offline
  • Posts: 3431
  • Shuffle iT Username: sudgy
  • It's pronounced "SOO-jee"
  • Respect: +2707
    • View Profile
Re: Log Search Engine
« Reply #21 on: June 09, 2013, 08:59:40 pm »
+2

It says its a discrete poll- but I can see the results  ???

You can't see who voted what things.
Logged
If you're wondering what my avatar is, watch this.

Check out my logic puzzle blog!

   Quote from: sudgy on June 31, 2011, 11:47:46 pm

heron

  • Saboteur
  • *****
  • Offline Offline
  • Posts: 1055
  • Shuffle iT Username: heron
  • Respect: +1184
    • View Profile
Re: Log Search Engine
« Reply #22 on: June 09, 2013, 09:05:26 pm »
+2

It says its a discrete poll- but I can see the results  ???

Why would a poll's discreteness affect its discreetness?  :P

Although I seem to remember it saying that it was a discrete poll, so you may not have made an error there. But how could a poll not be discrete  ???
« Last Edit: June 09, 2013, 11:03:36 pm by heron »
Logged

StrongRhino

  • Witch
  • *****
  • Offline Offline
  • Posts: 468
  • Shuffle iT Username: StrongRhino
  • Respect: +247
    • View Profile
Re: Log Search Engine
« Reply #23 on: June 09, 2013, 09:11:20 pm »
0

It says its a discrete poll- but I can see the results  ???

You can't see who voted what things.
Oh. Duh.
I thought it meant only the creator could see the results, which I translated as what was voted for.
Logged

DStu

  • Margrave
  • *****
  • Offline Offline
  • Posts: 2627
  • Respect: +1490
    • View Profile
Re: Log Search Engine
« Reply #24 on: June 10, 2013, 02:07:28 am »
0

I've been thinking -- perhaps a little too late -- about the privacy issues with the log search.  Yes, I know the logs are already public information b/c Goko is posting them, but there's a big difference between having a window in your bedroom and having someone set up a webcam outside it.

I'm considering adding a feature that would allow players to block searches for their name specifically.  If player X were blocked but player Y wasn't, it would work like this:

Search for player X: get nothing
Search for player X vs Y: get games between X and Y (like usual)
Search for player Y: get all of Y's games, including games with X (like usual)

Please let me know how you feel about this and/or vote in the poll above.
I'm a bit undecided.

On the one hand it's a simple feature which does not effect anyone who does not want to use it, and it cares for the ones who care.

On the other hand, it's giving a false sense of security and takes away knowledge from the public, while preserving it for anyone wit a little bit of skill.  I mean it does not protect against any assumed real threats, anyone who really wants to find useful information finds them in the goko logs. It just 'protect' against the public, and I've seen that too many times in the last years: Everyone who could really harm you (financially or however) will get the data anyhow, but the whole public rants on how their neighbour can now see their houses on the internet.  That's what left us Germans with this crippled version of Streetview, while at the same time nobody cares that you can get every relevant data on your houses from the state for a minimal fee.

On the third hand, I don't play on goko, so ...
Logged
Pages: [1] 2 3 ... 8  All
 

Page created in 0.069 seconds with 20 queries.