101
Goko Dominion Online / Re: Isotropish Leaderboard (alternative to Goko Pro)
« on: July 01, 2014, 05:40:18 am »https://github.com/aiannacc/goko-dominion-tools/blob/f0ae8522af6151e4a459eb49dc820c00931c4729/start_logwatcher.py#L81-L97 does look pretty rude: hitting them with 40 new connections all at once. Isn't there a python HTTP client that supports Connection: Keep-Alive and/or pipelining? It looks like urlgrabber, urllib2, httplib2, and pycurl may all support this sort of thing; but I don't have the python experience to judge which of them are actually any good.
Of course I don't know who on their end you'd have to talk to, but if they really are blocking you I'm kinda amazed they decided to do so without even contacting you. If you end up getting your networking code a little more polite but can't convince makingfun to let you back in, you could try connecting over tor.
Whether that's the problem or not, I would definitely appreciate some help in making my connections more "polite." I'm sure that the Python Requests module supports all the basic protocols and header options, but honestly I haven't a clue what I'm doing with this stuff. Like I have it doing 40 requests at once because that was the only way I could think to deal with the long delays (often 30 seconds or more) when I request individual log files.
Could you point me towards a useful reference for understanding how to do polite and efficient http requests in high(-ish) volume? It doesn't have to be Python-specific.
I realize that Tor is an option, but I'd like to try to civil route first. I'm also surprised to be cut off without being contacted. But that's assuming that a human made the decision. Maybe their server defends itself from attacks by automatically cutting off abusive requesters?
Also can you connect to archive-dominionlogs.goko.com ?
That is a different server.
Yes, I can still access that server from Linode. But it runs about 2 days behind on the game logs. The only source I know that provides logs in real time is logs.prod.dominion.makingfun.com (the same server as dominionlogs.goko.com).
TryCode: [Select]traceroute logs.prod.dominion.makingfun.com
to determine if it is not a network issue.
Ok. I haven't used traceroute before though. Does this output mean anything to you?
Code: [Select]
li566-22> traceroute logs.prod.dominion.makingfun.com
traceroute to logs.prod.dominion.makingfun.com (54.213.198.64), 30 hops max, 60 byte packets
1 23.92.24.3 (23.92.24.3) 0.377 ms 0.522 ms 0.638 ms
2 10ge8-3.core3.fmt2.he.net (64.71.132.137) 0.153 ms 0.143 ms 0.146 ms
3 10ge10-1.core1.sjc2.he.net (184.105.222.14) 12.244 ms 12.202 ms 12.149 ms
4 216.218.193.42 (216.218.193.42) 0.678 ms 0.691 ms 0.656 ms
5 205.251.229.155 (205.251.229.155) 0.678 ms 205.251.229.157 (205.251.229.157) 0.682 ms 205.251.229.155 (205.251.229.155) 0.703 ms
6 205.251.232.68 (205.251.232.68) 30.317 ms 205.251.232.112 (205.251.232.112) 22.153 ms 205.251.232.68 (205.251.232.68) 29.517 ms
7 205.251.232.147 (205.251.232.147) 22.359 ms 205.251.232.153 (205.251.232.153) 22.272 ms 205.251.232.141 (205.251.232.141) 22.262 ms
8 205.251.232.165 (205.251.232.165) 22.997 ms 22.948 ms 205.251.232.63 (205.251.232.63) 22.938 ms
9 * * *
10 * * *
11 * * *
12 * * *
13 * * *
14 * * *
15 * * *
16 * * *
17 * * *
18 * * *
19 * * *
20 * * *
21 * * *
22 * * *
23 * * *
24 * * *
25 * * *
26 * * *
27 * * *
28 * * *
29 * * *
30 * * *