The Week in Chess

Tuesday, December 31, 2013

Owl GrandMonster Chess Engines Random Tournament 2013

Happy New Year to Al!

As the year 2013 was about to close, I decided to utilize my idle computers to do something different other than rating list production. What comes to mind was a 4 round robin tournament close to the semi-finals format in the recent TCEC LIve Chess Tournament. The participants were qualifiers in the Stage 4 such as Houdini, Stockfish, Komodo, Gull, Bouquet, Naum and selected Stage 3 qualifiers like Critter and Rybka. The versions used were the latest or the same as in TCEC except for Bouquet and Naum where the latest versions were not released by the authors.

The tournament was labeled "Random" because it was done in 3 computers with random components and different CPU cores. I just want to share to the readers that in a chess engine testing environment, there is a small chance of the similarity of results. It explains the phenomena that no Chess Engines Rating List Sites have the same rankings which confuses the casual observer, because no testing environment are the same and chess is naturally a random game. The time control of this tournament was 2 minutes base + 2 seconds increment and were conducted with only just one instance of tournament in every computer which is not regular in the Owl rating list production. This is not official and will not appear in the Owl Rating List.  

As expected, the 3 strongest engines like Houdini, Stockfish and Komodo were at the top, but accomplishing it was not straight forward. Houdini won 2 tournaments and placed #2 once, while Stockfish won 1 tournament, placed 2nd once and placed 3rd once,  Komodo was in #2 once, #3 once and #6 once. The only chess engine with constant place was Naum at #8 and the rest have varying places throughout the tournament.

Houdini is at its best in a tournament where there are not much threads or processes that are running simultaneously and with very short time controls as evidenced by the results. Stockfish is relatively strong in both multi-threads and short time control. Komodo shines in long time control with the best hardware configuration as proven in the recent TCEC Championship, but relatively weak in very short time control. Gull placed higher than Bouquet which is probably due to the older version of Bouquet used in the tournament. Critter, Rybka and Naum are in the usual places just like in the different rating list rankings.

Congratulations to Robert Houdart of Houdini for winning the Owl GrandMonster Chess Engines Random Tournament!

The results below are the aggregate statistics of the 3 separate tournaments.
Rank Engine ELO Raw Games Score% Points Win Loss Draw TF% Ply
1 Houdini 4 Pro x64 148 84 72.62 61.0 46 8 30 0.00 0
2 Stockfish_13123001_x64 90 84 63.69 53.5 36 13 35 0.00 0
3 Komodo TCEC x64 40 84 55.36 46.5 32 23 29 0.00 0
4 Gull R600 x64 29 84 54.76 46.0 27 19 38 2.38 51
5 Critter 1.6a x64 14 84 52.38 44.0 23 19 42 0.00 0
6 Rybka 4.1 x64 -31 84 44.64 37.5 16 25 43 0.00 0
7 Bouquet 1.8 x64 -61 84 39.88 33.5 12 29 43 0.00 0
8 Naum 4.2 x64 -230 84 16.67 14.0 5 61 18 0.00 0

.


Here are the 3 scoreboards of the tournament:

Owl GrandMonster Chess Engines Random Tournament 2013 A
RankEngineScoreStHoGuCrRyKoBoNaS-B
1Stockfish_13123001_x6418.5/28· ·· ·=01==1100==1==1==111101=11=1 234.50 
2Houdini 4 Pro x64 18.0/28=10=· ·· ·0==01=01=1=1=111=1==111= 224.00 
3Gull R600 x64 17.5/28=0011==1· ·· ·==0==0=1===110111111 219.50 
4Critter 1.6a x64 16.5/281==00=10==1=· ·· ·======11=10==111 212.25 
5Rybka 4.1 x64 13.0/28==0==0=0=1=0====· ·· ·1==01===01== 176.00 
6Komodo TCEC x64 11.0/28=000=000===0==000==1· ·· ·1=111010 137.75 
7Bouquet 1.8 x64 10.5/28010==0==0100=01=0===0=00· ·· ·==1= 147.75 
8Naum 4.2 x64 7.0/2800=0000=0000=00010==0101==0=· ·· · 90.25 


112 games played / Tournament finished

Level: Blitz 2/2
Hardware: AMD Phenom(tm) II X4 945 Processor with 2.0 GB Memory
Operating system: Windows 7 Ultimate Professional Service Pack 1 (Build 7601) 64 bit
Table created with: Arena 3.0
.

Owl GrandMonster Chess Engines Random Tournament 2013 B
RankEngineScoreHoStKoGuCrBoRyNaS-B
1Houdini 4 Pro x64 20.5/28· ·· ·==0=11==111=1=11==1=0=111111 256.75 
2Stockfish_13123001_x6417.0/28==1=· ·· ·==0===11======1==0101111 217.75 
3Komodo TCEC x64 16.0/2800====1=· ·· ·0=0==0101=0111111=11 194.50 
4Gull R600 x64 15.0/28000===001=1=· ·· ·=1=1=======1=1=1 187.50 
5Critter 1.6a x64 14.5/280=00=====101=0=0· ·· ·=====11=111= 176.25 
6Bouquet 1.8 x64 12.5/28==0===0=0=10========· ·· ·=====01= 172.25 
7Rybka 4.1 x64 11.5/281=00=1010000===0=00=====· ·· ·0111 150.25 
8Naum 4.2 x64 5.0/28000000000=00=0=0000==10=1000· ·· · 66.75 


112 games played / Tournament finished

Level: Blitz 2/2
Hardware: Intel (R) (TM) 2 CPU Processor with 2.0 GB Memory
Operating system: Windows 7 Ultimate Professional Service Pack 1 (Build 7601) 64 bit
Table created with: Arena 3.0


.
Owl GrandMonster Chess Engines Random Tournament 2013 C
RankEngineScoreHoKoStGuRyCrBoNaS-B
1Houdini 4 Pro x64 22.5/28· ·· ·=11=110=1111=1=11=1=10111111 275.00 
2Komodo TCEC x64 19.5/28=00=· ·· ·1=010=111=111=111=1==111 230.75 
3Stockfish_13123001_x6418.0/28001=0=10· ·· ·==1===01111=11011111 207.75 
4Gull R600 x64 13.5/2800001=00==0=· ·· ·0==1==1==10=1111 143.75 
5Rybka 4.1 x64 13.0/28=0=00=00==101==0· ·· ·===0=1==11=1 148.00 
6Critter 1.6a x64 13.0/280=0=0=00000===0====1· ·· ·=1111=11 137.75 
7Bouquet 1.8 x64 10.5/2801000=0=0010=01==0===000· ·· ·111= 120.00 
8Naum 4.2 x64 2.0/280000=0000000000000=00=00000=· ·· · 28.00 


112 games played / Tournament finished

evel: Blitz 2/2
Hardware: AMD Athlon (tm) II X2 250 Processor with 2.0 GB Memory
Operating system: Windows 7 Ultimate Professional Service Pack 1 (Build 7601) 64 bit
Table created with: Arena 3.0
.
Download the computer chess engines tournament games here.

Sunday, December 29, 2013

Smart 1.40 - Gauntlet Matches, 100 Rounds

Smart 1.40 is Winboard/UCI chess engine by Sergei Markoff released last November 11, 2013.

Smart 1.40 scored 38.86% with 277 wins, 522 losses and 301 draws against the selection of 11 strong chess engines. It registered 2662 ELO rating points and number 59 spot in the Top 100 Chess Engines List.

Here is the gauntlet scoreboard of Smart 1.40:

Rank Engine ELO Raw Games Score% Points Win Loss Draw Chg TF% Ply
1 Crab PGO x64 2868 129 100 76.50 76.5 67 14 19 -5 2.00 147
2 Booot 5.2.0 x64 2730 37 100 66.00 66.0 51 19 30 23 0.00 0
3 Minko Chess 1.3 x64 2714 37 100 65.50 65.5 52 21 27 23 0.00 0
4 Quazar 0.4 x64 2756 32 100 65.50 65.5 50 19 31 -3 0.00 0
5 Thinker 54D Inert x64 2751 32 100 65.00 65.0 51 21 28 -1 0.00 0
6 Onno 1.2.70 x64 2788 17 100 62.50 62.5 51 26 23 -15 0.00 0
7 Doch 1.3.4 x64 2752 16 100 62.50 62.5 51 26 23 0 0.00 0
8 DiscoCheck 5.1 x64 2714 11 100 62.50 62.5 46 21 33 18 1.00 201
9 Tinapa 1.01 x64 2860 1 100 61.00 61.0 45 23 32 -13 2.00 155
10 SmarThink 1.40 2662 -72 1100 38.86 427.5 277 522 301 2662 0.36 126
11 Chiron 1.1a x64 2648 -100 100 45.50 45.5 31 40 29 1 5.00 137
12 Tornado 4.88 x64 2640 -141 100 40.00 40.0 27 47 26 6 0.00 0
.
Download the computer chess engines tournament games here.

Note:  TF% = Time forfeit percentage
          Ply = Average moves of games lost by time forfeit   

Murka 3 x64 - Gauntlet Matches, 100 Rounds

Murka 3 x64 is a Winboard/UCI chess Engine by Igor Korshunov released last July 17, 2013.

Murka 3 scored 49.09% with 345 wins, 365 losses and 390 draws against the selection of 11 strong chess engines.  It gathered 2769 ELO rating points and number 44 in the Top 100 Chess Engines rating list.

Here is the gauntlet statistics of Murka 3:
Rank Engine ELO Raw Games Score% Points Win Loss Draw Chg TF% Ply
1 OpenCritter 1.1.37 x64 2933 169 100 76.00 76.0 58 6 36 -1 0.00 0
2 Tinapa 1.01 x64 2860 98 100 65.50 65.5 48 17 35 -13 4.00 54
3 Protector 1.5.0 x64 2870 81 100 63.00 63.0 45 19 36 -4 0.00 0
4 Crab PGO x64 2868 72 100 61.50 61.5 46 23 31 -5 5.00 53
5 Murka 3 x64 2769 -4 1100 49.09 540.0 345 365 390 2769 0.55 78
6 Doch 1.3.4 x64 2752 -6 100 50.00 50.0 32 32 36 0 3.00 93
7 Booot 5.2.0 x64 2730 -7 100 49.50 49.5 26 27 47 23 0.00 0
8 Quazar 0.4 x64 2756 -38 100 45.00 45.0 29 39 32 -3 3.00 119
9 Minko Chess 1.3 x64 2714 -43 100 44.00 44.0 25 37 38 23 0.00 0
10 Nemo 1.0.1b x64 2680 -53 100 42.00 42.0 21 37 42 17 0.00 0
11 Onno 1.2.70 x64 2788 -63 100 41.00 41.0 24 42 34 -15 0.00 0
12 Arasan 16.3 x64 2574 -206 100 22.50 22.5 11 66 23 12 5.00 191
.
Download the computer chess engines tournament games here.

Owl Computer Chess Engines Rating List #87

The 87th Owl Computer Chess Engines Rating List released, 12/30/2031.

View the full rating list here.

Thursday, December 26, 2013

Stockfish 131223 x64 - Gauntlet Matches 100 Rounds

Stockfish 131223 x64 is a developmental UCI chess engine by +Marco Costalba , +Joona Kiiski and +Tord Romstad released last December 23, 2013.

 Stockfish scored 70.6% with 1061 wins, 195 losses and 844 draws against the top 21 strongest computer chess engines. It posted a 3228 ELO rating points and maintained the number 1 position in the rating list.  Stockfish 131223 defeated all the best chess engines including the offficial Stockfish DD version, Houdini 4 and Komodo TCEC. It gained an incremental strength of 18 ELO points from the previous version and 41 ELO points advantage against the second ranked Houdini 4 in the Top 100 Chess Engines List.

Here is the gauntlet performance of Stockfish:

Rank Engine ELO Raw Games Score% Points Win Loss Draw Chg TF% Ply
1 Stockfish 131223 x64 3228 128 2100.00 70.6 1483 1061 195 844 3228 1.10 81
2 Stockfish DD x64 3210 108 100.00 46.0 46 8 16 76 0 2.00 38
3 Komodo TCEC x64 3166 72 100.00 40.5 40.5 15 34 51 0 1.00 76
4 Houdini 4 Pro x64 3187 58 100.00 39.0 39 20 42 38 -1 2.00 70
5 Gull R600 x64 3108 32 100.00 34.0 34 8 40 52 0 0.00 0
6 Bouquet 1.8 x64 3072 28 100.00 32.5 32.5 6 41 53 2 0.00 0
7 Robodini 1.1 x64 3096 16 100.00 33.0 33 16 50 34 0 2.00 77
8 Fire 3.0 x64 3071 14 100.00 31.5 31.5 9 46 45 1 0.00 0
9 PanChess 00.537 x64 3054 0 100.00 31.0 31 14 52 34 1 2.00 57
10 Critter 1.6a x64 3094 -2 100.00 29.5 29.5 10 51 39 0 3.00 101
11 Rybka 4.1 x64 3031 -3 100.00 30.5 30.5 14 53 33 1 1.00 197
12 Strelka 5.7 x64 3086 -6 100.00 30.0 30 15 55 30 0 1.00 31
13 ComStock 3 x64 3072 -9 100.00 27.5 27.5 4 49 47 1 1.00 82
14 RobboLito 0.21Q x64 3047 -32 100.00 26.5 26.5 11 58 31 0 5.00 54
15 RyanFish 1 x64 3070 -35 100.00 24.5 24.5 5 56 39 0 0.00 0
16 Samsung x64 3107 -35 100.00 26.0 26 10 58 32 -2 0.00 0
17 LEOpard 0.7c x64 3028 -42 100.00 24.5 24.5 7 58 35 0 2.00 63
18 Firenzina 2.4 xTreme x64 3059 -45 100.00 23.5 23.5 5 58 37 -1 1.00 82
19 Mars 1 x64 3062 -47 100.00 23.5 23.5 5 58 37 -1 0.00 0
20 Igorrit 0.086v9 x64 3048 -55 100.00 23.0 23 7 61 32 0 0.00 0
21 Ivanhoe 46h x64 3036 -64 100.00 21.5 21.5 4 61 35 0 2.00 138
22 Tactico Power 2011 x64 3030 -82 100.00 19.0 19 2 64 34 0 0.00 0
.
Download the computer chess engines tournament games here.

Note:  TF% = Time forfeit percentage
          Ply = Average moves of games lost by time forfeit   


Chessdom News