The Week in Chess

Saturday, August 31, 2013

Stockfish - The New Chess Engines Champion!

The TCEC Live Chess Engines Tournament started last August 26, 2013. It is an influential tournament that is considered to be the world championship of chess engines.  The participants were mostly from the previous tournament's season led by Houdini, Stockfish, Rybka and Komodo. Many of the chess engines participants were updated versions notably Stockfish and Komodo which were shown in the rating list sites to be gaining strength.

Based on statistics and personal assessment, I reckoned that Houdini, Stockfish and Komodo will figure prominently going into the finals. To forecast who will be the champion is everyone's personal choice, so I made my own unscientific way of predicting who will be the champion.

I decided to make a round robin tournament of 30 games each for the top 3 likely finalists such as Houdini, Stockfish and Komodo. Time control was 10 minutes base + 10 seconds increment which should be sufficient for an engine to think properly.  The tournament were conducted in the two available computers, an AMD Quad core and AMD Dual core with 4 gigabytes of RAM and running Windows 7. The usual tournament rules in my rating list applies such as opening book (Perfect 2012) moves up to 6 ply, draw in 120 move limit, adjudication as win above 900 centipawns, ponder off, no endgame tablebases. Time forfeit will be part of the game and no replays will be made. Arena ChessGui was used with all the chess engines settings reset to default but Stockfish and Komodo threads option were set to 4 in the quad core and 2 in the dual core computers as recommended.

Stockfish was represented with development version 130827, released just after a day the tournament was started. This was an arbitrary choice since Komodo had a development version entered in the tournament which was not publicly available for testing.

After the games were finished in two days, I hesitated to publish it because of too many time forfeits by Houdini against Komodo despite being conducted in a dual core computer with no other tournament running. But after seeing the initial scores of TCEC where Naum 4.2 lost by time forfeit to Exchess, I was encouraged to just do it because it was the unmodified actual score and chess engines somehow will have losses by time forfeit even with very long time controls. Anyway, this was just for fun.

Here are the individual results:

Stockfish 130827 x64 vs. Houdini 3 Pro x64 = 1-0
RankEngineScoreStHoS-B
1Stockfish 130827 x6418.5/30· ·· ·· ·13-6-11 212.75 
2Houdini 3 Pro x64 11.5/306-13-11· ·· ·· · 212.75 


Stockfish 130827 x64 vs. Komodo 5.1r2 x64 = 1-0
RankEngineScoreStKoS-B
1Stockfish 130827 x6416.0/30· ·· ··9-7-14 224.00 
2Komodo 5.1r2 x64 14.0/307-9-14· ·· ·· 224.00 


Houdini 3 Pro x64 vs. Komodo 5.1r2 x64 = 0-1
RankEngineScoreKoHoS-B
1Komodo 5.1r2 x64 18.0/30· ·· ·· ·11-5-14 216.00 
2Houdini 3 Pro x6412.0/305-11-14· ·· ·· · 216.00 


Here are the combined results:


Rank Engine Raw Games Score% Points Win Loss Draw TF% Ply
1 Stockfish 130827 x64 31 60 58 35 22 13 25 1.67 190
2 Komodo 5.1r2 x64 13 60 53 32 18 14 28 3.33 40
3 Houdini 3 Pro x64 -44 60 39 24 11 24 25 18.33 88
Note: TF% = Time forfeit percentage, Ply = Average ply (half-moves) duration of forfeited games.
  

Scoreboard:

Rank Engine ELO Games Points c1 c2 c3
1 Stockfish 130827 x64 31 60 34.5 *** 16.0 18.5
2 Komodo 5.1r2 x64 13 60 32.0 14.0 *** 18.0
3 Houdini 3 Pro x64 -44 60 23.5 11.5 12.0 ***


In summary, Stockfish won the tournament individually with 2 points, followed by Komodo with 1 and Houdini with 0.

Disclaimer:
This was just a tournament for statistical forecasting fun and is not directly related with the TCEC Live Tournament.  The final results may vary, but the results in this tournament serves as my forecast for the top finishers in the TCEC tournament.

Download the chess engines tournament games here.
.

Saturday, August 24, 2013

Owl Computer Chess Engines Rating List #64

The 64th Owl Computer Chess Engines Rating List #64 released, 08/24/2013.

The star of the show is the official release Stockfish version 4 by Marco Costalba, Tord Romstad, Joona Kiiski.

View the full rating list here.

Stockfish 4 x64 - Gauntlet Matches 100 Rounds

Stockfish 4 by +Marco Costalba+Tord Romstad+Joona Kiiski  is a UCI chess  engine released last August 20, 2013.

Stockfish 4 x64 scored 63.16% with 796 wins, 296 losses, 808 draws against the 19 strongest chess engines in a 100 round gauntlet matches. Stockfish won all the matches with an ELO Rating performance of 3169 which is good for the 2nd place in the Top 100 Strongest Chess Engines list. Houdini 3 Pro is still number 1 because of its deadly scoring power against the weaker opposition in this short time control rating list site.

The previous Stockfish 130801 development version was removed to reduce clutter.  Stockfish 4 coincidentally has the same ELO rating as Stockfish 130801 with 36 points increase from the previous official Stockfish version 3.

Here is the gauntlet performance of Stockfish 4.
Rank Engine ELO Raw Games Score% Points Win Loss Draw Chg TF% Ply
1 Stockfish 4 x64 3169 78 1900 63.16 1200.0 796 296 808 3169 1.53 86
2 Houdini 3 Pro x64 3187 66 100 48.00 48.0 24 28 48 0 3 105
3 Critter 1.6a x64 3104 40 100 44.00 44.0 24 36 40 0 1 170
4 Komodo 5.1r2 x64 3100 30 100 42.00 42.0 20 36 44 1 2 92
5 Mars 1 x64 3081 17 100 40.00 40.0 18 38 44 1 0 0
6 ComStock 3 x64 3083 11 100 38.50 38.5 11 34 55 1 0 0
7 Bouquet 1.7b x64 3082 6 100 38.50 38.5 17 40 43 0 5 84
8 RyanFish 1 x64 3086 4 100 37.50 37.5 12 37 51 0 3 47
9 Robodini 1.1 x64 3107 4 100 38.50 38.5 20 43 37 0 2 44
10 PanChess 00.537 x64 3072 2 100 38.00 38.0 20 44 36 2 2 57
11 Gull 2.2 x64 3094 0 100 37.50 37.5 16 41 43 0 3 78
12 Firenzina 2.3.1 xTreme x64 3072 -7 100 36.50 36.5 17 44 39 0 2 51
13 LEOpard 0.7c x64 3045 -8 100 36.00 36.0 14 42 44 1 4 90
14 Rybka 4.1 x64 3039 -18 100 34.50 34.5 12 43 45 2 0 0
15 RobboLito 0.21Q x64 3065 -19 100 34.50 34.5 14 45 41 -1 3 63
16 Fire 2.2 xTreme x64 3069 -24 100 34.00 34.0 15 47 38 -1 2 53
17 Tactico Power 2011 x64 3044 -27 100 32.00 32.0 7 43 50 0 3 73
18 Strelka 5.5 x64 3054 -37 100 32.50 32.5 15 50 35 1 2 68
19 Igorrit 0.086v9 x64 3072 -42 100 31.00 31.0 11 49 40 -1 1 37
20 Ivanhoe 46h x64 3052 -77 100 26.50 26.5 9 56 35 -1 11 109
.
Download the computer chess engines tournament games here.

Tuesday, August 20, 2013

Gull 2.2 x64 - Gauntlet Matches, 100 Rounds

Gull 2.2 x64 by Vadim Demichev, is a UCI chess engine originally derived from Ivanhoe but has morphed into an engine that has no resemblance from its origins.

Gull 2.2 scored 52.03% with 584 wins, 503 losses and 913 draws earning 3094 ELO Rating points in the 100 rounds gauntlet matches against the strongest chess engines. It defeated higher ranked engines like Ryanfish 1, ComStock 3, drew with Robodini 1.1, Mars 1 and won the matches with the other 10 strong engines. With the impressive performance, it jumped from #15th rank to #6, gaining 39 ELO points increase.

The impressive performance of Gull 2.2 maybe gauged from the release notes:
    - Improved king safety evaluation.
    - Quadratic PST optimized with the use of automated tuning.
    - Several SMP bugs fixed.
    - Time management bug (pondering mode) fixed.



Rank Engine ELO Raw Games Score% Points Win Loss Draw Chg TF% Ply
1 Stockfish 130801 x64 3169 82 100 60.50 60.5 45 24 31 0 2.0 124
2 Houdini 3 Pro x64 3187 67 100 58.00 58.0 43 27 30 0 2.0 26
3 Critter 1.6a x64 3104 46 100 56.00 56.0 34 22 44 1 0.0 0
4 Komodo 5.1r2 x64 3099 21 100 51.50 51.5 30 27 43 1 3.0 74
5 Bouquet 1.7b x64 3082 17 100 51.00 51.0 27 25 48 0 3.0 117
6 Robodini 1.1 x64 3107 13 100 50.00 50.0 25 25 50 0 1.0 184
7 Mars 1 x64 3080 12 100 50.00 50.0 26 26 48 0 0.0 0
8 Gull 2.2 x64 3094 11 2000 52.03 1040.5 584 503 913 3094 1.7 77
9 Tactico Power 2011 x64 3044 6 100 49.00 49.0 25 27 48 1 4.0 127
10 Rybka 4.1 x64 3037 4 100 49.00 49.0 25 27 48 0 0.0 0
11 Gull 2.1 x64 3056 3 100 48.50 48.5 20 23 57 1 0.0 0
12 RobboLito 0.21Q x64 3066 0 100 48.00 48.0 19 23 58 0 2.0 56
13 Firenzina 2.3.1 xTreme x64 3072 -8 100 47.00 47.0 24 30 46 0 0.0 0
14 RyanFish 1 x64 3086 -12 100 46.00 46.0 23 31 46 -1 0.0 0
15 PanChess 00.537 x64 3070 -14 100 46.00 46.0 19 27 54 0 1.0 110
16 ComStock 3 x64 3082 -22 100 44.50 44.5 21 32 47 -1 1.0 109
17 Strelka 5.5 x64 3053 -23 100 44.00 44.0 20 32 48 0 1.0 49
18 Fire 2.2 xTreme x64 3070 -28 100 43.50 43.5 21 34 45 0 2.0 173
19 Ivanhoe 46h x64 3053 -46 100 41.00 41.0 19 37 44 0 8.0 120
20 LEOpard 0.7c x64 3044 -58 100 39.50 39.5 22 43 35 -1 5.0 118
21 Igorrit 0.086v9 x64 3073 -72 100 36.50 36.5 15 42 43 -2 0.0 0
.
Download the computer chess engines tournament games here.

Chessdom News