The Week in Chess

Friday, October 12, 2018

Arasan 21.1 vs. Top Chess Engines


Rank Chess Engine ELO Games Score%  Win%  Draw% Loss% Author
1 Stockfish 9 x64  3705.80 100 97.50 95.00 5.00 0.00 Romstad, Costalba, Kiiski, Linscott
2 Houdini 6.02 x64  3645.03 100 96.50 94.00 5.00 1.00 Robert Houdart
3 Komodo 11.2.2 x64  3448.83 100 90.00 82.00 16.00 2.00 Dailey, Kaufman,Lefler
4 Fire 7.1 x64  3374.73 100 85.50 76.00 19.00 5.00 Norman Schmidt
5 Ethereal 11.0 x64  3347.94 100 83.50 73.00 21.00 6.00 Andrew Grant
6 Shredder 13 x64  3335.52 100 82.50 71.00 23.00 6.00 Stefan Meyer-Kahlen
7 Xiphos 0.4 x64  3312.25 100 80.50 68.00 25.00 7.00 Milos Tatarevic
8 Gull 3 x64  3295.97 100 79.00 68.00 22.00 10.00 Vadim Demichev
9 Booot 6.3.1 x64  3229.29 100 72.00 58.00 28.00 14.00 Alex Morozov
10 Andscacs 0.94 x64  3220.69 100 71.00 62.00 18.00 20.00 Daniel Jose Queralto
11 Equinox 3.30 x64  3216.46 100 70.50 54.00 33.00 13.00 Colli, Rocchi
12 Critter 1.6a x64  3183.94 100 66.50 48.00 37.00 15.00 Richard Vida
13 Nirvana 2.4 x64  3168.43 100 64.50 45.00 39.00 16.00 Thomas Kolarik
14 Senpai 2.0 x64  3164.61 100 64.00 47.00 34.00 19.00 Fabien Letouzey
15 Hannibal 1.7 x64  3149.57 100 62.00 47.00 30.00 23.00 Sam Hamilton, Edsel Apostol
16 Texel 1.07 x64  3149.57 100 62.00 44.00 36.00 20.00 Peter Osterlund
17 Laser 1.6 x64  3123.95 100 58.50 41.00 35.00 24.00 Jeffrey An, Michael An
18 Pedone 1.8 x64  3113.18 100 57.00 43.00 28.00 29.00 Fabio Gobbato
19 ICE 3.0.658 x64  3106.04 100 56.00 42.00 28.00 30.00 Thomas Petzke
20 Smarthink 1.98 x64  3098.95 100 55.00 42.00 26.00 32.00 Sergei Markoff
21 Fritz 15 x64  3098.95 100 55.00 36.00 38.00 26.00 Chessbase
22 Fizbo 2.0 x64  3084.84 100 53.00 44.00 18.00 38.00 Youri Matiounine
23 Arasan 21.1 x64  3063.78 2500 32.08 18.72 26.70 54.58 Jon Dart
24 Protector 1.9.0 x64  3056.77 100 49.00 35.00 28.00 37.00 Raimund Heid
25 Nemorino 5.00 x64  3035.68 100 46.00 29.00 34.00 37.00 Christian Gunther
26 Naum 4.6 x64  3000.00 100 41.00 20.00 42.00 38.00 Aleksandar Naumov

Download the gauntlet tournament games here.

Wednesday, September 26, 2018

XIphos 0.4 vs. Top Chess Engines


Rank Chess Engine ELO Games Score%  Win%  Draw% Loss% Author
1 Stockfish 9 x64  3503.92 100 82.50 65.00 35.00 0.00 Romstad, Costalba, Kiiski, Linscott
2 Houdini 6.02 x64  3475.12 100 80.00 62.00 36.00 2.00 Robert Houdart
3 Komodo 11.2.2 x64  3356.29 100 67.00 47.00 40.00 13.00 Dailey, Kaufman,Lefler
4 Fire 7.1 x64  3340.67 100 65.00 41.00 48.00 11.00 Norman Schmidt
5 Shredder 13 x64  3263.81 100 54.50 30.00 49.00 21.00 Stefan Meyer-Kahlen
6 Ethereal 11.0 x64  3239.20 100 51.00 29.00 44.00 27.00 Andrew Grant
7 Xiphos 0.4 x64  3232.19 2400 59.35 41.88 35.00 23.12 Milos Tatarevic
8 Andscacs 0.94 x64  3228.68 100 49.50 31.00 37.00 32.00 Daniel Jose Queralto
9 Gull 3 x64  3179.21 100 42.50 31.00 23.00 46.00 Vadim Demichev
10 Booot 6.3.1 x64  3175.62 100 42.00 14.00 56.00 30.00 Alex Morozov
11 Laser 1.6 x64  3135.15 100 36.50 15.00 43.00 42.00 Jeffrey An, Michael An
12 Critter 1.6a x64  3131.36 100 36.00 21.00 30.00 49.00 Richard Vida
13 Fritz 15 x64  3127.54 100 35.50 14.00 43.00 43.00 Chessbase
14 ICE 3.0.658 x64  3108.08 100 33.00 17.00 32.00 51.00 Thomas Petzke
15 Nirvana 2.4 x64  3100.09 100 32.00 16.00 32.00 52.00 Thomas Kolarik
16 Texel 1.07 x64  3096.05 100 31.50 13.00 37.00 50.00 Peter Osterlund
17 Senpai 2.0 x64  3087.85 100 30.50 14.00 33.00 53.00 Fabien Letouzey
18 Equinox 3.30 x64  3083.70 100 30.00 14.00 32.00 54.00 Colli, Rocchi
19 Fizbo 2.0 x64  3079.51 100 29.50 22.00 15.00 63.00 Youri Matiounine
20 Pedone 1.8 x64  3053.41 100 26.50 10.00 33.00 57.00 Fabio Gobbato
21 Hannibal 1.7 x64  3053.41 100 26.50 7.00 39.00 54.00 Sam Hamilton, Edsel Apostol
22 Protector 1.9.0 x64  3048.89 100 26.00 11.00 30.00 59.00 Raimund Heid
23 Nemorino 5.00 x64  3030.19 100 24.00 10.00 28.00 62.00 Christian Gunther
24 Smarthink 1.98 x64  3020.44 100 23.00 11.00 24.00 65.00 Sergei Markoff
25 Naum 4.6 x64  3000.00 100 21.00 11.00 20.00 69.00 Aleksandar Naumov

Download the gauntlet tournament games here.

Tuesday, September 11, 2018

Ethereal 11.0 vs. Top Chess Engines


Rank Chess Engine ELO Games Score%  Win%  Draw% Loss% Author
1 Stockfish 9 x64  3443.68 100 77.50 58.00 39.00 3.00 T. Romstad, M. Costalba, J. Kiiski, G. Linscott
2 Houdini 6.02 x64  3401.25 100 73.00 55.00 36.00 9.00 Robert Houdart
3 Komodo 11.2.2 x64  3383.86 100 71.00 51.00 40.00 9.00 Don Dailey, Larry Kaufman, Mark Lefler
4 Fire 7.1 x64  3283.51 100 58.00 33.00 50.00 17.00 Norman Schmidt
5 Shredder 13 x64  3255.05 100 54.00 28.00 52.00 20.00 Stefan Meyer-Kahlen
6 Ethereal 11.0 x64  3226.95 2400 62.33 45.29 34.10 20.61 Andrew Grant
7 Andscacs 0.94 x64  3191.78 100 45.00 24.00 42.00 34.00 Daniel Jose Queralto
8 Xiphos 0.3.5 x64  3163.17 100 41.00 27.00 28.00 45.00 Milos Tatarevic
9 Booot 6.3.1 x64  3133.68 100 37.00 13.00 48.00 39.00 Alex Morozov
10 Laser 1.6 x64  3122.30 100 35.50 14.00 43.00 43.00 Jeffrey An, Michael An
11 Gull 3 x64  3118.47 100 35.00 13.00 44.00 43.00 Vadim Demichev
12 Fizbo 2.0 x64  3106.79 100 33.50 27.00 13.00 60.00 Youri Matiounine
13 Hannibal 1.7 x64  3086.73 100 31.00 11.00 40.00 49.00 Sam Hamilton, Edsel Apostol
14 Texel 1.07 x64  3082.62 100 30.50 15.00 31.00 54.00 Peter Osterlund
15 Equinox 3.30 x64  3082.62 100 30.50 12.00 37.00 51.00 Giancarlo Delli Colli and, formerly, Stefano Rocchi
16 Nirvana 2.4 x64  3078.47 100 30.00 15.00 30.00 55.00 Thomas Kolarik
17 Critter 1.6a x64  3074.27 100 29.50 11.00 37.00 52.00 Richard Vida
18 Senpai 2.0 x64  3074.27 100 29.50 13.00 33.00 54.00 Fabien Letouzey
19 ICE 3.0.658 x64  3074.27 100 29.50 16.00 27.00 57.00 Thomas Petzke
20 Fritz 15 x64  3029.72 100 24.50 8.00 33.00 59.00 Chessbase
21 Pedone 1.8 x64  3029.72 100 24.50 8.00 33.00 59.00 Fabio Gobbato
22 Nemorino 5.00 x64  3020.11 100 23.50 13.00 21.00 66.00 Christian Gunther
23 Naum 4.6 x64  3000.00 100 21.50 13.00 17.00 70.00 Aleksandar Naumov
24 Smarthink 1.98 x64  2989.44 100 20.50 12.00 17.00 71.00 Sergei Markoff
25 Protector 1.9.0 x64  2967.09 100 18.50 5.00 27.00 68.00 Raimund Heid

Download the gauntlet PGN games here.

Monday, August 27, 2018

ShashChess 180822: Tal, Petrosian & Capablanca Rumble

The last post showed that Shash is not stronger than most of Stockfish clones including the original. I was curious how the famous world champions strength are translated by making a separate compile for each character and then mix each one. 

The results are interesting: Petrosian ranks higher than Tal and Capablanca. Overall, the combination of Tal + Petrosian scored the highest, beating the default Shash character by 1.25% ELO.

This is not the ultimate ranking for Shash but just a snapshot of how its characters strength manifest in a small tournament. It needs to have more rounds to have a definite conclusion. But even so, I can be sure that Capablanca's style is the weakest with a huge difference in ELO rating of 46.15% from the second last placer. 

Tournament conditions:
Tournament manager: cutechess-cli 1.0
Time control: 60/60+1

Time margin: 1 second
Option.Threads: 1 
Opening: 100 positions
Rounds: 200, repeat each position for black and white
Win score: 200
Draw score: 20 

Concurrency: 32

Rank Chess Engine ELO Games Score%  Win%  Draw% Loss%
1 Shash 180822 TalPet  20.30 1400 53.29 25.50 55.60 18.90
2 Shash 180822 default  12.59 1400 52.04 22.93 58.20 18.87
3 Shash 180822 CapPet  10.83 1400 51.75 24.00 55.50 20.50
4 Shash 180822 Petrosian  10.17 1400 51.64 22.71 57.90 19.39
5 Shash 180822 TalCap  7.53 1400 51.21 24.07 54.30 21.63
6 Shash 180822 TalCapPet  0.93 1400 50.14 23.07 54.10 22.83
7 Shash 180822 Tal  -8.09 1400 48.68 22.29 52.80 24.91
8 Shash 180822 Capablanca  -54.26 1400 41.25 14.21 54.10 31.69
 

Download the Shash 180822 engines here. 
Download the tournament games here.

Tuesday, August 21, 2018

Stockfish 18081801 vs. Clones


The last Stockfish vs. Clones tournament was primarily an experiment using the cutechess tournament manager. I was intrigued that cutechess could handle 16 concurrent matches very easily without noticeable degradation of the responsiveness with the computer which is an old AMD Athlon with 4 cores and 16GB RAM. It was ran under the latest PCLinuxOS without a single time forfeit. The previous tournament manager I used was Arena 3.5.1 which could handle about 7 concurrent games and beyond that the computer become sluggish resulting numerous time forfeits. I doubled the concurrency to 32 and still it ran without sluggishness and time forfeits. Perhaps it could run 64 concurrencies...

The other significant change was the use of cross-compiler under Ubuntu 18.04 with mingw version 7.3. This was the system used by abrok.eu to compile Stockfish which was faster than the one I made under Windows/mingw. I discovered that it could accept the -flto option which does not run under Windows. The resulting benchmark is faster using the cross-compiler and made CFish overtake Stockfish in the ranking. Official CFish does not come with an executable so I made one from the Ubuntu cross-compiler. The other clones were using their own executables which were probably optimized by their respective authors.

There were two new entrants in the tournament, namely CorChess and ShashChess. The other change was the use of the later versions of Stockfish, Brainfish and Raubfisch.

The higher concurrency of 32 made me double the number of rounds from 100 to 200 for greater statistical accuracy. The 10 man round-robin tournament with 200 games each was finished in approximately 16 hours using only 1 computer. This amazed me for it will take a very long time to finish with the Arena GUI.

This is the tournament condition:
Time control: 60 moves in 60 seconds base + 1 second increment
Time margin: 1 second
Option.Threads: 1
Resign score: 200 cp
Draw score: 20 cp after 40 moves
Concurrency: 32
Book: 100 variations, 2 moves deep, alternating

Tournament result with 0 based rating:

Rank Chess Engine ELO Games Score%  Win%  Draw% Loss%
1 Asm Fish 180722 x64  26.94 1800 54.25 23.28 61.90 14.82
2 CFish 180819 x64  23.06 1800 53.64 23.28 60.70 16.02
3 Brain Fish 180818 x64  19.88 1800 53.14 22.00 62.30 15.70
4 Stockfish 18081801 x64  11.25 1800 51.78 21.44 60.70 17.86
5 Shark 180818 x64  6.85 1800 51.08 20.33 61.50 18.17
6 Raubfisch X38e x64  -8.09 1800 48.72 18.22 61.00 20.78
7 McBrain 9.6 x64  -14.95 1800 47.64 16.61 62.10 21.29
8 Cor Chess 2.5 x64  -16.18 1800 47.44 15.94 63.00 21.06
9 Shash 180820 x64  -24.12 1800 46.19 14.94 62.50 22.56
10 Sugar XPro 1.5.3 x64  -24.65 1800 46.11 17.11 58.00 24.89

Download the tournament games here.

Chessdom News