The Week in Chess

Monday, August 27, 2018

ShashChess 180822: Tal, Petrosian & Capablanca Rumble

The last post showed that Shash is not stronger than most of Stockfish clones including the original. I was curious how the famous world champions strength are translated by making a separate compile for each character and then mix each one. 

The results are interesting: Petrosian ranks higher than Tal and Capablanca. Overall, the combination of Tal + Petrosian scored the highest, beating the default Shash character by 1.25% ELO.

This is not the ultimate ranking for Shash but just a snapshot of how its characters strength manifest in a small tournament. It needs to have more rounds to have a definite conclusion. But even so, I can be sure that Capablanca's style is the weakest with a huge difference in ELO rating of 46.15% from the second last placer. 

Tournament conditions:
Tournament manager: cutechess-cli 1.0
Time control: 60/60+1

Time margin: 1 second
Option.Threads: 1 
Opening: 100 positions
Rounds: 200, repeat each position for black and white
Win score: 200
Draw score: 20 

Concurrency: 32

Rank Chess Engine ELO Games Score%  Win%  Draw% Loss%
1 Shash 180822 TalPet  20.30 1400 53.29 25.50 55.60 18.90
2 Shash 180822 default  12.59 1400 52.04 22.93 58.20 18.87
3 Shash 180822 CapPet  10.83 1400 51.75 24.00 55.50 20.50
4 Shash 180822 Petrosian  10.17 1400 51.64 22.71 57.90 19.39
5 Shash 180822 TalCap  7.53 1400 51.21 24.07 54.30 21.63
6 Shash 180822 TalCapPet  0.93 1400 50.14 23.07 54.10 22.83
7 Shash 180822 Tal  -8.09 1400 48.68 22.29 52.80 24.91
8 Shash 180822 Capablanca  -54.26 1400 41.25 14.21 54.10 31.69
 

Download the Shash 180822 engines here. 
Download the tournament games here.

Tuesday, August 21, 2018

Stockfish 18081801 vs. Clones


The last Stockfish vs. Clones tournament was primarily an experiment using the cutechess tournament manager. I was intrigued that cutechess could handle 16 concurrent matches very easily without noticeable degradation of the responsiveness with the computer which is an old AMD Athlon with 4 cores and 16GB RAM. It was ran under the latest PCLinuxOS without a single time forfeit. The previous tournament manager I used was Arena 3.5.1 which could handle about 7 concurrent games and beyond that the computer become sluggish resulting numerous time forfeits. I doubled the concurrency to 32 and still it ran without sluggishness and time forfeits. Perhaps it could run 64 concurrencies...

The other significant change was the use of cross-compiler under Ubuntu 18.04 with mingw version 7.3. This was the system used by abrok.eu to compile Stockfish which was faster than the one I made under Windows/mingw. I discovered that it could accept the -flto option which does not run under Windows. The resulting benchmark is faster using the cross-compiler and made CFish overtake Stockfish in the ranking. Official CFish does not come with an executable so I made one from the Ubuntu cross-compiler. The other clones were using their own executables which were probably optimized by their respective authors.

There were two new entrants in the tournament, namely CorChess and ShashChess. The other change was the use of the later versions of Stockfish, Brainfish and Raubfisch.

The higher concurrency of 32 made me double the number of rounds from 100 to 200 for greater statistical accuracy. The 10 man round-robin tournament with 200 games each was finished in approximately 16 hours using only 1 computer. This amazed me for it will take a very long time to finish with the Arena GUI.

This is the tournament condition:
Time control: 60 moves in 60 seconds base + 1 second increment
Time margin: 1 second
Option.Threads: 1
Resign score: 200 cp
Draw score: 20 cp after 40 moves
Concurrency: 32
Book: 100 variations, 2 moves deep, alternating

Tournament result with 0 based rating:

Rank Chess Engine ELO Games Score%  Win%  Draw% Loss%
1 Asm Fish 180722 x64  26.94 1800 54.25 23.28 61.90 14.82
2 CFish 180819 x64  23.06 1800 53.64 23.28 60.70 16.02
3 Brain Fish 180818 x64  19.88 1800 53.14 22.00 62.30 15.70
4 Stockfish 18081801 x64  11.25 1800 51.78 21.44 60.70 17.86
5 Shark 180818 x64  6.85 1800 51.08 20.33 61.50 18.17
6 Raubfisch X38e x64  -8.09 1800 48.72 18.22 61.00 20.78
7 McBrain 9.6 x64  -14.95 1800 47.64 16.61 62.10 21.29
8 Cor Chess 2.5 x64  -16.18 1800 47.44 15.94 63.00 21.06
9 Shash 180820 x64  -24.12 1800 46.19 14.94 62.50 22.56
10 Sugar XPro 1.5.3 x64  -24.65 1800 46.11 17.11 58.00 24.89

Download the tournament games here.

Saturday, August 11, 2018

Stockfish 180729 vs. Clones


After some time of relative quiet, I decided to make a tournament for the purpose of knowing the current relative strength of Stockfish against its many clones.

I choose the better known SF clones which are in step with the latest version of Stockfish. To my surprise, Stockfish came in second behind the assembler based AsmFish and stood higher than the other SF clones which are supposedly made to surpass the original. But I suspect that the reason why Stockfish 180729 is stronger than most is because it was made by Abrok which I found to have strong compiles lately.

The tournament was a round robin with 100 games against each other.
Here are the  tournament settings:
Tournament manager: cutechess linux version
Book: custom book of 50 variations with 2 moves depth derived from the most common opening of different book sources.
Time control: 60 moves in 60 seconds base + 1 second increment, repeating
Win rule: 200 cp
Draw rule: 15 cp after 40 moves
Computer used: AMD Athlon, 4 cores, 16GB ram
Option.Threads: 1
Concurrency: 16

Rank Chess Engine ELO Games Score%  Win%  Draw% Loss%
1 Asm Fish 180723 x64  22.88 700 53.71 19.43 68.60 11.97
2 Stockfish 180729 x64  11.87 700 51.93 18.43 67.00 14.57
3 CFish 180730 x64  9.67 700 51.57 18.29 66.60 15.11
4 Shark 180729 x64  9.67 700 51.57 17.29 68.60 14.11
5 Brain Fish 180728 x64  3.08 700 50.50 18.00 65.00 17.00
6 Raubfisch X38d3b x64  -3.51 700 49.43 18.00 62.90 19.10
7 McBrain 9.6 x64  -26.39 700 45.71 12.57 66.30 21.13
8 Sugar XPro 1.5.3 x64  -27.27 700 45.57 14.71 61.70 23.59

Download the gauntlet PGN games here.

Friday, August 10, 2018

Arasan 21.0 vs. Top Chess Engines


Rank Chess Engine ELO Games Score%  Win%  Draw% Loss%
1 Stockfish 9 x64  3829.84 100 99.00 98.00 2.00 0.00
2 Houdini 6.02 x64  3633.74 100 97.00 94.00 6.00 0.00
3 Komodo 11.2.2 x64  3464.84 100 92.50 85.00 15.00 0.00
4 Fire 7.1 x64  3390.96 100 89.00 82.00 14.00 4.00
5 Andscacs 0.94 x64  3321.77 100 84.50 78.00 13.00 9.00
6 Ethereal 10.55 x64  3308.73 100 83.50 71.00 25.00 4.00
7 Gull 3 x64  3296.31 100 82.50 71.00 23.00 6.00
8 Shredder 13 x64  3290.30 100 82.00 70.00 24.00 6.00
9 Fritz 15 x64  3226.57 100 76.00 58.00 36.00 6.00
10 Laser 1.6 x64  3217.10 100 75.00 59.00 32.00 9.00
11 Critter 1.6a x64  3212.46 100 74.50 62.00 25.00 13.00
12 Booot 6.3.1 x64  3203.35 100 73.50 53.00 41.00 6.00
13 Texel 1.07 x64  3164.79 100 69.00 53.00 32.00 15.00
14 Hannibal 1.7 x64  3156.67 100 68.00 49.00 38.00 13.00
15 Xiphos 0.3.5 x64  3152.66 100 67.50 47.00 41.00 12.00
16 Pedone 1.8 x64  3148.68 100 67.00 47.00 40.00 13.00
17 Equinox 3.30 x64  3133.06 100 65.00 48.00 34.00 18.00
18 Nirvana 2.4 x64  3129.22 100 64.50 46.00 37.00 17.00
19 Senpai 2.0 x64  3117.84 100 63.00 45.00 36.00 19.00
20 Protector 1.9.0 x64  3110.36 100 62.00 45.00 34.00 21.00
21 ICE 3.0.658 x64  3099.29 100 60.50 46.00 29.00 25.00
22 Fizbo 2.0 x64  3091.99 100 59.50 49.00 21.00 30.00
23 Smarthink 1.98 x64  3031.59 100 51.00 43.00 16.00 41.00
24 Arasan 21.0 x64  3024.57 2500 28.06 14.48 27.20 58.32
25 Naum 4.6 x64  3000.00 100 46.50 28.00 37.00 35.00
26 Nemorino 5.00 x64  2996.48 100 46.00 32.00 28.00 40.00

Download the gauntlet tournament PGN games here.

Tuesday, August 7, 2018

Pedone 1.8 vs. Top Chess Engines


Rank Chess Engine ELO Games Score%  Win%  Draw% Loss%
1 Stockfish 9 x64  3590.71 100 95.00 90.00 10.00 0.00
2 Houdini 6.02 x64  3590.71 100 95.00 90.00 10.00 0.00
3 Komodo 11.2.2 x64  3459.76 100 90.00 84.00 12.00 4.00
4 Fire 7.1 x64  3441.10 100 89.00 79.00 20.00 1.00
5 Ethereal 10.55 x64  3306.90 100 79.00 66.00 26.00 8.00
6 Shredder 13 x64  3291.45 100 77.50 58.00 39.00 3.00
7 Andscacs 0.94 x64  3231.62 100 71.00 54.00 34.00 12.00
8 Fritz 15 x64  3231.62 100 71.00 57.00 28.00 15.00
9 Xiphos 0.3.5 x64  3206.81 100 68.00 50.00 36.00 14.00
10 Laser 1.6 x64  3198.82 100 67.00 47.00 40.00 13.00
11 Equinox 3.30 x64  3194.87 100 66.50 44.00 45.00 11.00
12 Fizbo 2.0 x64  3183.20 100 65.00 54.00 22.00 24.00
13 Critter 1.6a x64  3167.98 100 63.00 37.00 52.00 11.00
14 Booot 6.3.1 x64  3167.98 100 63.00 40.00 46.00 14.00
15 Senpai 2.0 x64  3156.79 100 61.50 39.00 45.00 16.00
16 Nirvana 2.4 x64  3145.77 100 60.00 36.00 48.00 16.00
17 Texel 1.07 x64  3127.69 100 57.50 39.00 37.00 24.00
18 ICE 3.0.658 x64  3095.77 100 53.00 34.00 38.00 28.00
19 Gull 3 x64  3092.25 100 52.50 32.00 41.00 27.00
20 Hannibal 1.7 x64  3074.71 100 50.00 31.00 38.00 31.00
21 Pedone 1.8 x64  3074.71 2400 34.81 17.42 34.80 47.78
22 Protector 1.9.0 x64  3039.55 100 45.00 19.00 52.00 29.00
23 Nemorino 5.00 x64  3036.00 100 44.50 23.00 43.00 34.00
24 Smarthink 1.98 x64  3010.93 100 41.00 26.00 30.00 44.00
25 Naum 4.6 x64  3000.00 100 39.50 18.00 43.00 39.00

Download the gauntlet tournament PGN games here.

Smarthink 1.98 vs. Top Chess Engines


Rank Chess Engine ELO Games Score%  Win%  Draw% Loss%
1 Stockfish 9 x64  3488.47 100 93.00 88.00 10.00 2.00
2 Komodo 11.2.2 x64  3440.62 100 91.00 85.00 12.00 3.00
3 Fire 7.1 x64  3430.18 100 90.50 86.00 9.00 5.00
4 Houdini 6.02 x64  3430.18 100 90.50 84.00 13.00 3.00
5 Ethereal 10.55 x64  3289.27 100 81.00 69.00 24.00 7.00
6 Shredder 13 x64  3283.63 100 80.50 66.00 29.00 5.00
7 Gull 3 x64  3251.90 100 77.50 68.00 19.00 13.00
8 Andscacs 0.94 x64  3237.17 100 76.00 63.00 26.00 11.00
9 Laser 1.6 x64  3227.69 100 75.00 63.00 24.00 13.00
10 Xiphos 0.3.5 x64  3200.68 100 72.00 61.00 22.00 17.00
11 Equinox 3.30 x64  3187.84 100 70.50 56.00 29.00 15.00
12 Booot 6.3.1 x64  3183.65 100 70.00 52.00 36.00 12.00
13 Fritz 15 x64  3183.65 100 70.00 58.00 24.00 18.00
14 Critter 1.6a x64  3171.30 100 68.50 57.00 23.00 20.00
15 Fizbo 2.0 x64  3151.40 100 66.00 52.00 28.00 20.00
16 Texel 1.07 x64  3128.43 100 63.00 50.00 26.00 24.00
17 Hannibal 1.7 x64  3120.96 100 62.00 49.00 26.00 25.00
18 Nirvana 2.4 x64  3091.73 100 58.00 42.00 32.00 26.00
19 Senpai 2.0 x64  3070.33 100 55.00 45.00 20.00 35.00
20 Protector 1.9.0 x64  3038.67 100 50.50 38.00 25.00 37.00
21 Smarthink 1.98 x64  3035.17 2300 30.30 18.57 23.50 57.93
22 Nemorino 5.00 x64  3031.66 100 49.50 37.00 25.00 38.00
23 ICE 3.0.658 x64  3021.14 100 48.00 37.00 22.00 41.00
24 Naum 4.6 x64  3000.00 100 45.00 27.00 36.00 37.00

Download the gauntlet tournament PGN games here.

Chessdom News