The Week in Chess

Monday, April 29, 2019

Stockfish 19042419 vs. McCain x3


This is a special match between Stockfish and McCain. The previous Stockfish vs. Clones tests showed that McCain was always below Stockfish in rank. My confidence with the strength tests was shaken when McCain was the clear winner in the recent similar test conducted with the author of McCain. To eliminate the unnecessary rating noise, I decided to make a one on one death match between the two engines. Instead of 100 rounds, I made a longer 800 rounds which is the result of using the 400 positions root opening moves at 2 ply depth with both engines repeating the same position alternately. Effectively, all the first 2 moves combination are used which include many seldom seen moves like 1.  a3 a6. This also fit with my aim of collecting of games which had all these 400 root positions covered.

The tournament conditions are as follows:
Time control: 1 minute base + 1 second increment
Opening: all 400 root positions at 2 ply depth
Resign score: 200cp
Draw score: 20cp after 40 moves
Concurrency: 10 threads
Rounds: 800 with alternating colors

The Stockfish 19042419 compile was drawn from abrok.eu and the McCain X3 was a compiled version done by Corbit. Default parameters were used without touching any, no native opening books and no endgame tablebases. The tournament manager used was cutechess-cli 1.1 linux version.

The result showed that Stockfish is marginally stronger with a 6.14 ELO difference in which the previous results. My confidence in my previous testing results is strengthened. If there is no agreement with the results done with other testers, then so be it. There are many other factors that will make the results inconsistent. This is just my personal test.

Rank Chess Engine  ELO Games Score%  Win%  Draw% Loss%
1 Stockfish 19042419 x64  6.14 800 51.75 24.75 54.00 21.25
2 McCain X3 x64  -6.14 800 48.25 21.25 54.00 24.75

Download the match PGN games 

Sunday, April 28, 2019

Rofchade 2.1 vs. Top Chess Engines


Rofchade 2.1 gained 106 ELO points and moved 7 steps up in the ranking ladder. It caught another actively maintained Schooner 2.0.34 which is now 2 ranks below. It even beat Ethereal 11.25 and Booot 6.3.1 which are higher in rank in the general rating lists.

Rank Chess Engine  ELO Games Score%  Win%  Draw% Loss%
1 Stockfish 10 x64  3653.40 100 89.50 79.00 21.00 0.00
2 Houdini 6.02 x64  3603.38 100 86.50 75.00 23.00 2.00
3 Komodo 11.2.2 x64  3526.34 100 80.50 67.00 27.00 6.00
4 Fire 7.1 x64  3426.36 100 70.00 48.00 44.00 8.00
5 Xiphos 0.5 x64  3356.26 100 61.00 36.00 50.00 14.00
6 Critter 1.6a x64  3320.13 100 56.00 39.00 34.00 27.00
7 Andscacs 0.95 x64  3309.50 100 54.50 34.00 41.00 25.00
8 Shredder 13 x64  3298.93 100 53.00 27.00 52.00 21.00
9 Laser 1.7 x64  3291.90 100 52.00 24.00 56.00 20.00
10 Rofchade 2.1 x64  3277.87 3000 57.42 39.73 35.40 24.87
11 Ethereal 11.25 x64  3263.84 100 48.00 34.00 28.00 38.00
12 Schooner 2.0.34 x64  3253.30 100 46.50 26.00 41.00 33.00
13 Gull 3 x64  3249.77 100 46.00 22.00 48.00 30.00
14 Hannibal 1.7 x64  3239.16 100 44.50 32.00 25.00 43.00
15 Booot 6.3.1 x64  3224.90 100 42.50 18.00 49.00 33.00
16 Nirvana 2.4 x64  3199.48 100 39.00 17.00 44.00 39.00
17 Fizbo 2.0 x64  3192.08 100 38.00 25.00 26.00 49.00
18 Equinox 3.30 x64  3180.83 100 36.50 17.00 39.00 44.00
19 Fritz 15 x64  3173.23 100 35.50 16.00 39.00 45.00
20 Texel 1.07 x64  3161.63 100 34.00 14.00 40.00 46.00
21 Pedone 1.9 x64  3129.39 100 30.00 15.00 30.00 55.00
22 Senpai 2.0 x64  3125.20 100 29.50 9.00 41.00 50.00
23 ICE 3.0.658 x64  3116.68 100 28.50 8.00 41.00 51.00
24 Arasan 21.3 x64  3103.57 100 27.00 15.00 24.00 61.00
25 Protector 1.9.0 x64  3099.10 100 26.50 11.00 31.00 58.00
26 Nemorino 5.00 x64  3094.57 100 26.00 10.00 32.00 58.00
27 Wasp 3.60 x64  3066.12 100 23.00 6.00 34.00 60.00
28 SCTR 1.1f x64  3050.92 100 21.50 6.00 31.00 63.00
29 Vajolet 2.2.7 x64  3040.36 100 20.50 4.00 33.00 63.00
30 Naum 4.6 x64  3000.00 100 17.00 5.00 24.00 71.00
31 Smarthink 1.98 x64  2966.92 100 14.50 8.00 13.00 79.00

Download the gauntlet tournament PGN games here.

Thursday, April 18, 2019

Stockfish 19041623 vs. Clones

This is a test whether the Stockfish clones has something to show. CFish is still on top, Asm Fish moved one rank up. It is expected that Asm Fish will be better one because it is made in Assembly language. Perhaps the translated algorithm is not well optimized. Most showed to be marginally stronger than Stockfish and the others like Shash, Sugar and McCain are regressions. Houdini was included in the test to provide reference of the ELO strength.

The tournament was conducted in an old single 4 core AMD computer with 16GB RAM. Operating system used is Linux 4.16.16 under PCLinuxOs distro. The tournament manager is cutechess 1.1 linux version. All the chess engines had an extension of .exe which means they are all Windows compiled binaries. The 100 round-robin  tournament started yesterday at around 8pm and finished today at around 1:30pm which is less than 24hours. Number of threads used was 20 with no noticeable lag when occasionaly browsing at the same time. There were no time forfeits recorded using the time control of 1 minute base + 1 second increment. The opening book used is a custom selection 50 positions with only 2 ply depth repeating for both colors. Adjudication score for win/loss is 200cp and a draw score of 20cp after 40 moves. This would minimize the idiot dancing Kings in the endgame.

Rank  Chess Engine  ELO  Games  Score%  Win%  Draw% Author
 1  CFish 190324 x64  3559   1000  54.80 25.40 58.80 Ronald De Man
 2  Asm Fish 2019-04-05 x64  3544   1000  52.45 24.60 55.70 Mohammed Li, Lyudmil Antonov
 3  Shark 190416 x64  3543   1000  52.40 23.40 58.00 Krahs
 4  Brain Fish 190414 x64  3542   1000  52.10 25.00 54.20 Thomas Zipproth
 5  Raubfisch X40a x64  3538   1000  51.60 23.80 55.60 Frank Karl Warner
 6  CorChess 3.0 x64  3531   1000  50.45 22.80 55.30 Ivan Ivec
 7  Stockfish 19041623 x64  3531   1000  50.40 21.60 57.60 Romstad, Costalba, Kiiski, Linscott
 8  Shash 8.0 x64  3527   1000  49.80 18.90 61.80 Andrea Manzo
 9  Sugar MCTSL 220319 x64  3514   1000  47.85 22.30 51.10 Marco Zerbinati
 10  McCain X2b x64  3513   1000  47.60 17.60 60.00 Michael Byrne
 11  Houdini 6.02 x64  3467   1000  40.55 13.00 55.10 Robert Houdart

Download the gauntlet tournament games here.

Monday, April 15, 2019

Vajolet 2.2.7 vs. Top Chess Engines


Rank Chess Engine  ELO Games Score%  Win%  Draw% Loss%
1 Stockfish 10 x64  3726.31 100 98.50 97.00 3.00 0.00
2 Houdini 6.02 x64  3574.23 100 96.50 93.00 7.00 0.00
3 Komodo 11.2.2 x64  3508.98 100 95.00 90.00 10.00 0.00
4 Xiphos 0.5 x64  3421.00 100 92.00 86.00 12.00 2.00
5 Fire 7.1 x64  3409.42 100 91.50 83.00 17.00 0.00
6 Shredder 13 x64  3264.72 100 82.50 69.00 27.00 4.00
7 Critter 1.6a x64  3219.94 100 78.50 61.00 35.00 4.00
8 Ethereal 11.25 x64  3214.79 100 78.00 72.00 12.00 16.00
9 Booot 6.3.1 x64  3194.99 100 76.00 57.00 38.00 5.00
10 Schooner 2.0.34 x64  3190.22 100 75.50 58.00 35.00 7.00
11 Andscacs 0.95 x64  3180.87 100 74.50 57.00 35.00 8.00
12 Rofchade 2.0 x64  3176.29 100 74.00 57.00 34.00 9.00
13 Gull 3 x64  3176.29 100 74.00 55.00 38.00 7.00
14 Laser 1.7 x64  3158.50 100 72.00 58.00 28.00 14.00
15 Pedone 1.9 x64  3137.32 100 69.50 55.00 29.00 16.00
16 Fritz 15 x64  3129.13 100 68.50 52.00 33.00 15.00
17 Equinox 3.30 x64  3121.07 100 67.50 46.00 43.00 11.00
18 Texel 1.07 x64  3082.51 100 62.50 42.00 41.00 17.00
19 Fizbo 2.0 x64  3078.78 100 62.00 50.00 24.00 26.00
20 Senpai 2.0 x64  3053.16 100 58.50 39.00 39.00 22.00
21 Nirvana 2.4 x64  3045.96 100 57.50 38.00 39.00 23.00
22 Hannibal 1.7 x64  3028.16 100 55.00 30.00 50.00 20.00
23 ICE 3.0.658 x64  3024.62 100 54.50 33.00 43.00 24.00
24 Arasan 21.3 x64  3021.09 100 54.00 31.00 46.00 23.00
25 Naum 4.6 x64  3000.00 100 51.00 30.00 42.00 28.00
26 Protector 1.9.0 x64  2996.49 100 50.50 32.00 37.00 31.00
27 Vajolet 2.2.7 x64  2992.99 3000 31.77 15.63 32.30 52.07
28 Nemorino 5.00 x64  2978.96 100 48.00 26.00 44.00 30.00
29 Wasp 3.60 x64  2971.93 100 47.00 20.00 54.00 26.00
30 Smarthink 1.98 x64  2947.17 100 43.50 29.00 29.00 42.00
31 SCTR 1.1f x64  2914.60 100 39.00 17.00 44.00 39.00

Download gauntlet tournament games here.

Wasp 3.60 vs. Top Chess Engines


Rank Chess Engine  ELO Games Score%  Win%  Draw% Loss%
1 Stockfish 10 x64  3760.41 100 98.00 96.00 4.00 0.00
2 Houdini 6.02 x64  3635.32 100 96.00 94.00 4.00 2.00
3 Komodo 11.2.2 x64  3518.65 100 92.50 86.00 13.00 1.00
4 Fire 7.1 x64  3419.40 100 87.50 75.00 25.00 0.00
5 Xiphos 0.5 x64  3362.54 100 83.50 72.00 23.00 5.00
6 Ethereal 11.25 x64  3356.26 100 83.00 68.00 30.00 2.00
7 Laser 1.7 x64  3338.25 100 81.50 65.00 33.00 2.00
8 Shredder 13 x64  3338.25 100 81.50 74.00 15.00 11.00
9 Schooner 2.0.34 x64  3295.12 100 77.50 63.00 29.00 8.00
10 Booot 6.3.1 x64  3280.39 100 76.00 56.00 40.00 4.00
11 Andscacs 0.95 x64  3257.16 100 73.50 55.00 37.00 8.00
12 Gull 3 x64  3231.07 100 70.50 49.00 43.00 8.00
13 Rofchade 2.0 x64  3214.53 100 68.50 51.00 35.00 14.00
14 Equinox 3.30 x64  3214.53 100 68.50 46.00 45.00 9.00
15 Critter 1.6a x64  3210.48 100 68.00 51.00 34.00 15.00
16 Hannibal 1.7 x64  3183.03 100 64.50 44.00 41.00 15.00
17 Fizbo 2.0 x64  3167.91 100 62.50 48.00 29.00 23.00
18 Texel 1.07 x64  3160.47 100 61.50 48.00 27.00 25.00
19 Pedone 1.9 x64  3160.47 100 61.50 38.00 47.00 15.00
20 Senpai 2.0 x64  3113.56 100 55.00 31.00 48.00 21.00
21 Fritz 15 x64  3106.49 100 54.00 29.00 50.00 21.00
22 Nirvana 2.4 x64  3106.49 100 54.00 28.00 52.00 20.00
23 Nemorino 5.00 x64  3102.96 100 53.50 34.00 39.00 27.00
24 ICE 3.0.658 x64  3102.96 100 53.50 32.00 43.00 25.00
25 Smarthink 1.98 x64  3099.44 100 53.00 36.00 34.00 30.00
26 Wasp 3.60 x64  3078.39 3000 33.52 16.37 34.30 49.33
27 Arasan 21.3 x64  3064.36 100 48.00 32.00 32.00 36.00
28 Protector 1.9.0 x64  3060.85 100 47.50 25.00 45.00 30.00
29 SCTR 1.1f x64  3014.61 100 41.00 18.00 46.00 36.00
30 Vajolet 2.2.6.1 x64  3007.33 100 40.00 18.00 44.00 38.00
31 Naum 4.6 x64  3000.00 100 39.00 18.00 42.00 40.00

Download the gauntlet tournament games here.

Sunday, April 14, 2019

Amoeba 3.0 vs. Top Chess Engines II


Rank Chess Engine  ELO Games Score%  Win%  Draw% Loss%
1 Naum 4.6 x64  3000.00 100 58.00 36.00 44.00 20.00
2 Demolito 2018-10-29 x64  2964.49 100 53.00 33.00 40.00 27.00
3 Hakkapeliitta 210416 x64  2957.46 100 52.00 40.00 24.00 36.00
4 Deuterium 2019.1.36.50 x64  2953.95 100 51.50 34.00 35.00 31.00
5 Amoeba 3.0 x64  2943.44 1300 53.65 36.85 33.60 29.55
6 Crafty 25.2 x64  2929.41 100 48.00 26.00 44.00 30.00
7 HIARCS 14  2929.41 100 48.00 35.00 26.00 39.00
8 Spike 1.4  2922.38 100 47.00 27.00 40.00 33.00
9 Bobcat 8.0 x64  2922.38 100 47.00 34.00 26.00 40.00
10 Rodent III 0.273 x64  2918.86 100 46.50 31.00 31.00 38.00
11 Dirty Cucumber x64  2883.27 100 41.50 26.00 31.00 43.00
12 Sjeng 2010  2879.65 100 41.00 25.00 32.00 43.00
13 Cheng 4.39 x64  2861.36 100 38.50 20.00 37.00 43.00
14 Spark 1.0 x64  2799.11 100 30.50 17.00 27.00 56.00

Download the gauntlet tournament games here.

Saturday, April 13, 2019

Atlas 3.91 vs. Top Chess Engines


Rank Chess Engine ELO Games Score%  Win%  Draw% Loss%
1 Naum 4.6 x64  3000.00 100 75.50 56.00 39.00 5.00
2 HIARCS 14  2947.10 100 69.50 58.00 23.00 19.00
3 Hakkapeliitta 210416 x64  2915.12 100 65.50 53.00 25.00 22.00
4 Demolito 2018-10-29 x64  2911.25 100 65.00 47.00 36.00 17.00
5 Spike 1.4  2862.94 100 58.50 42.00 33.00 25.00
6 Rodent III 0.273 x64  2859.33 100 58.00 40.00 36.00 24.00
7 Amoeba 3.0 x64  2848.59 100 56.50 41.00 31.00 28.00
8 Bobcat 8.0 x64  2848.59 100 56.50 36.00 41.00 23.00
9 Crafty 25.2 x64  2841.48 100 55.50 37.00 37.00 26.00
10 Cheng 4.39 x64  2841.48 100 55.50 42.00 27.00 31.00
11 Deuterium 2019.1.36.50 x64  2820.31 100 52.50 34.00 37.00 29.00
12 Rubi 1.3 x64  2806.28 100 50.50 38.00 25.00 37.00
13 Dirty Cucumber x64  2806.28 100 50.50 33.00 35.00 32.00
14 Atlas 3.91 x64  2802.77 1500 43.90 27.87 32.10 40.03
15 Sjeng 2010  2781.72 100 47.00 30.00 34.00 36.00
16 Spark 1.0 x64  2610.25 100 25.00 14.00 22.00 64.00

Download the gauntlet tournament games here.

Friday, April 12, 2019

Rubi 1.3 vs. Top Chess Engines II


Rank Chess Engine ELO Games Score%  Win%  Draw% Loss%
1 Demolito 2018-10-29 x64  3007.27 100 60.00 41.00 38.00 21.00
2 Hakkapeliitta 210416 x64  3003.63 100 59.50 47.00 25.00 28.00
3 Naum 4.6 x64  3000.00 100 59.00 40.00 38.00 22.00
4 Dirty Cucumber x64  2967.85 100 54.50 35.00 39.00 26.00
5 Rodent III 0.273 x64  2946.74 100 51.50 35.00 33.00 32.00
6 Rubi 1.3 x64  2936.22 1400 51.71 34.79 33.90 31.31
7 HIARCS 14  2932.71 100 49.50 32.00 35.00 33.00
8 Deuterium 2019.1.36.50 x64  2932.71 100 49.50 34.00 31.00 35.00
9 Amoeba 3.0 x64  2925.70 100 48.50 30.00 37.00 33.00
10 Spike 1.4  2911.64 100 46.50 30.00 33.00 37.00
11 Bobcat 8.0 x64  2908.12 100 46.00 26.00 40.00 34.00
12 Cheng 4.39 x64  2908.12 100 46.00 27.00 38.00 35.00
13 Crafty 25.2 x64  2897.51 100 44.50 24.00 41.00 35.00
14 Sjeng 2010  2846.70 100 37.50 22.00 31.00 47.00
15 Spark 1.0 x64  2729.38 100 23.50 16.00 15.00 69.00

Download the gauntlet tournament games here.

Sunday, April 7, 2019

Ethereal 11.36 vs. Xiphos 0.5.3 - Test


Ethereal aimed to be the second strongest open source engine. It achieved that feat some months ago, but out of the blue Xiphos came from nowhere and dislodged Ethereal.

The recent development releases of Ethereal had not changed the situation as Xiphos is also doing development releases to elevate its position further.

Here is the score:

Rank Chess Engine ELO Games Score%  Win%  Draw% Loss%
1 Xiphos 0.5.3 x64  19.36 100 55.50 30.00 51.00 19.00
2 Ethereal 11.36 x64  -19.36 100 44.50 19.00 51.00 30.00

Download the match games here.

Xiphos 0.5.3 vs. Fire 7.1 - Test


Xiphos is now next in rank with Fire in the recent Rating Lists. This is a test for the latest Xiphos 0.5.3 development to determine whether it can beat Fire 7.1 in the Ratings List ranking. The results showed that it will take some more iterations and it can finally be on top of Fire, granting that Fire does nothing to prevent it.

Here is the score:

Rank Chess Engine ELO Games Score%  Win%  Draw% Loss%
1 Fire 7.1 x64  7.01 100 52.00 24.00 56.00 20.00
2 Xiphos 0.5.3 x64  -7.01 100 48.00 20.00 56.00 24.00

Download the match games here.

Tuesday, April 2, 2019

Arasan 21.3 vs. Top Chess Engines

Rank Chess Engine ELO Games Score%  Win%  Draw% Loss%
1 Stockfish 10 x64  3677.18 100 97.50 95.00 5.00 0.00
2 Houdini 6.02 x64  3644.33 100 97.00 96.00 2.00 2.00
3 Komodo 11.2.2 x64  3488.47 100 93.00 87.00 12.00 1.00
4 Fire 7.1 x64  3392.78 100 88.50 77.00 23.00 0.00
5 Xiphos 0.5 x64  3376.18 100 87.50 80.00 15.00 5.00
6 Ethereal 11.25 x64  3332.36 100 84.50 74.00 21.00 5.00
7 Shredder 13 x64  3289.27 100 81.00 69.00 24.00 7.00
8 Laser 1.7 x64  3283.63 100 80.50 64.00 33.00 3.00
9 Andscacs 0.95 x64  3262.12 100 78.50 67.00 23.00 10.00
10 Schooner 2.0.34 x64  3232.40 100 75.50 61.00 29.00 10.00
11 Booot 6.3.1 x64  3175.38 100 69.00 50.00 38.00 12.00
12 Rofchade 2.0 x64  3175.38 100 69.00 52.00 34.00 14.00
13 Gull 3 x64  3171.30 100 68.50 47.00 43.00 10.00
14 Texel 1.07 x64  3151.40 100 66.00 50.00 32.00 18.00
15 Critter 1.6a x64  3136.00 100 64.00 46.00 36.00 18.00
16 Equinox 3.30 x64  3132.20 100 63.50 40.00 47.00 13.00
17 Pedone 1.9 x64  3120.96 100 62.00 42.00 40.00 18.00
18 Nirvana 2.4 x64  3109.88 100 60.50 45.00 31.00 24.00
19 Fritz 15 x64  3091.73 100 58.00 42.00 32.00 26.00
20 Fizbo 2.0 x64  3073.88 100 55.50 47.00 17.00 36.00
21 Hannibal 1.7 x64  3056.22 100 53.00 28.00 50.00 22.00
22 ICE 3.0.658 x64  3045.68 100 51.50 37.00 29.00 34.00
23 Protector 1.9.0 x64  3042.18 100 51.00 32.00 38.00 30.00
24 Arasan 21.3 x64  3035.17 3000 34.10 18.93 30.30 50.77
25 Senpai 2.0 x64  3035.17 100 50.00 33.00 34.00 33.00
26 Nemorino 5.00 x64  3031.66 100 49.50 36.00 27.00 37.00
27 Smarthink 1.98 x64  3010.59 100 46.50 31.00 31.00 38.00
28 Wasp 3.50 x64  3003.54 100 45.50 23.00 45.00 32.00
29 Naum 4.6 x64  3000.00 100 45.00 22.00 46.00 32.00
30 SCTR 1.1f x64  2992.90 100 44.00 26.00 36.00 38.00
31 Vajolet 2.2.6.1 x64  2975.00 100 41.50 23.00 37.00 40.00

Download the gauntlet tournament games here.

Chessdom News