The Week in Chess

Wednesday, April 13, 2016

Man-Machine Chess Rating List

Sources: CCRL, CEGT, FCP, SWCR, FGRL, SPCC, OCERL, Chessbase Megabase

It is time to re-calibrate the base anchor ELO of the rating lists. Based on the information derived from the production of this Man-Machine chess rating list, the highest ELO rating of a chess engine is around 3439 (+-10) by Stockfish 7 when using the highest peak rating of Garry Kasparov at 2851 ELO as anchor. The normal anchor used by the majority of rating list sites is Shredder 12 with 2800 ELO. This Man-Machine rating list showed that the ELO rating of Shredder 12 is 3009 which is 209 points understated.

In the next rating list publication, this site will arbitrarily use Shredder 12 as anchor with a base ELO rating of 3000 to reflect the current pattern of ELO ratings of Computer and Human chess rating lists.

How this rating list was derived:
- The sources were from the latest Hybrid rating list of this site with 6.5 Million PGN's obtained from various sources and from the Chessbase Megabase also with 6.5 million PGN's.
- Top 120 chess engine names in the Hybrid rating list was used as filter in the next steps.
- The Megabase was pre-processed to isolate the main group from the huge 65,000 different groups with Ordo -g option
- Players with at least 100 games played were extracted from the filtered group list of the previous step. This was repeatedly processed with Ordoprep until the minimum of 100 games for each player was obtained. A filtered list is then created with Ordo.
- To link the Chess Engines database and Megabase database, all players that begins with "Comp " were extracted from Megabase. If there was a name that match with the Chess Engines database, a small ghost matches of 10 rounds each for players were created with a draw score (+3-3=4). For example: Comp Shredder 7 vs. Shredder 7 (5-5), Comp Fritz 5.32 vs. Fritz 5.32 (5-5), Comp Rebel Century vs. Rebel Century (5-5), etc.
- All the filtered names from previous steps were combined together with the names of all "Comp " players and its corresponding opponents to be used as include file parameter.
- The Hybrid Chess engines and Megabases databases were combined together with the ghost matches bridge.
- Data were extracted from the combined databases with the unique set of players from the filtered include file. Final filtering of the data with Ordoprep -d -M10 which removed perfect wins/losses and assuring a minimum of at least 10 games which is applicable for the Megabase "Comp " players to prevent wipeout.
- Rating list processed from previous step with Ordo -t10 -p <input.file> -o <rating.output>

Additional information:
- There were more than 13 million PGN's in the combined databases.
- More than 260 thousand players were in the databases.
- There were more than 10,000 resulting unique human players with at least 100 games played with each other within the group.
- The number of filtered "Comp " players that qualified are 44 from 366 players in Megabase.
- The first 65 ranks of the resulting rating list were occupied by chess engines.
- Processing of the rating list took 15 hours to converge which maybe caused by the thin bridge of about 120 games. It is usually less than 30 minutes each when the 2 databases were processed independently.

Here is the partial list - first 100 top players:

   # PLAYER                  : RATING    POINTS  PLAYED     (%)
   1 STOCKFISH 7             : 3439.6   14310.5   18050    79.3
   2 KOMODO 9.4.2            : 3436.0    4470.5    5355    83.5
   3 HOUDINI 4               : 3331.5   18536.0   26979    68.7
   4 STRELKA 6               : 3330.9    4471.0    5800    77.1
   5 GULL 3                  : 3282.7   15247.0   24860    61.3
   6 FIRE 4                  : 3263.7    9760.5   16381    59.6
   7 EQUINOX 3.30            : 3235.0   10865.0   19586    55.5
   8 CRITTER 1.6A            : 3229.5   14119.5   23707    59.6
   9 FRITZ 15                : 3221.9   10058.0   18307    54.9
  10 ANDSCACS 0.86           : 3169.1    2466.0    4000    61.6
  11 FIZBO 1.7               : 3153.7    2392.0    4000    59.8
  12 TEXEL 1.06A34           : 3153.1    2550.5    4200    60.7
  13 PROTECTOR 1.9.0         : 3152.3    6341.0   12056    52.6
  14 ICE 3.0                 : 3149.2    5105.5    8650    59.0
  15 NIRVANA 2.2             : 3136.6    6734.5   12666    53.2
  16 HANNIBAL 1.5            : 3105.9    7971.5   15382    51.8
  17 CHIRON 2.0              : 3105.6    9454.5   17425    54.3
  18 NAUM 4.6                : 3096.3    9851.0   19220    51.3
  19 COMP HYDRA              : 3078.6      12.0      14    85.7
  20 HIARCS 14               : 3046.4    8197.0   15765    52.0
  21 SENPAI 1.0              : 3045.6    8452.0   16467    51.3
  22 HAKKAPELIITTA 3.0       : 3033.2    6184.0   12333    50.1
  23 SHREDDER 12             : 3009.6   13904.0   27872    49.9
  24 SPIKE 1.4               : 3004.3   11321.0   23059    49.1
  25 CHENG 4.39              : 2999.4    6471.0   13575    47.7
  26 SJENG 2010              : 2998.7    7896.5   16213    48.7
  27 DISCOCHECK 5.2.1        : 2978.6    4477.5    9627    46.5
  28 SPARK 1.0               : 2975.7   10031.0   21189    47.3
  29 Rybka 2.2               : 2970.7    2999.5    4775    62.8
  30 JUNIOR 13.8.04          : 2969.1    4654.0   10721    43.4
  31 SMARTHINK 1.70          : 2967.5    5195.5   11682    44.5
  32 BOOOT 5.2.0             : 2962.6    5967.0   13233    45.1
  33 QUAZAR 0.4              : 2962.0    8334.5   18267    45.6
  34 VAJOLET 2.2.1           : 2952.9    4146.0   10207    40.6
  35 COMP RYBKA              : 2952.0      17.5      25    70.0
  36 CRAFTY 25.0             : 2948.5    4530.5   10160    44.6
  37 ARASAN 18.3             : 2945.8    2387.5    6245    38.2
  38 GAVIOTA 1.0             : 2936.5    6166.5   13933    44.3
  39 MURKA 3                 : 2935.6    4863.0   11228    43.3
  40 TOGA II 3.0             : 2934.2    3890.0    9246    42.1
  41 DIRTY 03NOV2015         : 2932.3    4541.5   10345    43.9
  42 DEUTERIUM 14.3.34.130   : 2932.2    6377.5   13159    48.5
  43 PEDONE 1.3              : 2930.8    3588.5    8648    41.5
  44 EXCHESS 7.88B           : 2925.3    3835.5    9735    39.4
  45 ATLAS 3.80              : 2924.3    4952.5   11777    42.1
  46 THINKER 5.4D            : 2913.5    7396.5   15372    48.1
  47 BOBCAT 7.1              : 2906.1    6093.5   12625    48.3
  48 NEMO 1.0.1B             : 2905.8    4084.5    9627    42.4
  49 MINKO 1.3               : 2902.8    5734.5   11630    49.3
  50 ONNO 1.2.70             : 2900.2    6401.5   14795    43.3
  51 ZAPPA MEXICO II         : 2899.8   10102.5   21804    46.3
  52 DISASTERAREA 1.54       : 2898.2    5753.5   11873    48.5
  53 SCORPIO 2.7.7           : 2896.1    4232.0    7953    53.2
  54 FRUIT RELOADED R2       : 2896.0    1357.5    4000    33.9
  55 RODENT II 0.8.7         : 2889.3    3560.5    7290    48.8
  56 COMP DEEP THOUGHT II    : 2888.0      16.0      20    80.0
  57 BELKA 1.8.20            : 2886.3    2793.5    5100    54.8
  58 TORNADO 7.0             : 2874.8    3999.5    8253    48.5
  59 GLAURUNG 2.2            : 2874.4    6285.0   12418    50.6
  60 FRITZ 10                : 2874.0    1902.0    3838    49.6
  61 COMP FRITZ 10           : 2874.0       5.0      10    50.0
  62 NARAKU 1.4              : 2870.7    4153.5    7855    52.9
  63 LOOP 2007               : 2864.8    5197.0   10012    51.9
  64 RHETORIC 1.4.3          : 2860.9    3707.5    7517    49.3
  65 KTULU 9.0               : 2851.3    3455.5    6714    51.5
  66 Kasparov, Garry         : 2851.0    1382.5    2000    69.1
  67 ALFIL 15.8              : 2845.2    2186.0    4591    47.6
  68 BUGCHESS2 1.9           : 2839.6    5848.5   11985    48.8
  69 OCTOCHESS R5190         : 2839.1    4424.0    9138    48.4
  70 THE BARON 3.29          : 2834.9    4411.5    9292    47.5
  71 FRENZEE 3.5.19          : 2832.8    5130.5   10607    48.4
  72 COMP SHREDDER 7         : 2822.2      30.5      40    76.2
  73 Anand, Viswanathan      : 2821.0    1920.0    3080    62.3
  74 Kramnik, Vladimir       : 2819.6    1596.5    2636    60.6
  75 CHRONOS 1.9.9           : 2816.4    4488.0    9225    48.7
  76 JUNIOR 10               : 2813.8     765.5    1842    41.6
  77 TUCANO 6.0              : 2813.7    2676.5    5697    47.0
  78 PRODEO 2.0              : 2811.1    3385.0    7430    45.6
  79 LASER 1.0               : 2808.6    3298.5    6539    50.4
  80 GODEL 3.4.9             : 2807.3    3104.5    6323    49.1
  81 BISON 9.11              : 2806.3    4532.5    9511    47.7
  82 Ivanchuk, Vassily       : 2803.6    2289.0    3774    60.7
  83 Grischuk, Alexander     : 2800.6    1417.0    2345    60.4
  84 Carlsen, Magnus         : 2798.1    1130.5    1844    61.3
  85 JONNY 4.0               : 2795.2    5435.0   11030    49.3
  86 Aronian, Levon          : 2792.5    1244.0    2090    59.5
  87 FRITZ 7                 : 2789.5     209.0     375    55.7
  88 COMP DEEP JUNIOR        : 2788.2      30.0      53    56.6
  89 Karjakin, Sergey        : 2786.0    1219.0    2078    58.7
  90 Mamedyarov, Shakhriyar  : 2785.4    1215.0    2021    60.1
  91 Svidler, Peter          : 2785.4    1647.0    2780    59.2
  92 COMP ZAP!CHESS          : 2785.3      23.0      32    71.9
  93 Ding, Liren             : 2784.0     413.5     685    60.4
  94 COMP DEEP FRITZ         : 2782.9      24.0      41    58.5
  95 Morozevich, Alexander   : 2781.5    1165.0    2005    58.1
  96 Nakamura, Hikaru        : 2779.4    1203.5    1933    62.3
  97 Karpov, Anatoly         : 2778.7    2075.0    3368    61.6
  98 Shirov, Alexei          : 2777.8    1992.5    3289    60.6
  99 Gelfand, Boris          : 2777.8    1668.0    2969    56.2
 100 Wang, Hao               : 2777.3     693.5    1161    59.7

View the full rating list here.

No comments:

Post a Comment

Chessdom News