SSDF Computer Rating List 2/99 (28-MAR-1999)


65604 games played by 190 computers

                                           Rating   +     -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Chessmaster 6000  64MB P200 MMX         2576   88   -71   100   78%  2363
   1 Fritz 5.32  64MB P200 MMX               2576   29   -28   627   66%  2457
   3 Hiarcs 7.0  64MB P200 MMX               2567   28   -27   676   63%  2471
   4 Nimzo 99  64MB P200 MMX                 2565   37   -35   390   63%  2472
   5 Fritz 5.0 PB29%  67MB P200 MMX          2564   24   -23   946   67%  2436
   6 Junior 5.0  64MB P200 MMX               2543   30   -29   576   63%  2447
   7 Hiarcs 6.0  48MB P200 MMX               2524   25   -25   802   57%  2473
   8 Nimzo 98  57MB P200 MMX                 2523   24   -23   899   59%  2459
   9 190                                     2522   54   -50   201   69%  2379
   9 Rebel 9.0  46MB P200 MMX                2522   25   -24   843   62%  2437
  11 Rebel 8.0  46MB P200 MMX                2507   31   -30   533   58%  2448
  12 MChess Pro 6.0  41MB P200 MMX           2506   28   -28   637   57%  2453
  13 MChess Pro 7.1  42MB P200 MMX           2505   24   -24   834   56%  2460
  14 Shredder 2.0  57MB P200 MMX             2502   25   -25   765   55%  2464
  15 Genius 5.0 DOS  44MB P200 MMX           2495   24   -23   883   56%  2449
  16 MChess Pro 8.0  64MB P200 MMX           2481   30   -29   560   53%  2456
  17 Gandalf 3.0  64MB P200 MMX              2466   41   -40   307   59%  2399
  18 Kallisto II  64MB P200 MMX              2445   35   -35   403   52%  2430
  19 Rebel 8.0 Pentium 90 MHz                2440   19   -18  1412   55%  2402
  20 Rebel 9.0 Pentium 90 MHz                2438   25   -25   767   49%  2445
  21 Hiarcs 6.0 Pentium 90 MHz               2434   19   -19  1293   52%  2419
  22 Genius 5.0 DOS Pentium 90 MHz           2431   20   -20  1269   51%  2424
  23 Hiarcs 5.0 Pentium 90 MHz               2428   38   -36   363   59%  2362
  24 MChess Pro 6.0 Pentium 90 MHz           2416   19   -19  1406   49%  2420
  25 Genius 3.0 Pentium 90 MHz               2409   26   -25   785   61%  2329
  26 MChess Pro 5.0 Pentium 90 MHz           2407   26   -25   769   63%  2315
  26 Rebel 6.0 Pentium 90 MHz                2407   31   -30   540   60%  2335
  28 Genius 4.0 DOS Pentium 90 MHz           2404   23   -23   944   60%  2335
  29 Rebel 7.0 Pentium 90 MHz                2402   26   -25   759   61%  2319
  30 Hiarcs 4.0 Pentium 90 MHz               2393   25   -25   766   55%  2358
  31 Nimzo 3.5 Pentium 90 MHz                2389   23   -23   937   46%  2419
  32 Junior 4.0 Pentium 90 MHz               2388   23   -23   916   43%  2438
  33 Chessmaster 5000 Pentium 90 MHz         2387   49   -45   240   67%  2262
  34 Shredder 1.0 Pentium 90 MHz             2385   59   -58   145   53%  2365
  35 Nimzo 3.0  Pentium 90 MHz               2380   26   -25   767   58%  2322
  36 Hiarcs 3.0 Pentium 90 MHz               2374   30   -30   545   56%  2329
  37 R30 v. 2.5                              2371   43   -40   303   66%  2255
  38 Genius 4.0 DOS 486/50-66 MHz            2367   23   -23   891   50%  2369
  39 Junior 3.3-3.5  Pentium 90 MHz          2358   31   -31   516   47%  2378
  40 Genius 3.0 486/50-66 MHz                2356   24   -23   910   62%  2268
  41 MChess Pro 4.0 Pentium 90 MHz           2355   29   -29   578   52%  2339
  42 CometA90  64MB P200 MMX                 2354   37   -39   358   36%  2453
  43 Fritz 3.0 Pentium 90 MHz                2341   19   -19  1327   44%  2383
  44 Mephisto Genius 2.0  486/50-66 MHz      2336   23   -23   917   58%  2276
  45 Fritz 4.0 Pentium 90 MHz                2334   40   -39   324   60%  2263
  46 WChess 1.06 Pentium 90 MHz              2332   21   -21  1106   40%  2405
  47 MChess Pro 5.0 486/50-66 MHz            2328   26   -26   691   50%  2331
  47 Rebel 7.0 486/50-66 MHz                 2328   26   -26   737   50%  2329
  49 Kallisto 1.98 Pentium 90 MHz            2326   22   -22  1017   42%  2380
  50 MChess Pro 4.0 486/50-66 MHz            2310   24   -24   846   53%  2286
  51 Chess Machine 30-32 MHz Schröder 3.1    2301   32   -30   546   68%  2170
  52 WChess 1.03 486/50-66 MHz               2298   27   -27   677   49%  2305
  52 Meph Genius 68 030 33 MHz               2298   45   -44   248   55%  2260
  54 Rebel 6.0 486/50-66 MHz                 2297   24   -23   887   55%  2263
  54 Hiarcs 3.0 486/50-66 MHz                2297   24   -24   865   50%  2294
  56 Ch.Machine 30 MHz King 2.0 aggr/R30off  2293   21   -20  1202   64%  2193
  57 Chessmaster 4000 486/50-66 MHz          2291   34   -33   462   66%  2171
  58 Chess Genius 1.0  486/50-66 MHz         2283   23   -23   931   54%  2255
  59 Rebel Decade Pentium 90 MHz             2276   29   -30   563   45%  2313
  60 Chess Machine 30 MHz Schröder 3.0       2274   62   -55   168   73%  2102
  61 Mephisto Gideon Pro  486/50-66 MHz      2271   35   -34   421   62%  2183
  62 MChess Pro 3.5  486/50-66 MHz           2268   23   -22   958   51%  2259
  63 MChess Pro 3.12  486/50-66 MHz          2264   36   -34   438   69%  2122
  64 Fritz 3.0 486/50-66 MHz                 2257   20   -20  1226   45%  2291
  65 Mephisto Lyon  68030 36 MHz             2252   28   -27   716   68%  2116
  66 Chess Genius 1.0  486/33 MHz            2240   32   -32   463   50%  2240
  67 Mephisto Portorose  68030 36 MHz        2238   40   -36   407   77%  2028
  68 Mephisto Vancouver  68030 36 MHz        2227   35   -33   471   71%  2071
  69 MChess Pro 3.12  486/33 MHz             2226   50   -48   208   60%  2152
  69 Meph RISC 2   1 MB                      2226   62   -66   125   39%  2306
  71 Berlin Pro 68 020 24 MHz                2225   24   -24   850   58%  2171
  72 Kasparov SPARC  20 MHz                  2223   23   -24   879   47%  2246
  73 Kallisto 1.82-1.83 486/50-66 MHz        2210   21   -22  1077   41%  2272
  74 Comet32 Pentium 90 MHz                  2201   24   -25   968   23%  2406
  75 Mephisto RISC 1 MB ARM 2  14 MHz        2200   20   -20  1194   56%  2158
  76 Hiarcs Master 2.0  486/33 MHz           2199   46   -46   229   51%  2190
  77 Mephisto Montreux ARM  14 MHz 512K      2196   30   -28   649   73%  2025
  78 MChess 1.1-1.71  486/33 MHz             2193   44   -40   326   74%  2014
  79 Chess Machine Schröder 512K ARM2 16MHz  2192   27   -26   703   62%  2108
  80 Saitek RISC 2500 ARM2 14 MHz 128K       2191   20   -20  1176   55%  2157
  80 Atlanta    SH7000 20 MHz                2191   48   -45   237   62%  2101
  82 Chess Machine The King 512K ARM2 16MHz  2174   32   -32   473   55%  2135
  83 Mephisto Vancouver  68020 12 MHz        2161   23   -22  1021   65%  2048
  84 Mephisto Lyon  68020 12 MHz             2150   19   -18  1442   59%  2086
  85 Socrates 3.0  486/33 MHz                2139   49   -50   203   47%  2160
  86 Fritz 2.0  486/33 MHz                   2129   30   -31   527   45%  2164
  87 Mephisto Portorose  68020 12 MHz        2127   26   -24   896   73%  1956
  88 M Chess 1.1-1.71 386/25-33 MHz          2126   36   -35   408   65%  2017
  89 Fidelity Elite  68030 32 MHz (vers.9)   2121   31   -30   521   60%  2048
  90 Mephisto Berlin  68 000 12 MHz          2115   22   -22   986   57%  2066
  91 Sapphire II                             2112   36   -35   404   64%  2008
  92 Mephisto Vancouver  68000 12 MHz        2105   21   -21  1099   55%  2072
  93 Mephisto Lyon  68000 12 MHz             2103   21   -21  1143   57%  2051
  94 Mephisto MM 4 Turbo Kit  6502 16 MHz    2093   46   -42   292   73%  1918
  95 Novag Sapphire H8 10 MHz                2090   22   -22  1014   47%  2108
  96 Milano Pro  SH7000 20 MHz               2078   35   -34   429   63%  1985
  97 Fidelity Mach IV  68020 20 MHz          2074   18   -18  1475   49%  2084
  98 Mephisto Almeria  68020 12 MHz          2073   42   -40   305   62%  1985
  99 Hiarcs Master 1.0  486/33 MHz           2070   48   -48   214   48%  2086
 100 Mephisto Portorose  68000 12 MHz        2045   25   -24   827   62%  1960
 101 Mephisto Polgar  6502 10 MHz            2043   43   -41   283   59%  1979
 102 Fritz 1.0  486/33 MHz                   2041   48   -47   215   55%  2008
 103 Gandalf 2.1 Pentium 90 MHz              2038   46   -51   242   27%  2212
 104 Fidelity Elite  68000 x 2 (vers. 5)     2037   49   -48   209   57%  1987
 105 Nimzo 2.2.1 486/33 MHz                  2033   46   -47   229   42%  2088
 106 Mephisto Roma  68020 14 MHz             2030   27   -26   712   65%  1919
 106 Rex Chess 2.3  386/25-33 MHz            2030   65   -62   126   59%  1964
 108 Zarkov 3.0 486/25-33 MHz                2029   46   -48   232   39%  2108
 109 Mephisto Dallas  68020 14 MHz           2023   35   -32   492   72%  1861
 110 Mephisto Almeria  68000 12 MHz          2021   32   -30   534   67%  1898
 111 Zarkov 2.5  386/25-33 MHz               2020   56   -53   168   61%  1941
 112 Kasparov Brute Force  H8 10 MHz         2018   23   -23   906   44%  2057
 113 Fritz 1.0  386/25-33 MHz                2007   66   -67   113   46%  2039
 114 Novag Diablo  68000 16 MHz              2005   21   -21  1123   41%  2071
 115 Fidelity Mach III  68000 16 MHz         1993   14   -14  2410   52%  1980
 116 Complete Chess System  486/33 MHz       1984   47   -47   221   47%  2006
 117 Kasparov President/GK-2100 H8 10 MHz    1978   29   -29   581   46%  2006
 118 Mephisto MM 5  6502 5 MHz               1974   19   -19  1374   47%  1997
 119 Mephisto Dallas  68000 12 MHz           1971   21   -20  1177   61%  1894
 120 Mephisto Polgar  6502 5 MHz             1970   16   -17  1793   41%  2036
 120 Mephisto Roma  68000 12 MHz             1970   18   -18  1519   56%  1927
 122 Mephisto Milano  6502  5 MHz            1963   24   -24   860   41%  2028
 123 Novag Super Expert C  6502 6 MHz Sel 5  1960   18   -18  1555   46%  1991
 123 Zarkov 2.6 386/25-33 MHz                1960   64   -62   125   56%  1917
 125 Mephisto Academy  6502 5 MHz            1939   18   -18  1535   44%  1982
 126 Chessmaster 3000  386/25-33 MHz         1933   68   -74   103   36%  2031
 127 Rex Chess 2.3  386/16-20 MHz            1930   53   -53   174   49%  1936
 128 Saitek Leonardo Maestro B 6502 18 MHz   1928   73   -67   105   62%  1842
 129 Mephisto Amsterdam  68000 12 MHz        1927   22   -22  1020   58%  1873
 130 Novag Super Expert B 6502 6 MHz sel 4   1919   29   -29   564   48%  1935
 131 Mephisto Mega IV  6502 4.9 MHz          1916   17   -18  1584   44%  1960
 131 Saitek Maestro D  6502 10 MHz           1916   26   -26   736   51%  1909
 133 Fidelity Excel Mach IIc  68000 12 MHz   1915   23   -23   955   50%  1911
 134 Novag Expert Turbo Kit 6502 16 MHz      1910   67   -63   120   61%  1830
 135 Mephisto MM 4  6502 5 MHz               1904   19   -19  1288   51%  1900
 136 Fidelity Travel Master H8/330 10 MHz    1897   65   -79   123   22%  2112
 136 Mephisto Modena  6502 4 MHz             1897   27   -28   655   40%  1968
 138 Kasparov GK-2000   H8 10 MHz            1896   29   -29   593   42%  1952
 139 Psion Atari  68000 8 MHz                1882   18   -18  1487   44%  1928
 140 CXG Sphinx Galaxy  6502 4 MHz           1880   17   -17  1710   37%  1974
 141 Novag Ruby H8  10 MHz                   1879   30   -30   545   42%  1934
 142 Fidelity Excel Mach IIa  68000 12 MHz   1878   46   -47   226   47%  1898
 143 Saitek Turboking II  6502 5 MHz         1868   23   -23   963   37%  1964
 144 Conchess Plymate Victoria 6502 5.5 MHz  1867   26   -27   701   40%  1941
 145 Fidelity Excel Club  68000 12 MHz       1858   23   -23   931   51%  1849
 146 Mephisto Mega IV Brute Force            1849   34   -35   422   38%  1939
 147 Novag Super Expert/Forte A 6502 5 MHz   1837   19   -19  1358   38%  1923
 148 Fidelity Par Excellence  6502 5 MHz     1835   22   -22  1022   48%  1846
 148 Fidelity Avant Garde  6502 5 MHz        1835   20   -20  1196   46%  1866
 150 Mephisto Rebell  6502 5 MHz             1824   19   -19  1393   38%  1909
 151 Saitek Stratos/Analys B  6502 6 MHz     1820   20   -21  1213   38%  1908
 152 Mephisto Super Mondial  6502 4 MHz      1819   19   -19  1375   37%  1914
 153 Novag Forte B  6502 5 MHz               1816   24   -24   837   44%  1860
 154 Saitek Leonardo Maestro A  6502 6 MHz   1811   30   -30   547   45%  1846
 155 Novag Forte A  6502 5 MHz               1810   22   -22   964   48%  1822
 156 Conchess Plymate  6502 5.5 MHz          1808   15   -16  2040   40%  1882
 157 Saitek Simultano/Corona C  6502 5 MHz   1806   23   -24   969   33%  1932
 158 Fidelity Excellence  6502 4 MHz         1801   18   -18  1565   43%  1852
 159 Novag Expert  6502 4 MHz                1789   24   -24   843   42%  1847
 160 Fidelity Elegance  6502 3.6 MHz         1781   40   -40   303   54%  1752
 161 Conchess Plymate  6502 4 MHz            1780   39   -38   333   55%  1748
 162 Mephisto MM 2  6502 3.7 MHz             1773   49   -48   208   52%  1756
 163 Saitek Turbostar 432  6502 4 MHz        1765   22   -22  1005   45%  1803
 164 Fidelity Excellence  6502 3 MHz         1757   22   -23   960   42%  1815
 165 Saitek Kasparov Blitz                   1734   45   -47   239   37%  1825
 165 Novag Super Nova                        1734   37   -38   350   40%  1803
 167 Novag Super Constellation  6502 4 MHz   1732   18   -18  1626   35%  1841
 168 Conchess Glasgow  6502 4 MHz            1720   39   -39   327   50%  1722
 169 Chessplayer 2150 Atari/Amiga            1714   58   -63   146   33%  1837
 170 The Final Chesscard  6502 5 MHz         1700   57   -64   156   27%  1872
 171 Novag Super VIP                         1688   53   -58   174   32%  1817
 172 Chessmaster 2100 Amiga 68000            1687   65   -76   120   25%  1874
 173 Mephisto Europa                         1683   50   -52   190   42%  1741
 174 Saitek Superstar 36K  6502 2 MHz        1679   23   -24   954   31%  1819
 175 Fidelity Elite A/S  6502 3.2 MHz        1678   22   -23  1043   28%  1842
 176 Chess Champion 2175 Atari/Amiga         1673   56   -62   157   30%  1822
 177 Conchess Glasgow  6502 2 MHz            1668   24   -25   855   34%  1782
 178 Novag Quattro  6502 4 MHz               1663   30   -31   560   33%  1791
 179 Fidelity Prestige  6502 4 MHz           1661   64   -66   118   44%  1703
 180 Chessmaster 2000 Atari  68000 8 MHz     1654   41   -45   312   25%  1841
 181 Novag Constellation  6502 3.6 MHz       1648   31   -32   504   41%  1715
 182 Novag Constellation Primo               1638   57   -59   149   44%  1683
 183 Novag Constellation  6502 2 MHz         1597   32   -33   479   35%  1706
 184 CXG Super Enterprise                    1563   36   -39   386   28%  1727


Rating : ELO rating
+/-    : deviation
Games  : number of games played
Won    : percentage of games won
Oppo   : medium opponent ELO rating


Comments to the Ratinglist 2/99 (28-MAR-1999)

By Thoralf Karlsson, thoralf.karlsson@mailbox.swipnet.se, Chairman of the SSDF

The SSDF rating list is made with the ambition to provide reliable information about the playing strength of chess programs and chess computers.

The ideal way to reach this goal would be to play hundreds of tournament games with each program against humans in the same country or against international ELO-rated players. Unfortunately this is an impossible task.

We have chosen to play matches with 20-40 games between a new program and as many as possible of the earlier tested programs. The goal is to get about 600 - 800 tournament games for each program. This gives us a relative rating, which with 95% probability is within a range of +-25-30 points.

Hopefully this rating could roughly be achieved if the same amount of games were to be played against human players. But we cannot be sure about that. The level of the rating list is based on the results of 337 games against Swedish chess players, played in serious tournaments between 1987 and 1991. The chess computers then used were of course much weaker than todays top programs running on fast hardware.

Many things have to be considered when the ratings are interpreted. Is there a difference between the Swedish rating level and the level in other countries? It seems so. How does the Swedish level correlate to the level in the ELO-system?

Are some chess programs relatively better or worse against humans than other programs? It could be so. But in order to prove that, you would have to play hundreds of games against humans with several of the chess programs, and this has not been done.

Is an improvement with say 400 rating points on the SSDF rating list comparable with the same improvement against humans? Or could there be a "spreading" effect when games between computers are played?

The results in the Aegon-tournament 1992 - 1997, where up to 300 games against humans were played each year, showed ratings slightly above what could be expected from the rating list. This indicates that the level of the list is rather correct, but doesn't prove it. The playing level in Aegon was somewhat faster than tournament play, and the humans didn't have Swedish ratings.

More strictly speaking, the SSDF rating list provides information about the relative ratings for chess programs, when they are tested in the way SSDF has chosen.

Could the result be different with another testing method? Yes, it could. We are presenting results on the tournament level, 40 moves in two hours. Games played on the blitz level or with one minute per move, would probably give a different order of the programs.

The same would most likely happen if we had used a faster or different processor. Some programs run relatively better on a AMD-processor with 64 kB level-1 cache than on P200 MMX.

Programs with good learners benefit from long series of games against the same opponent. If we somehow automatically could change the opponent after each game, the result might differ.

Obviously, the SSDF rating list doesn't say anything about programs which haven't been tested by us. Our ambition is to include all of the strongest commercially available programs. Sometimes we also have the possibility to play with amateur programs.

At the moment some of the stronger programs are missing because of juridical (perhaps illegal?) threats. Another reason for programs not being included is the fact that they cannot be tested automatically with auto232. The reason being that most testers are not willing to go back to the time consuming manual testing.

Thanks to four of SSDFs testers, we can now include one of these programs without auto232, which exactly reached the minimum number of games to be accepted. It is Johan de Konings Chessmaster 6000 P200 MMX, which after one hundred games takes a shared first place on the list with 2576!!

Compared to the earlier program version, CM5000, which we tested on P90, the new program seems to be about 110 points stronger! I can not deny that the result surprised me somewhat. Still, the rating is based on only 100 games with a margin of error of 70-80 points, so much could change if we succeed in playing more games.

Fritz 5.32 has gone up one point, which gives it a shared first place together with CM6000. Hiarcs 7.0 P200 MMX has lost 9 points and now takes the third place.

Chrilly Donningers program Nimzo 99 P200 MMX is new on the list. After 390 games it has a rating of 2565, which gives it a fourth place. Compared to Nimzo 98, the rating has gone up with 42 points!

Most of the games are played with a program version dated 98-12-14, the rest with a version from 98-11-01. The possibility to tell Nimzo 99 if it plays against Rebel, Junior or Fritz has been used in one or two of the matches.

Junior 5 has lost 11 points compared to the latest list, and Atlanta has gained 9 points.

For the nearest future we intend to play more games with Nimzo 99 and CM6000 and probably start with Crafty. As soon as we decide about the next hardware level, the best programs will be retested on the faster processor.

Next list will appear in May.




Last updated: Monday, 29. March 1999
Copyright Manfred Rosenboom marochess@oocities.com


This page hosted by Get your own Free Home Page