Rating + - Games Won Oppo
------ --- --- ----- --- ----
1 Chessmaster 6000 64MB P200 MMX 2576 88 -71 100 78% 2363
1 Fritz 5.32 64MB P200 MMX 2576 29 -28 627 66% 2457
3 Hiarcs 7.0 64MB P200 MMX 2567 28 -27 676 63% 2471
4 Nimzo 99 64MB P200 MMX 2565 37 -35 390 63% 2472
5 Fritz 5.0 PB29% 67MB P200 MMX 2564 24 -23 946 67% 2436
6 Junior 5.0 64MB P200 MMX 2543 30 -29 576 63% 2447
7 Hiarcs 6.0 48MB P200 MMX 2524 25 -25 802 57% 2473
8 Nimzo 98 57MB P200 MMX 2523 24 -23 899 59% 2459
9 190 2522 54 -50 201 69% 2379
9 Rebel 9.0 46MB P200 MMX 2522 25 -24 843 62% 2437
11 Rebel 8.0 46MB P200 MMX 2507 31 -30 533 58% 2448
12 MChess Pro 6.0 41MB P200 MMX 2506 28 -28 637 57% 2453
13 MChess Pro 7.1 42MB P200 MMX 2505 24 -24 834 56% 2460
14 Shredder 2.0 57MB P200 MMX 2502 25 -25 765 55% 2464
15 Genius 5.0 DOS 44MB P200 MMX 2495 24 -23 883 56% 2449
16 MChess Pro 8.0 64MB P200 MMX 2481 30 -29 560 53% 2456
17 Gandalf 3.0 64MB P200 MMX 2466 41 -40 307 59% 2399
18 Kallisto II 64MB P200 MMX 2445 35 -35 403 52% 2430
19 Rebel 8.0 Pentium 90 MHz 2440 19 -18 1412 55% 2402
20 Rebel 9.0 Pentium 90 MHz 2438 25 -25 767 49% 2445
21 Hiarcs 6.0 Pentium 90 MHz 2434 19 -19 1293 52% 2419
22 Genius 5.0 DOS Pentium 90 MHz 2431 20 -20 1269 51% 2424
23 Hiarcs 5.0 Pentium 90 MHz 2428 38 -36 363 59% 2362
24 MChess Pro 6.0 Pentium 90 MHz 2416 19 -19 1406 49% 2420
25 Genius 3.0 Pentium 90 MHz 2409 26 -25 785 61% 2329
26 MChess Pro 5.0 Pentium 90 MHz 2407 26 -25 769 63% 2315
26 Rebel 6.0 Pentium 90 MHz 2407 31 -30 540 60% 2335
28 Genius 4.0 DOS Pentium 90 MHz 2404 23 -23 944 60% 2335
29 Rebel 7.0 Pentium 90 MHz 2402 26 -25 759 61% 2319
30 Hiarcs 4.0 Pentium 90 MHz 2393 25 -25 766 55% 2358
31 Nimzo 3.5 Pentium 90 MHz 2389 23 -23 937 46% 2419
32 Junior 4.0 Pentium 90 MHz 2388 23 -23 916 43% 2438
33 Chessmaster 5000 Pentium 90 MHz 2387 49 -45 240 67% 2262
34 Shredder 1.0 Pentium 90 MHz 2385 59 -58 145 53% 2365
35 Nimzo 3.0 Pentium 90 MHz 2380 26 -25 767 58% 2322
36 Hiarcs 3.0 Pentium 90 MHz 2374 30 -30 545 56% 2329
37 R30 v. 2.5 2371 43 -40 303 66% 2255
38 Genius 4.0 DOS 486/50-66 MHz 2367 23 -23 891 50% 2369
39 Junior 3.3-3.5 Pentium 90 MHz 2358 31 -31 516 47% 2378
40 Genius 3.0 486/50-66 MHz 2356 24 -23 910 62% 2268
41 MChess Pro 4.0 Pentium 90 MHz 2355 29 -29 578 52% 2339
42 CometA90 64MB P200 MMX 2354 37 -39 358 36% 2453
43 Fritz 3.0 Pentium 90 MHz 2341 19 -19 1327 44% 2383
44 Mephisto Genius 2.0 486/50-66 MHz 2336 23 -23 917 58% 2276
45 Fritz 4.0 Pentium 90 MHz 2334 40 -39 324 60% 2263
46 WChess 1.06 Pentium 90 MHz 2332 21 -21 1106 40% 2405
47 MChess Pro 5.0 486/50-66 MHz 2328 26 -26 691 50% 2331
47 Rebel 7.0 486/50-66 MHz 2328 26 -26 737 50% 2329
49 Kallisto 1.98 Pentium 90 MHz 2326 22 -22 1017 42% 2380
50 MChess Pro 4.0 486/50-66 MHz 2310 24 -24 846 53% 2286
51 Chess Machine 30-32 MHz Schröder 3.1 2301 32 -30 546 68% 2170
52 WChess 1.03 486/50-66 MHz 2298 27 -27 677 49% 2305
52 Meph Genius 68 030 33 MHz 2298 45 -44 248 55% 2260
54 Rebel 6.0 486/50-66 MHz 2297 24 -23 887 55% 2263
54 Hiarcs 3.0 486/50-66 MHz 2297 24 -24 865 50% 2294
56 Ch.Machine 30 MHz King 2.0 aggr/R30off 2293 21 -20 1202 64% 2193
57 Chessmaster 4000 486/50-66 MHz 2291 34 -33 462 66% 2171
58 Chess Genius 1.0 486/50-66 MHz 2283 23 -23 931 54% 2255
59 Rebel Decade Pentium 90 MHz 2276 29 -30 563 45% 2313
60 Chess Machine 30 MHz Schröder 3.0 2274 62 -55 168 73% 2102
61 Mephisto Gideon Pro 486/50-66 MHz 2271 35 -34 421 62% 2183
62 MChess Pro 3.5 486/50-66 MHz 2268 23 -22 958 51% 2259
63 MChess Pro 3.12 486/50-66 MHz 2264 36 -34 438 69% 2122
64 Fritz 3.0 486/50-66 MHz 2257 20 -20 1226 45% 2291
65 Mephisto Lyon 68030 36 MHz 2252 28 -27 716 68% 2116
66 Chess Genius 1.0 486/33 MHz 2240 32 -32 463 50% 2240
67 Mephisto Portorose 68030 36 MHz 2238 40 -36 407 77% 2028
68 Mephisto Vancouver 68030 36 MHz 2227 35 -33 471 71% 2071
69 MChess Pro 3.12 486/33 MHz 2226 50 -48 208 60% 2152
69 Meph RISC 2 1 MB 2226 62 -66 125 39% 2306
71 Berlin Pro 68 020 24 MHz 2225 24 -24 850 58% 2171
72 Kasparov SPARC 20 MHz 2223 23 -24 879 47% 2246
73 Kallisto 1.82-1.83 486/50-66 MHz 2210 21 -22 1077 41% 2272
74 Comet32 Pentium 90 MHz 2201 24 -25 968 23% 2406
75 Mephisto RISC 1 MB ARM 2 14 MHz 2200 20 -20 1194 56% 2158
76 Hiarcs Master 2.0 486/33 MHz 2199 46 -46 229 51% 2190
77 Mephisto Montreux ARM 14 MHz 512K 2196 30 -28 649 73% 2025
78 MChess 1.1-1.71 486/33 MHz 2193 44 -40 326 74% 2014
79 Chess Machine Schröder 512K ARM2 16MHz 2192 27 -26 703 62% 2108
80 Saitek RISC 2500 ARM2 14 MHz 128K 2191 20 -20 1176 55% 2157
80 Atlanta SH7000 20 MHz 2191 48 -45 237 62% 2101
82 Chess Machine The King 512K ARM2 16MHz 2174 32 -32 473 55% 2135
83 Mephisto Vancouver 68020 12 MHz 2161 23 -22 1021 65% 2048
84 Mephisto Lyon 68020 12 MHz 2150 19 -18 1442 59% 2086
85 Socrates 3.0 486/33 MHz 2139 49 -50 203 47% 2160
86 Fritz 2.0 486/33 MHz 2129 30 -31 527 45% 2164
87 Mephisto Portorose 68020 12 MHz 2127 26 -24 896 73% 1956
88 M Chess 1.1-1.71 386/25-33 MHz 2126 36 -35 408 65% 2017
89 Fidelity Elite 68030 32 MHz (vers.9) 2121 31 -30 521 60% 2048
90 Mephisto Berlin 68 000 12 MHz 2115 22 -22 986 57% 2066
91 Sapphire II 2112 36 -35 404 64% 2008
92 Mephisto Vancouver 68000 12 MHz 2105 21 -21 1099 55% 2072
93 Mephisto Lyon 68000 12 MHz 2103 21 -21 1143 57% 2051
94 Mephisto MM 4 Turbo Kit 6502 16 MHz 2093 46 -42 292 73% 1918
95 Novag Sapphire H8 10 MHz 2090 22 -22 1014 47% 2108
96 Milano Pro SH7000 20 MHz 2078 35 -34 429 63% 1985
97 Fidelity Mach IV 68020 20 MHz 2074 18 -18 1475 49% 2084
98 Mephisto Almeria 68020 12 MHz 2073 42 -40 305 62% 1985
99 Hiarcs Master 1.0 486/33 MHz 2070 48 -48 214 48% 2086
100 Mephisto Portorose 68000 12 MHz 2045 25 -24 827 62% 1960
101 Mephisto Polgar 6502 10 MHz 2043 43 -41 283 59% 1979
102 Fritz 1.0 486/33 MHz 2041 48 -47 215 55% 2008
103 Gandalf 2.1 Pentium 90 MHz 2038 46 -51 242 27% 2212
104 Fidelity Elite 68000 x 2 (vers. 5) 2037 49 -48 209 57% 1987
105 Nimzo 2.2.1 486/33 MHz 2033 46 -47 229 42% 2088
106 Mephisto Roma 68020 14 MHz 2030 27 -26 712 65% 1919
106 Rex Chess 2.3 386/25-33 MHz 2030 65 -62 126 59% 1964
108 Zarkov 3.0 486/25-33 MHz 2029 46 -48 232 39% 2108
109 Mephisto Dallas 68020 14 MHz 2023 35 -32 492 72% 1861
110 Mephisto Almeria 68000 12 MHz 2021 32 -30 534 67% 1898
111 Zarkov 2.5 386/25-33 MHz 2020 56 -53 168 61% 1941
112 Kasparov Brute Force H8 10 MHz 2018 23 -23 906 44% 2057
113 Fritz 1.0 386/25-33 MHz 2007 66 -67 113 46% 2039
114 Novag Diablo 68000 16 MHz 2005 21 -21 1123 41% 2071
115 Fidelity Mach III 68000 16 MHz 1993 14 -14 2410 52% 1980
116 Complete Chess System 486/33 MHz 1984 47 -47 221 47% 2006
117 Kasparov President/GK-2100 H8 10 MHz 1978 29 -29 581 46% 2006
118 Mephisto MM 5 6502 5 MHz 1974 19 -19 1374 47% 1997
119 Mephisto Dallas 68000 12 MHz 1971 21 -20 1177 61% 1894
120 Mephisto Polgar 6502 5 MHz 1970 16 -17 1793 41% 2036
120 Mephisto Roma 68000 12 MHz 1970 18 -18 1519 56% 1927
122 Mephisto Milano 6502 5 MHz 1963 24 -24 860 41% 2028
123 Novag Super Expert C 6502 6 MHz Sel 5 1960 18 -18 1555 46% 1991
123 Zarkov 2.6 386/25-33 MHz 1960 64 -62 125 56% 1917
125 Mephisto Academy 6502 5 MHz 1939 18 -18 1535 44% 1982
126 Chessmaster 3000 386/25-33 MHz 1933 68 -74 103 36% 2031
127 Rex Chess 2.3 386/16-20 MHz 1930 53 -53 174 49% 1936
128 Saitek Leonardo Maestro B 6502 18 MHz 1928 73 -67 105 62% 1842
129 Mephisto Amsterdam 68000 12 MHz 1927 22 -22 1020 58% 1873
130 Novag Super Expert B 6502 6 MHz sel 4 1919 29 -29 564 48% 1935
131 Mephisto Mega IV 6502 4.9 MHz 1916 17 -18 1584 44% 1960
131 Saitek Maestro D 6502 10 MHz 1916 26 -26 736 51% 1909
133 Fidelity Excel Mach IIc 68000 12 MHz 1915 23 -23 955 50% 1911
134 Novag Expert Turbo Kit 6502 16 MHz 1910 67 -63 120 61% 1830
135 Mephisto MM 4 6502 5 MHz 1904 19 -19 1288 51% 1900
136 Fidelity Travel Master H8/330 10 MHz 1897 65 -79 123 22% 2112
136 Mephisto Modena 6502 4 MHz 1897 27 -28 655 40% 1968
138 Kasparov GK-2000 H8 10 MHz 1896 29 -29 593 42% 1952
139 Psion Atari 68000 8 MHz 1882 18 -18 1487 44% 1928
140 CXG Sphinx Galaxy 6502 4 MHz 1880 17 -17 1710 37% 1974
141 Novag Ruby H8 10 MHz 1879 30 -30 545 42% 1934
142 Fidelity Excel Mach IIa 68000 12 MHz 1878 46 -47 226 47% 1898
143 Saitek Turboking II 6502 5 MHz 1868 23 -23 963 37% 1964
144 Conchess Plymate Victoria 6502 5.5 MHz 1867 26 -27 701 40% 1941
145 Fidelity Excel Club 68000 12 MHz 1858 23 -23 931 51% 1849
146 Mephisto Mega IV Brute Force 1849 34 -35 422 38% 1939
147 Novag Super Expert/Forte A 6502 5 MHz 1837 19 -19 1358 38% 1923
148 Fidelity Par Excellence 6502 5 MHz 1835 22 -22 1022 48% 1846
148 Fidelity Avant Garde 6502 5 MHz 1835 20 -20 1196 46% 1866
150 Mephisto Rebell 6502 5 MHz 1824 19 -19 1393 38% 1909
151 Saitek Stratos/Analys B 6502 6 MHz 1820 20 -21 1213 38% 1908
152 Mephisto Super Mondial 6502 4 MHz 1819 19 -19 1375 37% 1914
153 Novag Forte B 6502 5 MHz 1816 24 -24 837 44% 1860
154 Saitek Leonardo Maestro A 6502 6 MHz 1811 30 -30 547 45% 1846
155 Novag Forte A 6502 5 MHz 1810 22 -22 964 48% 1822
156 Conchess Plymate 6502 5.5 MHz 1808 15 -16 2040 40% 1882
157 Saitek Simultano/Corona C 6502 5 MHz 1806 23 -24 969 33% 1932
158 Fidelity Excellence 6502 4 MHz 1801 18 -18 1565 43% 1852
159 Novag Expert 6502 4 MHz 1789 24 -24 843 42% 1847
160 Fidelity Elegance 6502 3.6 MHz 1781 40 -40 303 54% 1752
161 Conchess Plymate 6502 4 MHz 1780 39 -38 333 55% 1748
162 Mephisto MM 2 6502 3.7 MHz 1773 49 -48 208 52% 1756
163 Saitek Turbostar 432 6502 4 MHz 1765 22 -22 1005 45% 1803
164 Fidelity Excellence 6502 3 MHz 1757 22 -23 960 42% 1815
165 Saitek Kasparov Blitz 1734 45 -47 239 37% 1825
165 Novag Super Nova 1734 37 -38 350 40% 1803
167 Novag Super Constellation 6502 4 MHz 1732 18 -18 1626 35% 1841
168 Conchess Glasgow 6502 4 MHz 1720 39 -39 327 50% 1722
169 Chessplayer 2150 Atari/Amiga 1714 58 -63 146 33% 1837
170 The Final Chesscard 6502 5 MHz 1700 57 -64 156 27% 1872
171 Novag Super VIP 1688 53 -58 174 32% 1817
172 Chessmaster 2100 Amiga 68000 1687 65 -76 120 25% 1874
173 Mephisto Europa 1683 50 -52 190 42% 1741
174 Saitek Superstar 36K 6502 2 MHz 1679 23 -24 954 31% 1819
175 Fidelity Elite A/S 6502 3.2 MHz 1678 22 -23 1043 28% 1842
176 Chess Champion 2175 Atari/Amiga 1673 56 -62 157 30% 1822
177 Conchess Glasgow 6502 2 MHz 1668 24 -25 855 34% 1782
178 Novag Quattro 6502 4 MHz 1663 30 -31 560 33% 1791
179 Fidelity Prestige 6502 4 MHz 1661 64 -66 118 44% 1703
180 Chessmaster 2000 Atari 68000 8 MHz 1654 41 -45 312 25% 1841
181 Novag Constellation 6502 3.6 MHz 1648 31 -32 504 41% 1715
182 Novag Constellation Primo 1638 57 -59 149 44% 1683
183 Novag Constellation 6502 2 MHz 1597 32 -33 479 35% 1706
184 CXG Super Enterprise 1563 36 -39 386 28% 1727
Rating : ELO rating
+/- : deviation
Games : number of games played
Won : percentage of games won
Oppo : medium opponent ELO rating
By Thoralf Karlsson, thoralf.karlsson@mailbox.swipnet.se, Chairman of the SSDF
The SSDF rating list is made with the ambition to provide reliable information about the playing strength of chess programs and chess computers.
The ideal way to reach this goal would be to play hundreds of tournament games with each program against humans in the same country or against international ELO-rated players. Unfortunately this is an impossible task.
We have chosen to play matches with 20-40 games between a new program and as many as possible of the earlier tested programs. The goal is to get about 600 - 800 tournament games for each program. This gives us a relative rating, which with 95% probability is within a range of +-25-30 points.
Hopefully this rating could roughly be achieved if the same amount of games were to be played against human players. But we cannot be sure about that. The level of the rating list is based on the results of 337 games against Swedish chess players, played in serious tournaments between 1987 and 1991. The chess computers then used were of course much weaker than todays top programs running on fast hardware.
Many things have to be considered when the ratings are interpreted. Is there a difference between the Swedish rating level and the level in other countries? It seems so. How does the Swedish level correlate to the level in the ELO-system?
Are some chess programs relatively better or worse against humans than other programs? It could be so. But in order to prove that, you would have to play hundreds of games against humans with several of the chess programs, and this has not been done.
Is an improvement with say 400 rating points on the SSDF rating list comparable with the same improvement against humans? Or could there be a "spreading" effect when games between computers are played?
The results in the Aegon-tournament 1992 - 1997, where up to 300 games against humans were played each year, showed ratings slightly above what could be expected from the rating list. This indicates that the level of the list is rather correct, but doesn't prove it. The playing level in Aegon was somewhat faster than tournament play, and the humans didn't have Swedish ratings.
More strictly speaking, the SSDF rating list provides information about the relative ratings for chess programs, when they are tested in the way SSDF has chosen.
Could the result be different with another testing method? Yes, it could. We are presenting results on the tournament level, 40 moves in two hours. Games played on the blitz level or with one minute per move, would probably give a different order of the programs.
The same would most likely happen if we had used a faster or different processor. Some programs run relatively better on a AMD-processor with 64 kB level-1 cache than on P200 MMX.
Programs with good learners benefit from long series of games against the same opponent. If we somehow automatically could change the opponent after each game, the result might differ.
Obviously, the SSDF rating list doesn't say anything about programs which haven't been tested by us. Our ambition is to include all of the strongest commercially available programs. Sometimes we also have the possibility to play with amateur programs.
At the moment some of the stronger programs are missing because of juridical (perhaps illegal?) threats. Another reason for programs not being included is the fact that they cannot be tested automatically with auto232. The reason being that most testers are not willing to go back to the time consuming manual testing.
Thanks to four of SSDFs testers, we can now include one of these programs without auto232, which exactly reached the minimum number of games to be accepted. It is Johan de Konings Chessmaster 6000 P200 MMX, which after one hundred games takes a shared first place on the list with 2576!!
Compared to the earlier program version, CM5000, which we tested on P90, the new program seems to be about 110 points stronger! I can not deny that the result surprised me somewhat. Still, the rating is based on only 100 games with a margin of error of 70-80 points, so much could change if we succeed in playing more games.
Fritz 5.32 has gone up one point, which gives it a shared first place together with CM6000. Hiarcs 7.0 P200 MMX has lost 9 points and now takes the third place.
Chrilly Donningers program Nimzo 99 P200 MMX is new on the list. After 390 games it has a rating of 2565, which gives it a fourth place. Compared to Nimzo 98, the rating has gone up with 42 points!
Most of the games are played with a program version dated 98-12-14, the rest with a version from 98-11-01. The possibility to tell Nimzo 99 if it plays against Rebel, Junior or Fritz has been used in one or two of the matches.
Junior 5 has lost 11 points compared to the latest list, and Atlanta has gained 9 points.
For the nearest future we intend to play more games with Nimzo 99 and CM6000 and probably start with Crafty. As soon as we decide about the next hardware level, the best programs will be retested on the faster processor.
Next list will appear in May.