Rating + - Games Won Oppo ------ --- --- ----- --- ---- 1 Chessmaster 6000 64MB P200 MMX 2576 88 -71 100 78% 2363 1 Fritz 5.32 64MB P200 MMX 2576 29 -28 627 66% 2457 3 Hiarcs 7.0 64MB P200 MMX 2567 28 -27 676 63% 2471 4 Nimzo 99 64MB P200 MMX 2565 37 -35 390 63% 2472 5 Fritz 5.0 PB29% 67MB P200 MMX 2564 24 -23 946 67% 2436 6 Junior 5.0 64MB P200 MMX 2543 30 -29 576 63% 2447 7 Hiarcs 6.0 48MB P200 MMX 2524 25 -25 802 57% 2473 8 Nimzo 98 57MB P200 MMX 2523 24 -23 899 59% 2459 9 190 2522 54 -50 201 69% 2379 9 Rebel 9.0 46MB P200 MMX 2522 25 -24 843 62% 2437 11 Rebel 8.0 46MB P200 MMX 2507 31 -30 533 58% 2448 12 MChess Pro 6.0 41MB P200 MMX 2506 28 -28 637 57% 2453 13 MChess Pro 7.1 42MB P200 MMX 2505 24 -24 834 56% 2460 14 Shredder 2.0 57MB P200 MMX 2502 25 -25 765 55% 2464 15 Genius 5.0 DOS 44MB P200 MMX 2495 24 -23 883 56% 2449 16 MChess Pro 8.0 64MB P200 MMX 2481 30 -29 560 53% 2456 17 Gandalf 3.0 64MB P200 MMX 2466 41 -40 307 59% 2399 18 Kallisto II 64MB P200 MMX 2445 35 -35 403 52% 2430 19 Rebel 8.0 Pentium 90 MHz 2440 19 -18 1412 55% 2402 20 Rebel 9.0 Pentium 90 MHz 2438 25 -25 767 49% 2445 21 Hiarcs 6.0 Pentium 90 MHz 2434 19 -19 1293 52% 2419 22 Genius 5.0 DOS Pentium 90 MHz 2431 20 -20 1269 51% 2424 23 Hiarcs 5.0 Pentium 90 MHz 2428 38 -36 363 59% 2362 24 MChess Pro 6.0 Pentium 90 MHz 2416 19 -19 1406 49% 2420 25 Genius 3.0 Pentium 90 MHz 2409 26 -25 785 61% 2329 26 MChess Pro 5.0 Pentium 90 MHz 2407 26 -25 769 63% 2315 26 Rebel 6.0 Pentium 90 MHz 2407 31 -30 540 60% 2335 28 Genius 4.0 DOS Pentium 90 MHz 2404 23 -23 944 60% 2335 29 Rebel 7.0 Pentium 90 MHz 2402 26 -25 759 61% 2319 30 Hiarcs 4.0 Pentium 90 MHz 2393 25 -25 766 55% 2358 31 Nimzo 3.5 Pentium 90 MHz 2389 23 -23 937 46% 2419 32 Junior 4.0 Pentium 90 MHz 2388 23 -23 916 43% 2438 33 Chessmaster 5000 Pentium 90 MHz 2387 49 -45 240 67% 2262 34 Shredder 1.0 Pentium 90 MHz 2385 59 -58 145 53% 2365 35 Nimzo 3.0 Pentium 90 MHz 2380 26 -25 767 58% 2322 36 Hiarcs 3.0 Pentium 90 MHz 2374 30 -30 545 56% 2329 37 R30 v. 2.5 2371 43 -40 303 66% 2255 38 Genius 4.0 DOS 486/50-66 MHz 2367 23 -23 891 50% 2369 39 Junior 3.3-3.5 Pentium 90 MHz 2358 31 -31 516 47% 2378 40 Genius 3.0 486/50-66 MHz 2356 24 -23 910 62% 2268 41 MChess Pro 4.0 Pentium 90 MHz 2355 29 -29 578 52% 2339 42 CometA90 64MB P200 MMX 2354 37 -39 358 36% 2453 43 Fritz 3.0 Pentium 90 MHz 2341 19 -19 1327 44% 2383 44 Mephisto Genius 2.0 486/50-66 MHz 2336 23 -23 917 58% 2276 45 Fritz 4.0 Pentium 90 MHz 2334 40 -39 324 60% 2263 46 WChess 1.06 Pentium 90 MHz 2332 21 -21 1106 40% 2405 47 MChess Pro 5.0 486/50-66 MHz 2328 26 -26 691 50% 2331 47 Rebel 7.0 486/50-66 MHz 2328 26 -26 737 50% 2329 49 Kallisto 1.98 Pentium 90 MHz 2326 22 -22 1017 42% 2380 50 MChess Pro 4.0 486/50-66 MHz 2310 24 -24 846 53% 2286 51 Chess Machine 30-32 MHz Schröder 3.1 2301 32 -30 546 68% 2170 52 WChess 1.03 486/50-66 MHz 2298 27 -27 677 49% 2305 52 Meph Genius 68 030 33 MHz 2298 45 -44 248 55% 2260 54 Rebel 6.0 486/50-66 MHz 2297 24 -23 887 55% 2263 54 Hiarcs 3.0 486/50-66 MHz 2297 24 -24 865 50% 2294 56 Ch.Machine 30 MHz King 2.0 aggr/R30off 2293 21 -20 1202 64% 2193 57 Chessmaster 4000 486/50-66 MHz 2291 34 -33 462 66% 2171 58 Chess Genius 1.0 486/50-66 MHz 2283 23 -23 931 54% 2255 59 Rebel Decade Pentium 90 MHz 2276 29 -30 563 45% 2313 60 Chess Machine 30 MHz Schröder 3.0 2274 62 -55 168 73% 2102 61 Mephisto Gideon Pro 486/50-66 MHz 2271 35 -34 421 62% 2183 62 MChess Pro 3.5 486/50-66 MHz 2268 23 -22 958 51% 2259 63 MChess Pro 3.12 486/50-66 MHz 2264 36 -34 438 69% 2122 64 Fritz 3.0 486/50-66 MHz 2257 20 -20 1226 45% 2291 65 Mephisto Lyon 68030 36 MHz 2252 28 -27 716 68% 2116 66 Chess Genius 1.0 486/33 MHz 2240 32 -32 463 50% 2240 67 Mephisto Portorose 68030 36 MHz 2238 40 -36 407 77% 2028 68 Mephisto Vancouver 68030 36 MHz 2227 35 -33 471 71% 2071 69 MChess Pro 3.12 486/33 MHz 2226 50 -48 208 60% 2152 69 Meph RISC 2 1 MB 2226 62 -66 125 39% 2306 71 Berlin Pro 68 020 24 MHz 2225 24 -24 850 58% 2171 72 Kasparov SPARC 20 MHz 2223 23 -24 879 47% 2246 73 Kallisto 1.82-1.83 486/50-66 MHz 2210 21 -22 1077 41% 2272 74 Comet32 Pentium 90 MHz 2201 24 -25 968 23% 2406 75 Mephisto RISC 1 MB ARM 2 14 MHz 2200 20 -20 1194 56% 2158 76 Hiarcs Master 2.0 486/33 MHz 2199 46 -46 229 51% 2190 77 Mephisto Montreux ARM 14 MHz 512K 2196 30 -28 649 73% 2025 78 MChess 1.1-1.71 486/33 MHz 2193 44 -40 326 74% 2014 79 Chess Machine Schröder 512K ARM2 16MHz 2192 27 -26 703 62% 2108 80 Saitek RISC 2500 ARM2 14 MHz 128K 2191 20 -20 1176 55% 2157 80 Atlanta SH7000 20 MHz 2191 48 -45 237 62% 2101 82 Chess Machine The King 512K ARM2 16MHz 2174 32 -32 473 55% 2135 83 Mephisto Vancouver 68020 12 MHz 2161 23 -22 1021 65% 2048 84 Mephisto Lyon 68020 12 MHz 2150 19 -18 1442 59% 2086 85 Socrates 3.0 486/33 MHz 2139 49 -50 203 47% 2160 86 Fritz 2.0 486/33 MHz 2129 30 -31 527 45% 2164 87 Mephisto Portorose 68020 12 MHz 2127 26 -24 896 73% 1956 88 M Chess 1.1-1.71 386/25-33 MHz 2126 36 -35 408 65% 2017 89 Fidelity Elite 68030 32 MHz (vers.9) 2121 31 -30 521 60% 2048 90 Mephisto Berlin 68 000 12 MHz 2115 22 -22 986 57% 2066 91 Sapphire II 2112 36 -35 404 64% 2008 92 Mephisto Vancouver 68000 12 MHz 2105 21 -21 1099 55% 2072 93 Mephisto Lyon 68000 12 MHz 2103 21 -21 1143 57% 2051 94 Mephisto MM 4 Turbo Kit 6502 16 MHz 2093 46 -42 292 73% 1918 95 Novag Sapphire H8 10 MHz 2090 22 -22 1014 47% 2108 96 Milano Pro SH7000 20 MHz 2078 35 -34 429 63% 1985 97 Fidelity Mach IV 68020 20 MHz 2074 18 -18 1475 49% 2084 98 Mephisto Almeria 68020 12 MHz 2073 42 -40 305 62% 1985 99 Hiarcs Master 1.0 486/33 MHz 2070 48 -48 214 48% 2086 100 Mephisto Portorose 68000 12 MHz 2045 25 -24 827 62% 1960 101 Mephisto Polgar 6502 10 MHz 2043 43 -41 283 59% 1979 102 Fritz 1.0 486/33 MHz 2041 48 -47 215 55% 2008 103 Gandalf 2.1 Pentium 90 MHz 2038 46 -51 242 27% 2212 104 Fidelity Elite 68000 x 2 (vers. 5) 2037 49 -48 209 57% 1987 105 Nimzo 2.2.1 486/33 MHz 2033 46 -47 229 42% 2088 106 Mephisto Roma 68020 14 MHz 2030 27 -26 712 65% 1919 106 Rex Chess 2.3 386/25-33 MHz 2030 65 -62 126 59% 1964 108 Zarkov 3.0 486/25-33 MHz 2029 46 -48 232 39% 2108 109 Mephisto Dallas 68020 14 MHz 2023 35 -32 492 72% 1861 110 Mephisto Almeria 68000 12 MHz 2021 32 -30 534 67% 1898 111 Zarkov 2.5 386/25-33 MHz 2020 56 -53 168 61% 1941 112 Kasparov Brute Force H8 10 MHz 2018 23 -23 906 44% 2057 113 Fritz 1.0 386/25-33 MHz 2007 66 -67 113 46% 2039 114 Novag Diablo 68000 16 MHz 2005 21 -21 1123 41% 2071 115 Fidelity Mach III 68000 16 MHz 1993 14 -14 2410 52% 1980 116 Complete Chess System 486/33 MHz 1984 47 -47 221 47% 2006 117 Kasparov President/GK-2100 H8 10 MHz 1978 29 -29 581 46% 2006 118 Mephisto MM 5 6502 5 MHz 1974 19 -19 1374 47% 1997 119 Mephisto Dallas 68000 12 MHz 1971 21 -20 1177 61% 1894 120 Mephisto Polgar 6502 5 MHz 1970 16 -17 1793 41% 2036 120 Mephisto Roma 68000 12 MHz 1970 18 -18 1519 56% 1927 122 Mephisto Milano 6502 5 MHz 1963 24 -24 860 41% 2028 123 Novag Super Expert C 6502 6 MHz Sel 5 1960 18 -18 1555 46% 1991 123 Zarkov 2.6 386/25-33 MHz 1960 64 -62 125 56% 1917 125 Mephisto Academy 6502 5 MHz 1939 18 -18 1535 44% 1982 126 Chessmaster 3000 386/25-33 MHz 1933 68 -74 103 36% 2031 127 Rex Chess 2.3 386/16-20 MHz 1930 53 -53 174 49% 1936 128 Saitek Leonardo Maestro B 6502 18 MHz 1928 73 -67 105 62% 1842 129 Mephisto Amsterdam 68000 12 MHz 1927 22 -22 1020 58% 1873 130 Novag Super Expert B 6502 6 MHz sel 4 1919 29 -29 564 48% 1935 131 Mephisto Mega IV 6502 4.9 MHz 1916 17 -18 1584 44% 1960 131 Saitek Maestro D 6502 10 MHz 1916 26 -26 736 51% 1909 133 Fidelity Excel Mach IIc 68000 12 MHz 1915 23 -23 955 50% 1911 134 Novag Expert Turbo Kit 6502 16 MHz 1910 67 -63 120 61% 1830 135 Mephisto MM 4 6502 5 MHz 1904 19 -19 1288 51% 1900 136 Fidelity Travel Master H8/330 10 MHz 1897 65 -79 123 22% 2112 136 Mephisto Modena 6502 4 MHz 1897 27 -28 655 40% 1968 138 Kasparov GK-2000 H8 10 MHz 1896 29 -29 593 42% 1952 139 Psion Atari 68000 8 MHz 1882 18 -18 1487 44% 1928 140 CXG Sphinx Galaxy 6502 4 MHz 1880 17 -17 1710 37% 1974 141 Novag Ruby H8 10 MHz 1879 30 -30 545 42% 1934 142 Fidelity Excel Mach IIa 68000 12 MHz 1878 46 -47 226 47% 1898 143 Saitek Turboking II 6502 5 MHz 1868 23 -23 963 37% 1964 144 Conchess Plymate Victoria 6502 5.5 MHz 1867 26 -27 701 40% 1941 145 Fidelity Excel Club 68000 12 MHz 1858 23 -23 931 51% 1849 146 Mephisto Mega IV Brute Force 1849 34 -35 422 38% 1939 147 Novag Super Expert/Forte A 6502 5 MHz 1837 19 -19 1358 38% 1923 148 Fidelity Par Excellence 6502 5 MHz 1835 22 -22 1022 48% 1846 148 Fidelity Avant Garde 6502 5 MHz 1835 20 -20 1196 46% 1866 150 Mephisto Rebell 6502 5 MHz 1824 19 -19 1393 38% 1909 151 Saitek Stratos/Analys B 6502 6 MHz 1820 20 -21 1213 38% 1908 152 Mephisto Super Mondial 6502 4 MHz 1819 19 -19 1375 37% 1914 153 Novag Forte B 6502 5 MHz 1816 24 -24 837 44% 1860 154 Saitek Leonardo Maestro A 6502 6 MHz 1811 30 -30 547 45% 1846 155 Novag Forte A 6502 5 MHz 1810 22 -22 964 48% 1822 156 Conchess Plymate 6502 5.5 MHz 1808 15 -16 2040 40% 1882 157 Saitek Simultano/Corona C 6502 5 MHz 1806 23 -24 969 33% 1932 158 Fidelity Excellence 6502 4 MHz 1801 18 -18 1565 43% 1852 159 Novag Expert 6502 4 MHz 1789 24 -24 843 42% 1847 160 Fidelity Elegance 6502 3.6 MHz 1781 40 -40 303 54% 1752 161 Conchess Plymate 6502 4 MHz 1780 39 -38 333 55% 1748 162 Mephisto MM 2 6502 3.7 MHz 1773 49 -48 208 52% 1756 163 Saitek Turbostar 432 6502 4 MHz 1765 22 -22 1005 45% 1803 164 Fidelity Excellence 6502 3 MHz 1757 22 -23 960 42% 1815 165 Saitek Kasparov Blitz 1734 45 -47 239 37% 1825 165 Novag Super Nova 1734 37 -38 350 40% 1803 167 Novag Super Constellation 6502 4 MHz 1732 18 -18 1626 35% 1841 168 Conchess Glasgow 6502 4 MHz 1720 39 -39 327 50% 1722 169 Chessplayer 2150 Atari/Amiga 1714 58 -63 146 33% 1837 170 The Final Chesscard 6502 5 MHz 1700 57 -64 156 27% 1872 171 Novag Super VIP 1688 53 -58 174 32% 1817 172 Chessmaster 2100 Amiga 68000 1687 65 -76 120 25% 1874 173 Mephisto Europa 1683 50 -52 190 42% 1741 174 Saitek Superstar 36K 6502 2 MHz 1679 23 -24 954 31% 1819 175 Fidelity Elite A/S 6502 3.2 MHz 1678 22 -23 1043 28% 1842 176 Chess Champion 2175 Atari/Amiga 1673 56 -62 157 30% 1822 177 Conchess Glasgow 6502 2 MHz 1668 24 -25 855 34% 1782 178 Novag Quattro 6502 4 MHz 1663 30 -31 560 33% 1791 179 Fidelity Prestige 6502 4 MHz 1661 64 -66 118 44% 1703 180 Chessmaster 2000 Atari 68000 8 MHz 1654 41 -45 312 25% 1841 181 Novag Constellation 6502 3.6 MHz 1648 31 -32 504 41% 1715 182 Novag Constellation Primo 1638 57 -59 149 44% 1683 183 Novag Constellation 6502 2 MHz 1597 32 -33 479 35% 1706 184 CXG Super Enterprise 1563 36 -39 386 28% 1727 Rating : ELO rating +/- : deviation Games : number of games played Won : percentage of games won Oppo : medium opponent ELO rating
By Thoralf Karlsson, thoralf.karlsson@mailbox.swipnet.se, Chairman of the SSDF
The SSDF rating list is made with the ambition to provide reliable information about the playing strength of chess programs and chess computers.
The ideal way to reach this goal would be to play hundreds of tournament games with each program against humans in the same country or against international ELO-rated players. Unfortunately this is an impossible task.
We have chosen to play matches with 20-40 games between a new program and as many as possible of the earlier tested programs. The goal is to get about 600 - 800 tournament games for each program. This gives us a relative rating, which with 95% probability is within a range of +-25-30 points.
Hopefully this rating could roughly be achieved if the same amount of games were to be played against human players. But we cannot be sure about that. The level of the rating list is based on the results of 337 games against Swedish chess players, played in serious tournaments between 1987 and 1991. The chess computers then used were of course much weaker than todays top programs running on fast hardware.
Many things have to be considered when the ratings are interpreted. Is there a difference between the Swedish rating level and the level in other countries? It seems so. How does the Swedish level correlate to the level in the ELO-system?
Are some chess programs relatively better or worse against humans than other programs? It could be so. But in order to prove that, you would have to play hundreds of games against humans with several of the chess programs, and this has not been done.
Is an improvement with say 400 rating points on the SSDF rating list comparable with the same improvement against humans? Or could there be a "spreading" effect when games between computers are played?
The results in the Aegon-tournament 1992 - 1997, where up to 300 games against humans were played each year, showed ratings slightly above what could be expected from the rating list. This indicates that the level of the list is rather correct, but doesn't prove it. The playing level in Aegon was somewhat faster than tournament play, and the humans didn't have Swedish ratings.
More strictly speaking, the SSDF rating list provides information about the relative ratings for chess programs, when they are tested in the way SSDF has chosen.
Could the result be different with another testing method? Yes, it could. We are presenting results on the tournament level, 40 moves in two hours. Games played on the blitz level or with one minute per move, would probably give a different order of the programs.
The same would most likely happen if we had used a faster or different processor. Some programs run relatively better on a AMD-processor with 64 kB level-1 cache than on P200 MMX.
Programs with good learners benefit from long series of games against the same opponent. If we somehow automatically could change the opponent after each game, the result might differ.
Obviously, the SSDF rating list doesn't say anything about programs which haven't been tested by us. Our ambition is to include all of the strongest commercially available programs. Sometimes we also have the possibility to play with amateur programs.
At the moment some of the stronger programs are missing because of juridical (perhaps illegal?) threats. Another reason for programs not being included is the fact that they cannot be tested automatically with auto232. The reason being that most testers are not willing to go back to the time consuming manual testing.
Thanks to four of SSDFs testers, we can now include one of these programs without auto232, which exactly reached the minimum number of games to be accepted. It is Johan de Konings Chessmaster 6000 P200 MMX, which after one hundred games takes a shared first place on the list with 2576!!
Compared to the earlier program version, CM5000, which we tested on P90, the new program seems to be about 110 points stronger! I can not deny that the result surprised me somewhat. Still, the rating is based on only 100 games with a margin of error of 70-80 points, so much could change if we succeed in playing more games.
Fritz 5.32 has gone up one point, which gives it a shared first place together with CM6000. Hiarcs 7.0 P200 MMX has lost 9 points and now takes the third place.
Chrilly Donningers program Nimzo 99 P200 MMX is new on the list. After 390 games it has a rating of 2565, which gives it a fourth place. Compared to Nimzo 98, the rating has gone up with 42 points!
Most of the games are played with a program version dated 98-12-14, the rest with a version from 98-11-01. The possibility to tell Nimzo 99 if it plays against Rebel, Junior or Fritz has been used in one or two of the matches.
Junior 5 has lost 11 points compared to the latest list, and Atlanta has gained 9 points.
For the nearest future we intend to play more games with Nimzo 99 and CM6000 and probably start with Crafty. As soon as we decide about the next hardware level, the best programs will be retested on the faster processor.
Next list will appear in May.