Testsuites
Amundsen beginning from version 0.50 is capable of running testsuites through
the "testsuite" command. Write for example "testsuite wac.epd" in order
to run the wac testsuite. The result will be written to the file
"log.testsuite".
Results
(10 seconds of search time has been used for each position)
Testsuite |
Positions |
v0.50 |
v0.55 |
v0.60 |
v0.65 |
v0.70 |
v0.75 |
v0.80 |
bs2830 |
27 |
0 |
0 |
1 |
2 |
3 |
1 |
0 |
bt2630 |
30 |
5 |
8 |
11 |
16 |
18 |
18 |
15 |
ccc-1 |
11 |
2 |
2 |
4 |
4 |
5 |
4 |
4 |
ccc-2 |
11 |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
ccc-3 |
45 |
17 |
21 |
17 |
17 |
23 |
21 |
21 |
ccc-4 |
4 |
2 |
2 |
1 |
1 |
1 |
0 |
1 |
covax |
25 |
0 |
0 |
0 |
1 |
0 |
0 |
0 |
covax2 |
15 |
0 |
0 |
1 |
1 |
1 |
1 |
2 |
covax3 |
170 |
52 |
53 |
59 |
72 |
72 |
74 |
69 |
crafty_test |
347 |
132 |
148 |
168 |
169 |
168 |
162 |
169 |
ecm98 |
770 |
378 |
395 |
479 |
502 |
528 |
506 |
498 |
gmg1 |
100 |
81 |
82 |
84 |
89 |
87 |
89 |
87 |
gmg2 |
48 |
16 |
18 |
22 |
22 |
20 |
21 |
20 |
gmg3 |
63 |
27 |
31 |
36 |
39 |
35 |
37 |
37 |
gs2930 |
14 |
0 |
1 |
1 |
1 |
2 |
0 |
1 |
iq2 |
201 |
52 |
63 |
94 |
99 |
117 |
112 |
99 |
kaufman |
25 |
10 |
15 |
21 |
20 |
20 |
21 |
18 |
nolot |
12 |
0 |
0 |
0 |
0 |
0 |
0 |
0 |
wac |
300 |
262 |
262 |
279 |
284 |
290 |
288 |
281 |
Total |
2218 |
1036 |
1101 |
1278 |
1339 |
1390 |
1355 |
1322 |
Downloading testsuites
bs2830,
bt2630,
ccc-1,
ccc-2,
ccc-3,
ccc-4,
covax,
covax2,
covax3,
crafty_test,
ecm98,
gmg1,
gmg2,
gmg3,
gs2930,
iq2,
kaufman,
nolot,
wac,
perftsuite