Testsuites

Amundsen beginning from version 0.50 is capable of running testsuites through the "testsuite" command. Write for example "testsuite wac.epd" in order to run the wac testsuite. The result will be written to the file "log.testsuite".

Results

(10 seconds of search time has been used for each position)
Testsuite Positions   v0.50   v0.55   v0.60   v0.65   v0.70   v0.75   v0.80
bs2830 27 0 0 1 2 3 1 0
bt2630 30 5 8 11 16 18 18 15
ccc-1 11 2 2 4 4 5 4 4
ccc-2 11 0 0 0 0 0 0 0
ccc-3 45 17 21 17 17 23 21 21
ccc-4 4 2 2 1 1 1 0 1
covax 25 0 0 0 1 0 0 0
covax2 15 0 0 1 1 1 1 2
covax3 170 52 53 59 72 72 74 69
crafty_test 347 132 148 168 169 168 162 169
ecm98 770 378 395 479 502 528 506 498
gmg1 100 81 82 84 89 87 89 87
gmg2 48 16 18 22 22 20 21 20
gmg3 63 27 31 36 39 35 37 37
gs2930 14 0 1 1 1 2 0 1
iq2 201 52 63 94 99 117 112 99
kaufman 25 10 15 21 20 20 21 18
nolot 12 0 0 0 0 0 0 0
wac 300 262 262 279 284 290 288 281
Total 2218 1036 1101 1278 1339 1390 1355 1322

Downloading testsuites

bs2830, bt2630, ccc-1, ccc-2, ccc-3, ccc-4, covax, covax2, covax3, crafty_test, ecm98, gmg1, gmg2, gmg3, gs2930, iq2, kaufman, nolot, wac, perftsuite