Table 1.
Results of Generating 50 Forms by the Proposed ATA Program.
| HSK level | Number of items in the test | Time to generate a form (sec) | Successful assembly rate | Maximum deviation from the reference form |
|||||
|---|---|---|---|---|---|---|---|---|---|
| Listening |
Reading |
Writing |
|||||||
| p | r | p | r | p | r | ||||
| 1 | 40 | 3.5 | 90% | .03 | .04 | .03 | .02 | — | — |
| 2 | 60 | 13.4 | 84% | .02 | .02 | .05 | .02 | — | — |
| 3 | 80 | 18.5 | 86% | .03 | .04 | .04 | .06 | — | — |
| 4 | 100 | 22 | 88% | .05 | .02 | .04 | .03 | .03 | .04 |
| 5 | 100 | 22.8 | 94% | .06 | .05 | .05 | .05 | .04 | .06 |
| 6 | 100 | 12.8 | 100% | .05 | .03 | .04 | .03 | .01 | .02 |
Note. p stands for difficulty statistic and r stands for the discrimination statistic. Computation time was recorded from the test run on a computer with Intel(R)-i5 2520M CPU with 4GB RAM memory. ATA = automated test assembly; HSK = Hanyu Shuiping Kaoshi.