search for: mik07

Hi, this is more a general statistics question I think. I am working on a system which automatically answers user questions (such systems are commonly called "Question Answering systems"). I evaluated different versions of the same system on a publicly available test set. This set contains 500 question. Naturally, for each question the answer can be wrong or right, which is coded as

Hi, I am working on a system which automatically answers user questions (such systems are commonly called "Question Answering systems"). I evaluated different versions of the same system on a publicly available test sets. Naturally, there is a fixed number of questions in the test set, and the system answers some right and some wrong. I want to compare each version of the system