Hi,
I have trained my data using two models(gbm and rf). I get the accuracies
shown below.
How does one get the aggreement accuracy% ? Is that the comparison of the
two confusion matrices ?
Confusion Matrix and Statistics
Reference
Prediction 1 2 3 4 5 6 7 8 9 10 11
1 33 1 0 0 0 0 0 0 0 0 0
2 13 17 4 0 0 0 0 0 0 0 0
3 0 3 25 3 0 0 0 0 0 0 3
4 0 0 0 29 0 5 0 0 0 0 0
5 0 0 0 0 18 4 10 0 0 0 2
6 0 0 0 7 2 16 3 0 0 0 6
7 0 0 3 1 1 0 26 3 0 0 0
8 0 0 0 0 0 0 2 25 3 4 0
9 0 0 0 0 0 0 2 1 21 10 0
10 0 0 0 0 0 0 1 0 9 24 0
11 0 0 0 0 2 4 0 0 2 0 26
Overall Statistics
Accuracy : 0.6952
--------------------------------------------------------------------------------------------------
Confusion Matrix and Statistics
Reference
Prediction 1 2 3 4 5 6 7 8 9 10 11
1 34 0 0 0 0 0 0 0 0 0 0
2 9 19 6 0 0 0 0 0 0 0 0
3 0 1 33 0 0 0 0 0 0 0 0
4 0 0 0 30 0 4 0 0 0 0 0
5 0 0 0 0 21 4 8 0 0 0 1
6 0 0 0 6 3 22 0 0 0 0 3
7 0 0 3 0 1 0 24 5 1 0 0
8 0 0 0 0 0 0 1 32 1 0 0
9 0 0 0 0 0 0 0 0 25 9 0
10 0 0 0 0 0 0 1 0 8 25 0
11 0 0 0 0 0 0 0 0 2 0 32
Overall Statistics
Accuracy : 0.7941
Thanks,
Mohan
[[alternative HTML version deleted]]
I am also wondering how the Accuracy reported by the confusion matrix for gbm and rf could vary with the type of machines. The seed is the same. What other factors could affect the accuracy ? library is caret. Thanks, Mohan On Thu, Sep 25, 2014 at 2:30 PM, Mohan Radhakrishnan < radhakrishnan.mohan at gmail.com> wrote:> Hi, > > I have trained my data using two models(gbm and rf). I get the accuracies > shown below. > > How does one get the aggreement accuracy% ? Is that the comparison of the > two confusion matrices ? > > > > > Confusion Matrix and Statistics > > > Reference > > Prediction 1 2 3 4 5 6 7 8 9 10 11 > > 1 33 1 0 0 0 0 0 0 0 0 0 > > 2 13 17 4 0 0 0 0 0 0 0 0 > > 3 0 3 25 3 0 0 0 0 0 0 3 > > 4 0 0 0 29 0 5 0 0 0 0 0 > > 5 0 0 0 0 18 4 10 0 0 0 2 > > 6 0 0 0 7 2 16 3 0 0 0 6 > > 7 0 0 3 1 1 0 26 3 0 0 0 > > 8 0 0 0 0 0 0 2 25 3 4 0 > > 9 0 0 0 0 0 0 2 1 21 10 0 > > 10 0 0 0 0 0 0 1 0 9 24 0 > > 11 0 0 0 0 2 4 0 0 2 0 26 > > > Overall Statistics > > > > Accuracy : 0.6952 > > > -------------------------------------------------------------------------------------------------- > > Confusion Matrix and Statistics > > > Reference > > Prediction 1 2 3 4 5 6 7 8 9 10 11 > > 1 34 0 0 0 0 0 0 0 0 0 0 > > 2 9 19 6 0 0 0 0 0 0 0 0 > > 3 0 1 33 0 0 0 0 0 0 0 0 > > 4 0 0 0 30 0 4 0 0 0 0 0 > > 5 0 0 0 0 21 4 8 0 0 0 1 > > 6 0 0 0 6 3 22 0 0 0 0 3 > > 7 0 0 3 0 1 0 24 5 1 0 0 > > 8 0 0 0 0 0 0 1 32 1 0 0 > > 9 0 0 0 0 0 0 0 0 25 9 0 > > 10 0 0 0 0 0 0 1 0 8 25 0 > > 11 0 0 0 0 0 0 0 0 2 0 32 > > > Overall Statistics > > > > Accuracy : 0.7941 > > Thanks, > Mohan >[[alternative HTML version deleted]]