Neha gupta
2022-Feb-28 21:56 UTC
[R] How to perform statistical test with multiple variables
Hello everyone, I have 'mean absolute error' values from different folds of CV of 6 ML models.. a= c(0.3, 0.5, ..... 0.4) b= c(0.4, 0.6,...... 0.2) .... .. f= c(0.1, 0.4, .....0.5) Now algorithm 'a' performed better than all the others (in terms of mean absolute error scores) and then I used wilcoxon signed rank test to compare 'a' with all other models for significance difference. Now, I have been asked to compare all the models with all others for significant differences at once and not compare one with the other, how can I do it, plz guide me? At this time, I just know about the Wilcoxon signed rank test. Regards [[alternative HTML version deleted]]
Jim Lemon
2022-Feb-28 22:14 UTC
[R] How to perform statistical test with multiple variables
Hi neha, Ouch! I've just been run over by homework. What you are probably being asked to do is an "omnibus test", but I can't figure out what you are actually testing. Maybe that phrase will help you in _your_ search for the answer. Jim On Tue, Mar 1, 2022 at 8:56 AM Neha gupta <neha.bologna90 at gmail.com> wrote:> > Hello everyone, > > I have 'mean absolute error' values from different folds of CV of 6 ML > models.. > a= c(0.3, 0.5, ..... 0.4) > b= c(0.4, 0.6,...... 0.2) > .... > .. > f= c(0.1, 0.4, .....0.5) > Now algorithm 'a' performed better than all the others (in terms of mean > absolute error scores) and then I used wilcoxon signed rank test to compare > 'a' with all other models for significance difference. > > Now, I have been asked to compare all the models with all others for > significant differences at once and not compare one with the other, how can > I do it, plz guide me? At this time, I just know about the Wilcoxon signed > rank test. > Regards > > [[alternative HTML version deleted]] > > ______________________________________________ > R-help at r-project.org mailing list -- To UNSUBSCRIBE and more, see > https://stat.ethz.ch/mailman/listinfo/r-help > PLEASE do read the posting guide http://www.R-project.org/posting-guide.html > and provide commented, minimal, self-contained, reproducible code.