Object
Title: Nonparametric statistical analysis for multiple comparison of machine learning regression algorithms
Creator:
Trawiński, Bogdan ; Smętek, Magdalena ; Telec, Zbigniew ; Lasota, Tadeusz
Date:
Resource Type:
Contributor:
Cordón, Oskar - ed. ; Kazienko, Przemysław - ed.
Subtitle:
Hybrid and Ensemble Methods in Machine Learning
Group publication title:
Abstract:
In the paper we present some guidelines for the application of nonparametric statistical tests and post-hoc procedures devised to perform multiple comparisons of machine learning algorithms. We emphasize that it is necessary to distinguish between pairwise and multiple comparison tests. ; We show that the pairwise Wilcoxon test, when employed to multiple comparisons, will lead to overoptimistic conclusions. We carry out intensive normality examination employing ten different tests showing that the output of machine learning algorithms for regression problems does not satisfy normality requirements. ; We conduct experiments on nonparametric statistical tests and post-hoc procedures designed for multiple 1×N and N×N comparisons with six different neural regression algorithms over 29 benchmark regression data sets. Our investigation proves the usefulness and strength of multiple comparison statistical procedures to analyse and select machine learning algorithms.
Publisher:
Zielona Góra: Uniwersytet Zielonogórski
Resource Identifier:
DOI:
Pages:
Source:
AMCS, Volume 22, Number 4 (2012) ; click here to follow the link
Language:
Rights:
Biblioteka Uniwersytetu Zielonogórskiego
Object collections:
- Digital Library of Zielona Góra > Repository > Faculties > Faculty of Computer, Electrical and Control Engineering
- Digital Library of Zielona Góra > Repository > Types of work > Articles
- Digital Library of Zielona Góra > Repository > Scientific journals and UZ publishing series > International Journal of Applied Mathematics and Computer Science (AMCS) > International Journal of Applied Mathematics and Computer Science (AMCS) (2012)
Last modified:
Oct 14, 2021
In our library since:
Sep 15, 2021
Number of object content hits:
96
All available object's versions:
https://www.zbc.uz.zgora.pl/publication/65814
Show description in RDF format:
Show description in OAI-PMH format:
-
International Journal of Applied Mathematics and Computer Science (AMCS)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 23 (2013)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 22 (2012)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 22, number 1 (2012)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 22, number 2 (2012)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 22, number 3 (2012)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 22, number 4 (2012)
- International Journal of Applied Mathematics and Computer Science (AMCS), volume 22, number 4 (2012) - spis treści
- Intelligent financial time series forecasting: A complex neuro-fuzzy approach with multi-swarm intelligence
- ReSySTER: A hybrid recommender system for Scrum team roles based on fuzzy and rough sets
- DFIS: A novel data filling approach for an incomplete soft set
- Multi-label classification using error correcting output codes
- A rainfall forecasting method using machine learning models and its application to the Fukuoka city case
- Combined classifier based on feature space partitioning
- Nonparametric statistical analysis for multiple comparison of machine learning regression algorithms
- BEM and FEM results of displacements in a poroelastic column
- A modified state variable diagram method for determination of positive realizations of linear continuous-time systems with delays
- Normalized finite fractional differences: Computational and accuracy breakthroughs
- Observer-based controller design of time-delay systems with an interval time-varying delay
- Novel fault detection criteria based on linear quadratic control performances
- Data-driven models for fault detection using kernel PCA: A water distribution system case study
- Nash equilibrium design and price-based coordination in hierarchical systems
- The island model as a Markov dynamic system
- Designing a ship course controller by applying the adaptive backstepping method
- Customized crossover in evolutionary sets of safe ship trajectories
- Regulation of p53 by siRNA in radiation treated cells: Simulation studies
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 22, number 1 (2012)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 21 (2011)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 20 (2010)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 19 (2009)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 18 (2008)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 17 (2007)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 16 (2006)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 15 (2005)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 13 (2003)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 12 (2002)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 11 (2001)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 10 (2000)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 9 (1999)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 8 (1998)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 7 (1997)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 6 (1996)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 5 (1995)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 4 (1994)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 3 (1993)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 2 (1992)
-
International Journal of Applied Mathematics and Computer Science (AMCS),volume 1 (1991)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 23 (2013)
| Edition name | Date |
|---|---|
| Nonparametric statistical analysis for multiple comparison of machine learning regression algorithms | Oct 14, 2021 |
