Three Hours on Multiple Classififier Systems

Motivations and basic concepts Motivations of multiple classifier systems. The “worst” case and “best” case motivations. Practical and theoretical motivations. Basic concepts. Architectures for multiple classifier systems. Ensemble types, combiner types. The concept of classifier “diversity”. The design cycle of a multiple classifier system. Creating multiple classifiers Systematic methods for creating classifier ensembles. Methods based on training data manipulation: data splitting methods, Bagging and Boosting. Methods based on input and output feature manipulation: feature selection, the Random Subspace method, noise injection, and error-correcting codes. Combining multiple classifiers Methods for combining multiple classifiers at the “abstract” level (voting methods, the Behaviour Knowledge Space method, etc.) Methods for combining multiple classifiers at the “rank” level (the Borda count method, etc.) Methods for combining multiple classifiers at the “measurement” level (linear combiners, the product rule, etc.) Basic concepts on dynamic classifier selection methods.