Boosting is recognized as one of the most successful techniques for generating classifier ensembles. Typically, the classifier outputs are combined by the weighted majority vote. The purpose of this study is to demonstrate the advantages of some fuzzy combination methods for ensembles of classifiers designed by Boosting. We ran 2-fold cross-validation experiments on 6 benchmark data sets to compare the fuzzy and non-fuzzy combination methods. On the "fuzzy side" we used the fuzzy integral and the decision templates with different similarity measures. On the "non-fuzzy side" we tried simple combiners such as the majority vote, minimum, maximum, average, product, and the Naive Bayes combination. Surprisingly, the minimum, maximum, average and product, which have been reported elsewhere to work very well on a variety of problems, appeared to be inadequate for our task. Thus the real contest was among the fuzzy combination methods on the one hand, and the weighted majority vote, the simple majority vote, and the Naive Bayes combiner, on the other hand. In our experiments, the fuzzy methods performed consistently better than the nonfuzzy methods. The weighted majority vote showed a stable performance, though slightly inferior to the performance of the fuzzy combiners. The majority vote and the Naive Bayes combiners had erratic behavior, ranging from the best to the worst contestants for different data sets.

Abstract—A large experiment on Persian handwritten digits are reported and discussed. In this paper the techniques to combine multiple classifiers based on static structures is investigated. A static structure includes two main strategies to combine result of base classifiers: a) class indifferent methods b) class conscious methods. We establish our model on Decision Template and Dempster Shafer, which are under category of class indifferent method, and compare theirs recognition rate with five of the most famous combining methods of class conscious category. To evaluate our proposed model a real-world database of Persian handwritten digits containing 8600 handwritten digit images is used. Experiments using our database demonstrate that combining result of base classifiers with class indifferent methods indeed are far more effective than combining the result with class conscious methods in Persian handwritten digit recognition. Evaluating the proposed system with 2150 test samples the recognition rate of 91.98 % is achieved. Keywords—Class conscious, Class indifferent, Classifier fusion,