MetaCartSign in to MyCiteSeer

Include Citations | Advanced Search | Help

Include Citations | Advanced Search | Help

  and Tadao NAKAMURA +, Members

Download:
pdf
by Hiroyuki Takizawa, Taira Nakajima, Hiroaki Kobayashi, Summary A
http://search.ieice.org/2000/files/../pdf/e83-d_1_90.pdf
Add To MetaCart

Abstract:

multilay er perceptron isusually considered a passive learner thatonly receives given training data. However, if a multilay er perceptron actively gathers training data that resolve its uncertainty about a problem being learnt, su#ciently accurate classification is attained with fewer training data. Recently, such active learning has been receiving an increasing interest. In this paper, we propose a novel active learningstrategy hestrategy attempts to produceonly useful training data for multilay er perceptrons to achieve accurate classification, and avoids generating redundant training data. Furthermore, thestrategy attempts to avoid generating temporarily useful training data that will become redundant in the future. As a result, thestrategy can allow multilay er perceptrons to achieve accurate classification with fewer training data. o demonstrate the performance of the strategy in comparison with other active learning strategies, we also propose an empirical active learning algorithm as an implementation of thestrategy, which does not require expensive computations. Experimental results show that the proposed algorithm improves the classificationaccuracy of a multilay er perceptron with fewer training data than that for a conventional random selection algorithm that constructs a training data set without explicit strategies. Moreover, the algorithm outperforms ty/6 cal active learning algorithms in the experiments. hose results show that the algorithm can construct an appropriate training data set at lower computational cost, because training data generation isusually costly

Citations

431 Learning representation by back propagating errors – Rumelhart, Hinton, et al. - 1986
371 A direct adaptive method for faster backpropagation learning: the RPROP algorithm – Riedmiller, Braun - 1993
293 What size net gives valid generalization – Baum, Haussler - 1989
162 Information-based objective functions for active data selection – MacKay - 1992
99 Neural network exploration using optimal experiment design – Cohn - 1994
51 Training connectionist networks with queries and selective sampling – Cohn, Atlas, et al. - 1990
17 Decision boundary feature extraction for neural networks – Lee, Landgrebe - 1997
10 Minimizing Statistical Bias with Queries – Cohn - 1997
7 A method for improving classification reliability of multilayer perceptrons – Cordella, Stefano, et al. - 1995
3 Cross-validation with active pattern selection for neural-netowrk classifiers – Leisch, Jain, et al. - 1998
3 Randomness in generalization ability: A source to improve it – Sarkar - 1996
1 al: AN ACTIVE LEARNING ALGORITHM BASED ON EXISTING TRAINING DATA [2] L. Prechelt, "PROBEN1 -- A set of benchmarks and benchmarking rules for neural network training algorithms," Technical report, Fakultat fur Informatik, Universitat Karlsruhe, n – et - 1994
1 Neural-network classifiers for recognizingtotally unconstrained handwritten numerals – Cho - 1997
1 Neural nets that learn in polyS"/T4 time from examples and queries – Baum - 1991
1 Active learining with statistical models – Cohn, Ghahramani, et al. - 1995
1 II,"Query based learning applied topartially trained multilay er perceptrons – Hwang, Choi, et al. - 1991
1 Tishby , "Information, prediction, andquery by committee – Freund, Seung, et al. - 1993
1 An empiricalstudy of learning speed in back-propagation networks – Fahlman - 1988
1 Training feedforward neural networks: An algorithm giving improved generalization – Lee - 1997
1 received the B.E. degree in Mechanical Engineering, and the M.E. degree in Information Science from ohoku University – He - 1997
1 is currently a research associate of Graduate School of Information Sciences, ohoku University . His research interests include neural networks and pattern recognition. He received the – Nakajima - 1999
1 is currently an associate professor of Department of Computer and Mathematical Sciences, Graduate School of Information Sciences, ohoku University – Kobayashi - 1995