by Hiroyuki Takizawa, Taira Nakajima, Hiroaki Kobayashi, Summary A
http://search.ieice.org/2000/files/../pdf/e83-d_1_90.pdf
Add To MetaCart
Abstract:
multilay er perceptron isusually considered a passive learner thatonly receives given training data. However, if a multilay er perceptron actively gathers training data that resolve its uncertainty about a problem being learnt, su#ciently accurate classification is attained with fewer training data. Recently, such active learning has been receiving an increasing interest. In this paper, we propose a novel active learningstrategy hestrategy attempts to produceonly useful training data for multilay er perceptrons to achieve accurate classification, and avoids generating redundant training data. Furthermore, thestrategy attempts to avoid generating temporarily useful training data that will become redundant in the future. As a result, thestrategy can allow multilay er perceptrons to achieve accurate classification with fewer training data. o demonstrate the performance of the strategy in comparison with other active learning strategies, we also propose an empirical active learning algorithm as an implementation of thestrategy, which does not require expensive computations. Experimental results show that the proposed algorithm improves the classificationaccuracy of a multilay er perceptron with fewer training data than that for a conventional random selection algorithm that constructs a training data set without explicit strategies. Moreover, the algorithm outperforms ty/6 cal active learning algorithms in the experiments. hose results show that the algorithm can construct an appropriate training data set at lower computational cost, because training data generation isusually costly
Citations
|
431
|
Learning representation by back propagating errors
– Rumelhart, Hinton, et al.
- 1986
|
|
371
|
A direct adaptive method for faster backpropagation learning: the RPROP algorithm
– Riedmiller, Braun
- 1993
|
|
293
|
What size net gives valid generalization
– Baum, Haussler
- 1989
|
|
162
|
Information-based objective functions for active data selection
– MacKay
- 1992
|
|
99
|
Neural network exploration using optimal experiment design
– Cohn
- 1994
|
|
51
|
Training connectionist networks with queries and selective sampling
– Cohn, Atlas, et al.
- 1990
|
|
17
|
Decision boundary feature extraction for neural networks
– Lee, Landgrebe
- 1997
|
|
10
|
Minimizing Statistical Bias with Queries
– Cohn
- 1997
|
|
7
|
A method for improving classification reliability of multilayer perceptrons
– Cordella, Stefano, et al.
- 1995
|
|
3
|
Cross-validation with active pattern selection for neural-netowrk classifiers
– Leisch, Jain, et al.
- 1998
|
|
3
|
Randomness in generalization ability: A source to improve it
– Sarkar
- 1996
|
|
1
|
al: AN ACTIVE LEARNING ALGORITHM BASED ON EXISTING TRAINING DATA [2] L. Prechelt, "PROBEN1 -- A set of benchmarks and benchmarking rules for neural network training algorithms," Technical report, Fakultat fur Informatik, Universitat Karlsruhe, n
– et
- 1994
|
|
1
|
Neural-network classifiers for recognizingtotally unconstrained handwritten numerals
– Cho
- 1997
|
|
1
|
Neural nets that learn in polyS"/T4 time from examples and queries
– Baum
- 1991
|
|
1
|
Active learining with statistical models
– Cohn, Ghahramani, et al.
- 1995
|
|
1
|
II,"Query based learning applied topartially trained multilay er perceptrons
– Hwang, Choi, et al.
- 1991
|
|
1
|
Tishby , "Information, prediction, andquery by committee
– Freund, Seung, et al.
- 1993
|
|
1
|
An empiricalstudy of learning speed in back-propagation networks
– Fahlman
- 1988
|
|
1
|
Training feedforward neural networks: An algorithm giving improved generalization
– Lee
- 1997
|
|
1
|
received the B.E. degree in Mechanical Engineering, and the M.E. degree in Information Science from ohoku University
– He
- 1997
|
|
1
|
is currently a research associate of Graduate School of Information Sciences, ohoku University . His research interests include neural networks and pattern recognition. He received the
– Nakajima
- 1999
|
|
1
|
is currently an associate professor of Department of Computer and Mathematical Sciences, Graduate School of Information Sciences, ohoku University
– Kobayashi
- 1995
|