See this document in CiteSeerX!

A Fast Stochastic Error-Descent Algorithm for Supervised Learning and Optimization (1993)  (Make Corrections)  (17 citations)
Gert Cauwenberghs
Advances in Neural Information Processing Systems



  Home/Search   Context   Related

 
View or download:
ohiostate.edu/pub...berghs.nips92.ps.Z
Cached:  PS.gz  PS  PDF   Image  Update  Help

From:  egbert.cistron.nl/neuroprose (more)
(Enter author homepages)

Rate this article: (best)
  Comment on this article  
(Enter summary)

Abstract: A parallel stochastic algorithm is investigated for error-descent learning and optimization in deterministic networks of arbitrary topology. No explicit information about internal network structure is needed. The method is based on the model-free distributed learning mechanism of Dembo and Kailath. A modified parameter update rule is proposed by which each individual parameter vector perturbation contributes a decrease in error. A substantially faster learning speed is hence allowed.... (Update)

Context of citations to this paper:   More

.... Perturbation In weight perturbation (Jabri and Flower, 1991; Alspector et al. 1993; Flower and Jabri, 1993; Kirk et al. 1993; Cauwenberghs, 1993) the gradient r w is approximated using only the globally broadcast result of the computation of E(w) This is done by adding a...

Cited by:   More
LETTER Communicated by Tom Heskes Learning Curves for.. - Justin Werfel Jkwerfel (2005)   (Correct)
Learning Curves for Stochastic Gradient Descent in Linear.. - Werfel, Xie (2004)   (Correct)
On Growing Better Decision Trees from Data - Murthy (1996)   (Correct)

Active bibliography (related documents):   More   All
1.2:   Accurate and Precise Computation using Analog VLSI, with.. - Kirk (1993)   (Correct)
0.6:   A Learning Analog Neural Network Chip with Continuous-Time.. - Cauwenberghs   (Correct)
0.3:   A Low Power VLSI Arrhythmia Classifier - Leong, Jabri (1999)   (Correct)

Similar documents based on text:   More   All
0.2:   Unknown - Approximate Localisation The   (Correct)
0.1:   Probabilistic Branching and Looping in Fuzzy Stochastic.. - Andrew Nyakaana Blair   (Correct)
0.1:   Incremental and Decremental Support Vector Machine Learning - Cauwenberghs, Poggio (2000)   (Correct)

Related documents from co-citation:   More   All
13:   Weight perturbation: An optimal architecture and learning technique for analog v.. - Jabri, Flower - 1992
12:   Summed weight neuron perturbation: An O (context) - Flower, Jabri - 1993
9:   A Parallel Gradient Descent Method for Learning in Analog VLSI Neural Networks (context) - Alspector, Meir et al. - 1993

BibTeX entry:   (Update)

Gert Cauwenberghs. A fast stochastic error-descent algorithm for supervised learning and optimization. In S.J Hanson, J.D. Cowan, and C.L. Giles, editors, Advances in Neural Information Processing Systems 5, pages 244--251, San Mateo, CA, 1993. Morgan Kaufmann Publishers. http://citeseer.ist.psu.edu/cauwenberghs93fast.html   More

@inproceedings{ cauwenberghs93fast,
    author = "Gert Cauwenberghs",
    title = "A Fast Stochastic Error-Descent Algorithm for Supervised Learning and Optimization",
    booktitle = "Advances in Neural Information Processing Systems",
    volume = "5",
    publisher = "Morgan Kaufmann, San Mateo, CA",
    editor = "Stephen Jos{\'e} Hanson and Jack D. Cowan and C. Lee Giles",
    pages = "244--251",
    year = "1993",
    url = "citeseer.ist.psu.edu/cauwenberghs93fast.html" }
Citations (may not include all citations):
1491   Learning Internal Representations by Error Propagation (context) - Rumelhart, Hinton et al. - 1986
269   A Learning Algorithm for Continually Running Fully Recurrent.. - Williams, Zipser - 1989
104   Learning State Space Trajectories in Recurrent Neural Networ.. (context) - Pearlmutter - 1989
38   30 years of Adaptive Neural Networks. Perceptron, Madaline, .. (context) - Widrow, Lehr - 1990
30   Weight Perturbation: An Optimal Architecture and Learning Te.. - Jabri, Flower - 1992
14   A VLSI-Efficient Technique for Generating Multiple Uncorrela.. (context) - Alspector, Gannett et al. - 1991
11   Learning a Trajectory using Adjoint Functions and Teacher Fo.. (context) - Toomarian, Barhen - 1992
10   A Parallel Gradient Descent Method for Learning in Analog VL.. (context) - Alspector, Meir et al. - 1993
6   Analog VLSI Implementation of Gradient Descent (context) - Kirk, Kerns et al. - 1993
5   Model-Free Distributed Learning (context) - Dembo, Kailath - 1990
5   Summed Weight Neuron Perturbation: An O(n) Improvement over .. - Flower, Jabri - 1993
4   A Fixed Size Storage O(n 3 ) Time Complexity Learning Algori.. (context) - Schmidhuber - 1992
2   Using Noise Injection and Correlation in Analog Hardware to .. (context) - Anderson, Kerns - 1992
1   Learning in Dynamical Systems: Gradient Descent, Random Desc.. (context) - Baldi - 1992
1   An Adaptive System for the Control of Aircraft and Spacecraf.. (context) - Whitaker - 1959



The graph only includes citing articles where the year of publication is known.


Documents on the same site (http://www.egbert.cistron.nl/neuroprose.html):   More
A Widrow-Hoff learning-rule for a generalization of.. - Abdi, Valentin.. (1996)   (Correct)
A generalized autoassociator model for face processing.. - Abdi, Valentin, O'Toole (1996)   (Correct)
The Cocktail Party Listener - Abolfazlian, Karlsen   (Correct)

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC