(Enter summary)
Abstract: This thesis addresses a set of problems faced by connectionist learning that have originated from the
observation that connectionist cognitive models lack two fundamental properties of the mind: Generativity,
stemming from the boundless cognitive competence one can exhibit, and systematicity, due to the existence
of symmetries within them. Such properties have seldom been seen in neural networks models, which have
typically suffered from problems of inadequate generalization, as examplified... (Update)
Context of citations to this paper: More
.... that the challenge can be met (e.g. Pollack, 1988, 1990; Smolensky, 1990; Chalmers, 1990; Niklasson and Sharkey, 1992; Brousse, 1993). Unfortunately, it has generally been unclear whether these models actually do have this implication (see, for instance, the...
.... not that detrimental to generalization in a purely feedforward network (e.g. as demonstrated in a componential generalization task; Brousse, 1993), but it proves far more damaging in the context of the attractor dynamics in an interactive network. Therefore, it seems likely...
Cited by: More
Connectionism and the Problem of Systematicity - Phillips (1995)
(Correct)
Constituent similarity and systematicity: The limits of.. - Phillips (2000)
(Correct)
Generalization in Interactive Networks: The Benefits of.. - O'Reilly
(Correct)
Active bibliography (related documents): More All
0.8: Incremental Learning of Complex Temporal Patterns - Wang, Yuwono (1995)
(Correct)
0.7: Automated Modeling and Nonlinear Axis Scaling - Leejay Wu (2005)
(Correct)
0.6: Connectionism: Past, Present, and Future - Jordan B. Pollack (1988)
(Correct)
Similar documents based on text: More All
0.3: On Being Systematically Connectionist - Niklasson, Van Gelder (1994)
(Correct)
0.3: Can Connectionist Models Exhibit Non-Classical Structure.. - Niklasson, al. (1994)
(Correct)
0.3: Strong Systematicity within Connectionism: The Tensor-Recurrent.. - Phillips (1994)
(Correct)
Related documents from co-citation: More All
7: Recursive distributed representations
- Pollack - 1990
7: Tensor product variable binding and the representation of symbolic structures in.. (context) - Smolensky - 1990
6: Finding structure in time
- Elman - 1990
BibTeX entry: (Update)
Brousse, O. (1993). Generativity and systematicity in neural network combinatorial learning. http://citeseer.ist.psu.edu/brousse93generativity.html More
@misc{ brousse93generativity,
author = "O. Brousse",
title = "Generativity and systematicity in neural network combinatorial learning",
text = "Brousse, O. (1993). Generativity and systematicity in neural network combinatorial
learning.",
year = "1993",
url = "citeseer.ist.psu.edu/brousse93generativity.html" }
Citations (may not include all citations):
1447
A mathematical theory of communication (context) - Shannon - 1948 ACM
700
Self-organization and associative memory (context) - Kohonen - 1984
653
Neural networks and physical systems with emergent collectiv.. (context) - Hopfield - 1982
644
Finding structure in time
- Elman - 1990 DBLP
493
Communications of the ACM (context) - Valiant, of et al. - 1984
454
On uniform convergence of relative frequencies of events to .. (context) - Vapnik, Chervonenkis - 1971
392
A theory and methodology of inductive learning (context) - Michalski - 1983
376
A learning algorithm for boltzmann machines (context) - Ackley, Hinton et al. - 1985
338
Neural networks and principal components analysis: Learning .. (context) - Baldi, Hornik - 1988
293
Compression of individual sequences via variable-rate encodi..
- Ziv, Lempel - 1978
291
A logical calculus of the ideas immanent in the nervous acti.. (context) - McCullogh, Pitts - 1943
274
Generalization as search (context) - Mitchell - 1982 DBLP
256
Parallel networks that learn to pronounce English text (context) - Sejnowski, Rosenberg - 1987
253
Beyond regression: New tools for Prediction and Analysis in .. (context) - Werbos - 1974
227
Harvard University Press (context) - Fodor, of - 1975
221
Perceptrons: An introduction to computational geometry (context) - Minsky, Papert - 1969
203
What size net gives valid generalization (context) - Baum, Haussler - 1989
201
Cluster analysis (context) - Everitt - 1980 ACM
198
Connectionism and cognitive architecture: A critical analysi..
- Fodor, Pylyshyn - 1988 ACM
174
Principles of Neurodynamics (context) - Rosenblatt - 1962
169
A formal theory of inductive inference (context) - Solomonoff - 1964
159
Three approaches to the quantitative definition of informati.. (context) - Kolmogorov - 1965
158
Adaptive pattern classification and universal recoding (context) - Grossberg - 1976
148
The perceptron: A probabilistic model for information storag.. (context) - Rosenblatt - 1958
142
the proper treatment of connectionism (context) - Smolensky - 1988
138
Learning and relearning in boltzmann machines (context) - Hinton, Sejnowski - 1986 ACM
122
Predicting the future: a connectionist approach (context) - Weigend, Huberman et al. - 1990
122
The Upstart algorithm: A method for constructing and trainin.. (context) - Frean - 1990 ACM
118
Induction: Processes of inference (context) - Holland, Holyoak et al. - 1986
110
A theory of program size formally identical to information t..
- Chaitin - 1965 ACM DBLP
108
Prediction and entropy of printed English (context) - Shannon - 1951
101
Explorations in Parallel Distributed Processing: Volume 2: P.. (context) - McClelland, Rumelhart et al. - 1986
101
Explorations in Parallel Distributed Processing: A handbook .. (context) - McClelland, Rumelhart - 1988
101
Explorations in Parallel Distributed Processing: Volume 1: F.. (context) - Rumelhart, McClelland et al. - 1986
99
Tensor product variable binding and the representations of s.. (context) - Smolensky - 1990
97
Generalization by weight-elimination with application to for.. (context) - Weigend, Rumelhart et al. - 1991 ACM DBLP
82
Generalization of back-propagation to recurrent neural netwo.. (context) - Pineda - 1987
75
Stochastic complexity (context) - Rissanen - 1986
73
Syntactic transformations on distributed representations
- Chalmers - 1990
65
The complexity of finite objects and the development of the .. (context) - Zvonkin, Levin - 1970
65
Physical symbol systems (context) - Newell - 1980
64
Feedforward nets for interpolation and classification (context) - Sontag - 1990 ACM DBLP
55
Neural Darwinism : the theory of neuronal group selection (context) - Edelman - 1987
49
IEEE Transactions on Information Theory (context) - Lempel, Ziv et al. - 1974
48
A learning rule for asynchronous perceptrons with feedback i.. (context) - Almeida - 1987 ACM
48
Catastrophic interference in connectionist networks: The seq.. (context) - McCloskey, Cohen - 1989
48
Art2: Self organization of stable category recognition codes.. (context) - Carpenter, Grossberg - 1987
45
Handwritten digit recognition with a back-propagation networ..
- Le Cun, Boser et al. - 1990 ACM DBLP
42
A convergence theorem for sequential learning in two layer p.. (context) - Marchand, Golea et al. - 1990
39
IEEE Transactions on Information Theory (context) - Grassberger, efficient - 1989
35
Recursive auto-associative memory: Devising compositional di.. (context) - Pollack - 1988
34
Medical diagnostic expert system based on a pdp model (context) - Saito, Nakano - 1988
33
Consistent inference of probabilities in layered networks: p.. (context) - Tishby, Levin et al. - 1989
31
Complexity-based induction systems: Comparisons and converge.. (context) - Solomonoff - 1978
28
Neural trees: A new tool for classification (context) - Sirat, Nadal - 1990
27
Encoding sequential structure in simple recurrent networks (context) - Servan-Schreiber, Cleeremans et al. - 1989
27
Connectionism and the problem of systematicity: Why Smolensk.. (context) - Fodor, McLaulghlin - 1990
26
Connectionist models of recognition memory: constraints impo.. (context) - Ratcliff - 1990
26
Exhaustive learning (context) - Schwartz, Samalam et al. - 1990
26
Associative memory: A system theoretical approach (context) - Kohonen - 1977
25
Using relevance to reduce network size automatically (context) - Mozer, Smolensky - 1989
23
Learning translation invariant recognition in a massivelly p.. (context) - Hinton - 1987
20
version spaces and Valiant's learning framework (context) - Haussler - 1987
20
A convergent gambling estimate of the entropy of English (context) - Cover, King - 1978
19
Using semi-distributed representations to overcome catastrop..
- French - 1991
18
or the importance of starting small (context) - Elman - 1991
17
On variable binding and the representation of symbolic struc.. (context) - Smolensky - 1987
16
A mathematical theory of generalization (context) - Wolpert - 1990
16
Parsnip: A connectionist network that learns natural languag.. (context) - Hanson, Kegl - 1987
16
Waking up from the boolean dream (context) - Hofstadter - 1985
16
A mathematical theory of generalization (context) - Wolpert - 1990
15
Constructing a generalizer superior to nettalk via a mathema.. (context) - Wolpert - 1990 ACM
14
Episodic memory on connectionist networks (context) - Kortge - 1990
13
A user's guide to Planet version (context) - Miyata - 1990
13
rule extraction and generalization (context) - Denker, Schwartz et al. - 1987
12
Stochastic complexity in statistical enquiry (context) - Rissanen - 1989
12
Towards memory-based reasoning (context) - Stanfill, Waltz - 1986
11
Virtual memories and massive generalization in connectionist.. (context) - Brousse, Smolensky - 1989
11
Some equivalences between Shannon entropy and Kolmogorov com.. (context) - Cheong, Cover - 1978
11
and inductive generalization (context) - Willshaw, associative - 1981
9
New York (context) - Company - 1988
9
A study of scaling and generalization in neural networks (context) - Ahmad - 1988
9
Generativity and Systematicity in Neural Network Combinatori..
- Brousse - 1991 ACM
9
Applications of information theory to psychology: A summmary.. (context) - Attneave - 1959
8
Quantifying inductive bias in concept learning (context) - Haussler - 1986
7
Why Fodor and Pylyshyn were wrong: the simplest refutation
- Chalmers - 1990
7
Making a mind versus modeling a brain: Artificial intelligen.. (context) - Dreyfus, Dreyfus - 1988
7
Annual review of psychology (context) - Medin, Smith et al. - 1984
6
The connectionist construction of concepts (context) - Cussins - 1990
6
Cambridge at the University Press (context) - Staniland, redundancy - 1966
6
Compositionality: A connectionist variation on a classical t.. (context) - Van Gelder - 1990 DBLP
5
New York: Harcourt (context) - Chomsky, mind - 1968
5
Distributed recursive structure processing (context) - Legendre, Miyata et al. - 1991 ACM DBLP
5
Information theory (context) - Young - 1971 ACM
5
the ability of the optimal perceptron to generalize (context) - Opper, Kinzel et al. - 1990
4
Three unfinished works on the optimal storage capacity of ne.. (context) - Gardner, Derrida - 1989
4
Uncertainty and Structure as Psychological Concepts (context) - Garner - 1962
4
Storage and processing of information in distributed associa.. (context) - Kohonen, Oja et al. - 1981
4
Optimal pruning of neural tree networks for improved general..
- Sankar, Mammone - 1991
4
a connectionist expert system that actually works (context) - Fozzard, Ceci et al. - 1989 ACM DBLP
3
Learning and generalization (context) - Rumelhart - 1988 ACM
3
Reducing interference in distributed memories through episod.. (context) - Sloman, Rumelhart
3
Traffic: A model of object recognition based on transformati.. (context) - Zemel, Mozer et al. - 1990
3
Fate of first-list associations in transfer theory (context) - Barnes, Underwood - 1959
3
Variability and confirmation (context) - Thagard, Nisbett - 1982
3
A comparison of different biases for minimal network constru.. (context) - Hanson, Pratt - 1989
2
A comparison of the Shannon and Kullback information measure.. (context) - Hobson, Cheng - 1973
2
Is distributed connectionism compatible with the physical sy..
- Derthick - 1986
2
Revealing the structure of NETtalk's internal representation.. (context) - Rosenberg - 1987
2
Generalization performance of overtrained networks (context) - Chauvin - 1990
2
Technical Report UCSC-CRL (context) - Blumer, Ehrenfeucht et al. - 1987
2
Harmonic grammar --a formal multi-level theory of linguistic.. (context) - Legendre, Miyata et al. - 1990
2
A learning procedure for asymmetric threshold networks (context) - Le Cun - 1985
2
categorical perception and probability learning: Some applic.. (context) - Anderson, Silverstein et al. - 1977
2
Harmonic grammar --a formal multi-level theory of linguistic.. (context) - Legendre, Miyata et al. - 1990
1
Learning in feed-forward layered networks: The tiling constr.. (context) - Mezard, Nadal - 1989
1
A study of learning and generalization by exhaustive analysi.. (context) - Samalam, Schwartz - 1989
1
Interference and generalization in connectionist networks: W.. (context) - Brousse, Smolensky - 1990
1
Connectionist generalization and incremental learning in con.. (context) - Brousse, Smolensky - 1989
1
An analysis of the hidden unit and weights values in nonline.. (context) - Goggin, Gustafson et al.
1
Personal Communication (context) - Ehrenfeucht - 1991
1
Learning to control an unstable system using forward modelin.. (context) - Jordan, Jacob - 1990
1
A technique for assigning local reponsibilities to hidden un.. (context) - Sanger - 1989
1
Similarity-related channel interactions in visual processing (context) - Estes - 1982
1
Contribution analysis: a technique for Assigning Local Respo.. (context) - Sanger - 1990
1
Is there catatrophic interference in connectionist networks (context) - Hetherington, Seidenberg - 1989
1
The constituent structure of connectionit mental states: A r.. (context) - Smolensky - 1987
1
Schema selection and stochastic inferece in modular environm.. (context) - Smolensky - 1983
1
IEEE Transactions on Information Theory (context) - Abu-Mostafa, of - 1986
1
Personal Communication (context) - Sirat - 1990
1
Incremental back-propagation learning from novelty-based ort.. (context) - Otwell - 1990
1
CONNEX: Graphical interface for connectionist networks (context) - Mozer - 1990
1
Incremental back-propagation learning from novelty-based ort.. (context) - Yu, Simmons - 1990
1
Information theory and statitics (context) - Kullback - 1959
1
Cognitive architectures from the standpont of an experimenta.. (context) - Estes - 1991
1
Factor analysis and related methods (context) - McDonald - 1985
1
Computer Science Department (context) - McMillan - 1991
1
Back-propagation topologies for sequence generation (context) - Kukich - 1988
1
Obtained from the ftp internet Neuroprose database on archiv.. (context) - Krogh, Hertz et al.
1
Center for Computational Research in Enconomics and Manageme.. (context) - Parker, Technical - 1985
1
Organization of action sequences in motor learning (context) - Miyata - 1988
The graph only includes citing articles where the year of publication is known.
Documents on the same site (http://www.egbert.cistron.nl/neuroprose.html): More
A Widrow-Hoff learning-rule for a generalization of.. - Abdi, Valentin.. (1996)
(Correct)
A generalized autoassociator model for face processing.. - Abdi, Valentin, O'Toole (1996)
(Correct)
The Cocktail Party Listener - Abolfazlian, Karlsen
(Correct)
Online articles have much greater impact More about CiteSeer.IST Add search form to your site Submit documents Feedback
CiteSeer.IST - Copyright Penn State and NEC