See this document in CiteSeerX!

Generativity and Systematicity in Neural Network Combinatorial Learning (1993)  (Make Corrections)  (9 citations)
Olivier Brousse



  Home/Search   Context   Related

Links:   ACM

 
View or download:
ohiostate.edu/pub...rousse.sysgen.ps.Z
Cached:  PS.gz  PS  PDF   Image  Update  Help

From:  egbert.cistron.nl/neuroprose (more)
(Enter author homepages)

Rate this article: (best)
  Comment on this article  
(Enter summary)

Abstract: This thesis addresses a set of problems faced by connectionist learning that have originated from the observation that connectionist cognitive models lack two fundamental properties of the mind: Generativity, stemming from the boundless cognitive competence one can exhibit, and systematicity, due to the existence of symmetries within them. Such properties have seldom been seen in neural networks models, which have typically suffered from problems of inadequate generalization, as examplified... (Update)

Context of citations to this paper:   More

.... that the challenge can be met (e.g. Pollack, 1988, 1990; Smolensky, 1990; Chalmers, 1990; Niklasson and Sharkey, 1992; Brousse, 1993). Unfortunately, it has generally been unclear whether these models actually do have this implication (see, for instance, the...

.... not that detrimental to generalization in a purely feedforward network (e.g. as demonstrated in a componential generalization task; Brousse, 1993), but it proves far more damaging in the context of the attractor dynamics in an interactive network. Therefore, it seems likely...

Cited by:   More
Connectionism and the Problem of Systematicity - Phillips (1995)   (Correct)
Constituent similarity and systematicity: The limits of.. - Phillips (2000)   (Correct)
Generalization in Interactive Networks: The Benefits of.. - O'Reilly   (Correct)

Active bibliography (related documents):   More   All
0.8:   Incremental Learning of Complex Temporal Patterns - Wang, Yuwono (1995)   (Correct)
0.7:   Automated Modeling and Nonlinear Axis Scaling - Leejay Wu (2005)   (Correct)
0.6:   Connectionism: Past, Present, and Future - Jordan B. Pollack (1988)   (Correct)

Similar documents based on text:   More   All
0.3:   On Being Systematically Connectionist - Niklasson, Van Gelder (1994)   (Correct)
0.3:   Can Connectionist Models Exhibit Non-Classical Structure.. - Niklasson, al. (1994)   (Correct)
0.3:   Strong Systematicity within Connectionism: The Tensor-Recurrent.. - Phillips (1994)   (Correct)

Related documents from co-citation:   More   All
7:   Recursive distributed representations - Pollack - 1990
7:   Tensor product variable binding and the representation of symbolic structures in.. (context) - Smolensky - 1990
6:   Finding structure in time - Elman - 1990

BibTeX entry:   (Update)

Brousse, O. (1993). Generativity and systematicity in neural network combinatorial learning. http://citeseer.ist.psu.edu/brousse93generativity.html   More

@misc{ brousse93generativity,
  author = "O. Brousse",
  title = "Generativity and systematicity in neural network combinatorial learning",
  text = "Brousse, O. (1993). Generativity and systematicity in neural network combinatorial
    learning.",
  year = "1993",
  url = "citeseer.ist.psu.edu/brousse93generativity.html" }
Citations (may not include all citations):
1447   A mathematical theory of communication (context) - Shannon - 1948  ACM
700   Self-organization and associative memory (context) - Kohonen - 1984
653   Neural networks and physical systems with emergent collectiv.. (context) - Hopfield - 1982
644   Finding structure in time - Elman - 1990  DBLP
493   Communications of the ACM (context) - Valiant, of et al. - 1984
454   On uniform convergence of relative frequencies of events to .. (context) - Vapnik, Chervonenkis - 1971
392   A theory and methodology of inductive learning (context) - Michalski - 1983
376   A learning algorithm for boltzmann machines (context) - Ackley, Hinton et al. - 1985
338   Neural networks and principal components analysis: Learning .. (context) - Baldi, Hornik - 1988
293   Compression of individual sequences via variable-rate encodi.. - Ziv, Lempel - 1978
291   A logical calculus of the ideas immanent in the nervous acti.. (context) - McCullogh, Pitts - 1943
274   Generalization as search (context) - Mitchell - 1982  DBLP
256   Parallel networks that learn to pronounce English text (context) - Sejnowski, Rosenberg - 1987
253   Beyond regression: New tools for Prediction and Analysis in .. (context) - Werbos - 1974
227   Harvard University Press (context) - Fodor, of - 1975
221   Perceptrons: An introduction to computational geometry (context) - Minsky, Papert - 1969
203   What size net gives valid generalization (context) - Baum, Haussler - 1989
201   Cluster analysis (context) - Everitt - 1980  ACM
198   Connectionism and cognitive architecture: A critical analysi.. - Fodor, Pylyshyn - 1988  ACM
174   Principles of Neurodynamics (context) - Rosenblatt - 1962
169   A formal theory of inductive inference (context) - Solomonoff - 1964
159   Three approaches to the quantitative definition of informati.. (context) - Kolmogorov - 1965
158   Adaptive pattern classification and universal recoding (context) - Grossberg - 1976
148   The perceptron: A probabilistic model for information storag.. (context) - Rosenblatt - 1958
142   the proper treatment of connectionism (context) - Smolensky - 1988
138   Learning and relearning in boltzmann machines (context) - Hinton, Sejnowski - 1986  ACM
122   Predicting the future: a connectionist approach (context) - Weigend, Huberman et al. - 1990
122   The Upstart algorithm: A method for constructing and trainin.. (context) - Frean - 1990  ACM
118   Induction: Processes of inference (context) - Holland, Holyoak et al. - 1986
110   A theory of program size formally identical to information t.. - Chaitin - 1965  ACM   DBLP
108   Prediction and entropy of printed English (context) - Shannon - 1951
101   Explorations in Parallel Distributed Processing: Volume 2: P.. (context) - McClelland, Rumelhart et al. - 1986
101   Explorations in Parallel Distributed Processing: A handbook .. (context) - McClelland, Rumelhart - 1988
101   Explorations in Parallel Distributed Processing: Volume 1: F.. (context) - Rumelhart, McClelland et al. - 1986
99   Tensor product variable binding and the representations of s.. (context) - Smolensky - 1990
97   Generalization by weight-elimination with application to for.. (context) - Weigend, Rumelhart et al. - 1991  ACM   DBLP
82   Generalization of back-propagation to recurrent neural netwo.. (context) - Pineda - 1987
75   Stochastic complexity (context) - Rissanen - 1986
73   Syntactic transformations on distributed representations - Chalmers - 1990
65   The complexity of finite objects and the development of the .. (context) - Zvonkin, Levin - 1970
65   Physical symbol systems (context) - Newell - 1980
64   Feedforward nets for interpolation and classification (context) - Sontag - 1990  ACM   DBLP
55   Neural Darwinism : the theory of neuronal group selection (context) - Edelman - 1987
49   IEEE Transactions on Information Theory (context) - Lempel, Ziv et al. - 1974
48   A learning rule for asynchronous perceptrons with feedback i.. (context) - Almeida - 1987  ACM
48   Catastrophic interference in connectionist networks: The seq.. (context) - McCloskey, Cohen - 1989
48   Art2: Self organization of stable category recognition codes.. (context) - Carpenter, Grossberg - 1987
45   Handwritten digit recognition with a back-propagation networ.. - Le Cun, Boser et al. - 1990  ACM   DBLP
42   A convergence theorem for sequential learning in two layer p.. (context) - Marchand, Golea et al. - 1990
39   IEEE Transactions on Information Theory (context) - Grassberger, efficient - 1989
35   Recursive auto-associative memory: Devising compositional di.. (context) - Pollack - 1988
34   Medical diagnostic expert system based on a pdp model (context) - Saito, Nakano - 1988
33   Consistent inference of probabilities in layered networks: p.. (context) - Tishby, Levin et al. - 1989
31   Complexity-based induction systems: Comparisons and converge.. (context) - Solomonoff - 1978
28   Neural trees: A new tool for classification (context) - Sirat, Nadal - 1990
27   Encoding sequential structure in simple recurrent networks (context) - Servan-Schreiber, Cleeremans et al. - 1989
27   Connectionism and the problem of systematicity: Why Smolensk.. (context) - Fodor, McLaulghlin - 1990
26   Connectionist models of recognition memory: constraints impo.. (context) - Ratcliff - 1990
26   Exhaustive learning (context) - Schwartz, Samalam et al. - 1990
26   Associative memory: A system theoretical approach (context) - Kohonen - 1977
25   Using relevance to reduce network size automatically (context) - Mozer, Smolensky - 1989
23   Learning translation invariant recognition in a massivelly p.. (context) - Hinton - 1987
20   version spaces and Valiant's learning framework (context) - Haussler - 1987
20   A convergent gambling estimate of the entropy of English (context) - Cover, King - 1978
19   Using semi-distributed representations to overcome catastrop.. - French - 1991
18   or the importance of starting small (context) - Elman - 1991
17   On variable binding and the representation of symbolic struc.. (context) - Smolensky - 1987
16   A mathematical theory of generalization (context) - Wolpert - 1990
16   Parsnip: A connectionist network that learns natural languag.. (context) - Hanson, Kegl - 1987
16   Waking up from the boolean dream (context) - Hofstadter - 1985
16   A mathematical theory of generalization (context) - Wolpert - 1990
15   Constructing a generalizer superior to nettalk via a mathema.. (context) - Wolpert - 1990  ACM
14   Episodic memory on connectionist networks (context) - Kortge - 1990
13   A user's guide to Planet version (context) - Miyata - 1990
13   rule extraction and generalization (context) - Denker, Schwartz et al. - 1987
12   Stochastic complexity in statistical enquiry (context) - Rissanen - 1989
12   Towards memory-based reasoning (context) - Stanfill, Waltz - 1986
11   Virtual memories and massive generalization in connectionist.. (context) - Brousse, Smolensky - 1989
11   Some equivalences between Shannon entropy and Kolmogorov com.. (context) - Cheong, Cover - 1978
11   and inductive generalization (context) - Willshaw, associative - 1981
9   New York (context) - Company - 1988
9   A study of scaling and generalization in neural networks (context) - Ahmad - 1988
9   Generativity and Systematicity in Neural Network Combinatori.. - Brousse - 1991  ACM
9   Applications of information theory to psychology: A summmary.. (context) - Attneave - 1959
8   Quantifying inductive bias in concept learning (context) - Haussler - 1986
7   Why Fodor and Pylyshyn were wrong: the simplest refutation - Chalmers - 1990
7   Making a mind versus modeling a brain: Artificial intelligen.. (context) - Dreyfus, Dreyfus - 1988
7   Annual review of psychology (context) - Medin, Smith et al. - 1984
6   The connectionist construction of concepts (context) - Cussins - 1990
6   Cambridge at the University Press (context) - Staniland, redundancy - 1966
6   Compositionality: A connectionist variation on a classical t.. (context) - Van Gelder - 1990  DBLP
5   New York: Harcourt (context) - Chomsky, mind - 1968
5   Distributed recursive structure processing (context) - Legendre, Miyata et al. - 1991  ACM   DBLP
5   Information theory (context) - Young - 1971  ACM
5   the ability of the optimal perceptron to generalize (context) - Opper, Kinzel et al. - 1990
4   Three unfinished works on the optimal storage capacity of ne.. (context) - Gardner, Derrida - 1989
4   Uncertainty and Structure as Psychological Concepts (context) - Garner - 1962
4   Storage and processing of information in distributed associa.. (context) - Kohonen, Oja et al. - 1981
4   Optimal pruning of neural tree networks for improved general.. - Sankar, Mammone - 1991
4   a connectionist expert system that actually works (context) - Fozzard, Ceci et al. - 1989  ACM   DBLP
3   Learning and generalization (context) - Rumelhart - 1988  ACM
3   Reducing interference in distributed memories through episod.. (context) - Sloman, Rumelhart
3   Traffic: A model of object recognition based on transformati.. (context) - Zemel, Mozer et al. - 1990
3   Fate of first-list associations in transfer theory (context) - Barnes, Underwood - 1959
3   Variability and confirmation (context) - Thagard, Nisbett - 1982
3   A comparison of different biases for minimal network constru.. (context) - Hanson, Pratt - 1989
2   A comparison of the Shannon and Kullback information measure.. (context) - Hobson, Cheng - 1973
2   Is distributed connectionism compatible with the physical sy.. - Derthick - 1986
2   Revealing the structure of NETtalk's internal representation.. (context) - Rosenberg - 1987
2   Generalization performance of overtrained networks (context) - Chauvin - 1990
2   Technical Report UCSC-CRL (context) - Blumer, Ehrenfeucht et al. - 1987
2   Harmonic grammar --a formal multi-level theory of linguistic.. (context) - Legendre, Miyata et al. - 1990
2   A learning procedure for asymmetric threshold networks (context) - Le Cun - 1985
2   categorical perception and probability learning: Some applic.. (context) - Anderson, Silverstein et al. - 1977
2   Harmonic grammar --a formal multi-level theory of linguistic.. (context) - Legendre, Miyata et al. - 1990
1   Learning in feed-forward layered networks: The tiling constr.. (context) - Mezard, Nadal - 1989
1   A study of learning and generalization by exhaustive analysi.. (context) - Samalam, Schwartz - 1989
1   Interference and generalization in connectionist networks: W.. (context) - Brousse, Smolensky - 1990
1   Connectionist generalization and incremental learning in con.. (context) - Brousse, Smolensky - 1989
1   An analysis of the hidden unit and weights values in nonline.. (context) - Goggin, Gustafson et al.
1   Personal Communication (context) - Ehrenfeucht - 1991
1   Learning to control an unstable system using forward modelin.. (context) - Jordan, Jacob - 1990
1   A technique for assigning local reponsibilities to hidden un.. (context) - Sanger - 1989
1   Similarity-related channel interactions in visual processing (context) - Estes - 1982
1   Contribution analysis: a technique for Assigning Local Respo.. (context) - Sanger - 1990
1   Is there catatrophic interference in connectionist networks (context) - Hetherington, Seidenberg - 1989
1   The constituent structure of connectionit mental states: A r.. (context) - Smolensky - 1987
1   Schema selection and stochastic inferece in modular environm.. (context) - Smolensky - 1983
1   IEEE Transactions on Information Theory (context) - Abu-Mostafa, of - 1986
1   Personal Communication (context) - Sirat - 1990
1   Incremental back-propagation learning from novelty-based ort.. (context) - Otwell - 1990
1   CONNEX: Graphical interface for connectionist networks (context) - Mozer - 1990
1   Incremental back-propagation learning from novelty-based ort.. (context) - Yu, Simmons - 1990
1   Information theory and statitics (context) - Kullback - 1959
1   Cognitive architectures from the standpont of an experimenta.. (context) - Estes - 1991
1   Factor analysis and related methods (context) - McDonald - 1985
1   Computer Science Department (context) - McMillan - 1991
1   Back-propagation topologies for sequence generation (context) - Kukich - 1988
1   Obtained from the ftp internet Neuroprose database on archiv.. (context) - Krogh, Hertz et al.
1   Center for Computational Research in Enconomics and Manageme.. (context) - Parker, Technical - 1985
1   Organization of action sequences in motor learning (context) - Miyata - 1988



The graph only includes citing articles where the year of publication is known.


Documents on the same site (http://www.egbert.cistron.nl/neuroprose.html):   More
A Widrow-Hoff learning-rule for a generalization of.. - Abdi, Valentin.. (1996)   (Correct)
A generalized autoassociator model for face processing.. - Abdi, Valentin, O'Toole (1996)   (Correct)
The Cocktail Party Listener - Abolfazlian, Karlsen   (Correct)

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC