Rumelhart, D.E. & McClelland, J.L. (1986). PDP models and general issues in cognitive science. In D.E. Rumelhart & J.L. McClelland (Eds.), Parallel Distributed Processing. Vol. 1. Cambridge, MA: MIT Press/Bradford Books.  Home/Search   Document Not in Database   Summary   Related Articles   Check

....[3, 8, 11] are based upon a simple description of the neuron taking into account the presence of pre synaptic cells and their synaptic potentials, the activation threshold, and the propagation of an action potential. Certainly, this is an impoverished explanation of human brain characteristics [1, 9, 12]. In this paper, a mechanism to generate a biologically plausible artificial neural network model is presented [10] which is taken to be closer to some of the human brain features. In such a mechanism, the classical framework is redesigned in order to encompass not only the traditional ....

Rumelhart, D. E. and McClelland, J. L.: PDP Models and General Issues in Cognitive Science, in D. E. Rumelhart and J. L. McClelland (eds.), Parallel Distributed Processing, Vol. 1, Cambridge, Massachusetts - London, England, The MIT Press, 1986.

....abilities of ANNs, and the cognitive models of the PDP Research Group [22, 16] Parallelism is essential and inherent to these models. Distribution of Control: Rumelhart and McClelland identified the use of Distributed, not central, control as one of the key features for CI models of cognition [21]. This characteristic has been implemented with varying degrees of completeness in various CI models, a point we will return to in section 6. For computer architecture, distributing the executive function is also a clear priority, but no consensus is evident. Different architectures distribute ....

D. E. Rumelhart and J. L. McClelland. PDP Models and general issues in cognitive science. In Rumelhart et al. [22], chapter 4, pages 110--146.

....nj nm jk mn Feed forward networks such as the one Figure 5 are one class of networks. Others include Hopfield, Kohonen, Boltzman Machine, Perceptrons and implementational variations thereof, none of which will be described in any detail here (see standard introductory text for further information Rumelhart and McClelland 1986; Vemuri 1988; Davalo and Naim 1991) NN s can be characterised in a number of different ways; in terms of spread of activation, relaxation and activation inhibition, statistical correlation (between inputs and outputs) and parallel distributed processing (PDP) and, when modelling real behaviour ....

.... associations) could be learnt assuming that learning set was orthogonal or linearly separable (see for example Davalo and Naim 1991) A more general and less restricted version of a learning rule based on Hebb s learning rule, generally referred to as Back Propagation (BP) or standard backprop (Rumelhart and McClelland 1986) is widely used for training multilayered NN s and is briefly described below. The basic idea of BP learning rule is that small changes are made to the weights in order to train the network to elicit satisfactory behaviour (reduce output error) which of course, is determined by the problem or ....

Rumelhart, D E and McClelland, J (1986). "PDP Models and General Issues in Cognitive Science", chapter 4 in Parallel distributed Processing, Explorations in the Microstructure of Cognition, Vol. 1: Foundations. Rumelhart, D, McClelland, J and the PDP Research Group (eds.). The MIT Press, Cambridge MA.

.... discussed in [68, 22, 23, 40, 61, 3, 21, 52, 19, 56, 80] Some representative references for semantic and syntactic analysis with connectionist networks can be found in [38, 50, 60, 75, 70, 79] For references on cognitively oriented connectionist natural language processing some references are [14, 78, 69, 42, 12]. 3 Statistical Approaches 3.1 Introduction With the recent trend for learning in natural language processing, statistical methods have gained new popularity, and are being applied to new domains. They are usually characterized by using large text corpora and performing some analysis which uses ....

D. E. Rumelhart and J. L. McClelland. PDP models and general issues in cognitive science. In D. E. Rumelhart and J. L. McClelland, editors, Parallel Distributed Processing, volume 1, pages 110--146. MIT Press, Cambridge, MA, 1986.

....distributed representation for the token Clyde included as a part the information of the type ( elephant ) to which it belongs. However, once this type of representation is used, they claim that it cannot also be used to represent the part whole relationship between items (Hinton, McClelland and Rumelhart, 1986, p. 105) Robins (1989) however, questions whether even the form of distributed representation used for coding type hierarchies is well founded. He points out that the approach uses the idea that, in a population of vectors of the same type, the type representation is the subvector which is invariant ....

....the application of higher level rules. Connectionism is the study of the mechanisms of cognition, goes the claim, and the application of rules is neither 8 In many people s opinion, computer science is an engineering discipline. more nor less cognitive than the activation of low level units (Rumelhart and McClelland, 1986a, p. 120). This is not the only view concerning the relationship between connectionism and rules, however, and the first task will be to identify the different relationships that have been widely proposed. The second task will be to highlight the essentially functional role of representations in both ....

[Article contains additional citation context not shown here]

Rumelhart, D.E., and McClelland, J.L. (1986a). PDP models and general issues in cognitive science, in D.E. Rumelhart, J.L. McClelland, and the PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations , Bradford Books/MIT Press.

....a unique role early in learning. Rather, all the hidden units move to reduce the current largest error (Fahlman Lebiere 1990) Eventually hidden unit responsibilities are sorted out, but in the intervening time stages can be observed. An example of this occurs in the learning of past tenses (Rumelhart McClelland 1986a; Plunkett Marchman 1990; Marchman 1992) 2. Over generalization. Hidden unit herding is one form of over generalization, but a network without hidden units can also over generalize. An initial period of over generalization could be seen as one stage, with later stages occurring as the network learned the fine ....

Rumelhart, D. E. & McClelland, J. L. (1986b). PDP models and general issues in cognitive science. In Rumelhart, D. E., McClelland, J. L. & The PDP Research Group, eds, Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1: Foundations. MIT Press, Cambridge, MA.

....observation. Rather than directly observe neuronal activity, descriptions are constructed by observing the behaviour of human cognitive agents. Given the gap between evidence obtained from observation of an 1 Even those developing connectionist descriptions of cognition have rejected this (cf. Rumelhart and McClelland 1986). In addition, even though their descriptions are informed by neuroscience, the extent to which these descriptions are actually constrained by neurological evidence is open to question: As Jim Bower wrote: As a neurobiologist, however, I would assert that even a cursory look at the brain ....

Rumelhart, D. E. and J. L. McClelland (1986). PDP models and general issues in cognitive science. In J. L. McClelland, D. E. Rumelhart, and the PDP Research Group, editors, Parallel distributed processing, volume 1, pages 110--146. Cambridge, Mass: MIT Press.

....None Wk 2, Jan 20 GENERAL ISSUES Topics: Brain mind link, levels of analysis, pieces of the brain mind (modules, specialized subsystems, etc) general properties of neural computation, general types of methodology. Readings: Marr (1982) Chapter 1, pp. 8 29; Sejnowski and Churchland (1989) Rumelhart and McClelland (1986); O Reilly, Munakata, and McClelland (1998) Chapter 1, pp. 19 31; Shallice (1988) Chapter 2, pp. 18 37; Kosslyn (1994) Chapter 2, pp. 25 51. Wk 3, Jan 27 NEUROANATOMY: TOPOLOGY OF COGNITION Topics: Cortical lobes and areas, subcortical areas, broadman numbers, functional specializations: ....

....no disengage attention model (Cohen, Romero, Farah, Servan Schreiber, 1994) other models. Readings: O Reilly et al. 1998) Chapter 2, pp. 37 65 (selected sections) Farah (1994) Jacobs and Jordan (1992) and re read with emphasis on computational models: Sejnowski and Churchland (1989) Rumelhart and McClelland (1986); O Reilly et al. 1998) Chapter 1, pp. 19 31. Feb 19 Feb 22 TAKE HOME MIDTERM EXAM Wk 7, Feb 24 PERCEPTION AND ATTENTION Topics: Structure of the visual system (dual pathway) object recognition, agnosias (e.g. prosopagnosia) Simulations: Visual object recognition. Readings: Desimone ....

Rumelhart, D. E., & McClelland, J. L. (1986). PDP models and general issues in cognitive science. In D. E.

....the natural systems modeled by CA. This general point is neither new nor deep. Analogous arguments have been put forth in the context of neural networks, for example. While many constructions have been made of universal computation in neural networks (e.g. 29] some psychologists (e.g. [28]) have argued that this has little to do with understanding how brains or minds work in the natural world. Similarly, if one wants to use a CA as a parallel computer for solving a real problem such as face recognition it would be very inefficient, if not practically impossible, to solve the ....

D. E. Rumelhart and J. L. McClelland. PDP models and general issues in cognitive science. In D. E. Rumelhart and J. L. McClelland, editors, Parallel Distributed Processing, volume 1, Cambridge, MA, 1986. MIT Press.

....to the working manner of NARS, each chunk as a processing unit only takes care of its own business, that is, only does inferences where the concept is directly involved. As a result, the answering of a question is usually the cooperation of several concepts. However, like in connectionist models [30], there is no global plan or central process that is responsible for each question. The cooperation is carried out by message passing among chunks. The generating of a specific answer is the emergent result of lots of local events, not only caused by the events in its derivation path, but also ....

....AI (for example, 6] or AI as a whole (for example, 33] are actually against a more specific target: pure axiomatic systems. Designed as a reasoning system, but not a logicist one [25] NARS actually shares more philosophical opinions with the sub symbolic, or connectionist movement [12, 14, 30, 36], but chooses to formalize and implement these opinions in a framework that looks more close to the traditional symbolic AI tradition. The practice of NARS shows that such a framework has its advantages, such as more general and abstract, more closely related to the old problems in the domain, and ....

[Article contains additional citation context not shown here]

D. Rumelhart and J. McClelland. PDP models and general issues in cognitive science. In D. Rumelhart and J. McClelland, editors, Parallel Distributed Processing: Exploration in the Microstructure of cognition, Vol. 1, Foundations, pages 110--146. The MIT Press, Cambridge, Massachusetts, 1986.

No context found.

Rumelhart, D.E. & McClelland, J.L. (1986). PDP models and general issues in cognitive science. In D.E. Rumelhart & J.L. McClelland (Eds.), Parallel Distributed Processing. Vol. 1. Cambridge, MA: MIT Press/Bradford Books.

No context found.

J. B. Pollack Rumelhart, D. E. & McClelland, J. L. (1986). PDP Models and General Issues in Cognitive Science. In D. E. Rumelhart, J. L. McClelland & the PDP research Group, (Eds.), Parallel Distributed Processing: Experiments in the Microstructure of Cognition, Vol. 1. Cambridge: MIT Press.

No context found.

Rumelhart, D. E. and McClelland, J. L. (1986) PDP Models and General Issues in Cognitive Science. Parallel Distributed Processing(I and II), MIT Press, Cambridge, Mass.

No context found.

D.E. Rumelhart and J.L. McClelland. Pdp models and general issues in cognitive science. In Parallel Distributed Processing [18], chapter 4, pages 110--146.

No context found.

Rumelhart, D. E. and McClelland, J. L. 1986b. Pdp models and general issues in cognitive science. In D. E. Rumelhart, J. L. M. and the PDP research group, editors, Parallel distributed processing: Explorations in the microstructure of cognition, volume 1, pages 110--146. The MIT Press, Cambridge, MA.

No context found.

Rumelhart, D.E>, & McClelland, J.L. (1986a). PDP Models and general issues in cognitive science. In D.E. Rumelhart & J.L. McClelland (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 1).

No context found.

Rumelhart, D. E. and McClelland, J. L. (1986) PDP Models and General Issues in Cognitive Science. Parallel Distributed Processing(I and II), MIT Press, Cambridge, Mass.

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC