J. H. Holland and J. S. Reitman. Cognitive systems based on adaptive algorithms. In D. A. Waterman and F. Hayes-Roth, editors, Pattern-Directed Inference Systems. Academic Press, 1978.  Home/Search   Document Not in Database   Summary   Related Articles   Check

....ready to use algorithms. The majority of current implementations of evolutionary algorithms descend from three strongly related but independently developed approaches: genetic algorithms, evolutionary programming , and evolution strategies. Genetic algorithms, introduced by Holland [6] 11] [12] and subsequently studied by De Jong [13] 14] 15] 16] Goldberg [17] 18] 19] 20] 21] and others such as Davis [22] Eshelman [23] 24] Forrest [25] Grefenstette [26] 27] 28] 29] Koza [30] 31] Mitchell [32] Riolo [33] 34] Schaffer [35] 36] 37] to name only a ....

J. H. Holland and J. S. Reitman, "Cognitive systems based on adaptive algorithms," in Pattern-directed inference systems, D. A. Waterman and F. Hayes-Roth, Eds. Academic Press, New York, NY, 1978.

....but may not be able to handle all necessary situations. GAs have also been used to evolve rule sets in a number of other systems The SAMUEL system successfully evolves complex rules for controlling autonomous robots [10] Classifier systems evolve rule sets applied to a range of complex problems [11]. Environmental and terrain factors Evaluation of simulation GA: Each individual in population is a set of condition action rules. Figure 1 GA with MAV Simulator 3.2 Memory Enhancements to GAs The idea of memory has been explored in a range of studies in the GA ....

J.H. Holland & J.S. Reitman: "Cognitive Systems Based on Adaptive Algorithms", Pattern-Directed Inference Systems, D.A. Waterman & F. HayesRoth eds., Academic Press, NY, 1978.

....This makes it possible to aggregate several situations within a common description so that the representation of the RL problem gets smaller. The rst proposals for a LCS devoted to RL problems are presented in [Hol76] The rst implementation of an actual LCS, called CS1, can be found in [HR78]. Wilson [Wil95] introduced in LCSs a learning algorithm similar to Q learning [Wat89] to replace the traditional Bucket Brigade algorithm [Hol85] This work led to a revival of LCS research since the new accuracy based approach in XCS overcomes the over generalization problems found in previous ....

J. H. Holland and J. S. Reitman. Cognitive Systems based on adaptive algorithms. Pattern Directed Inference Systems, 7(2):125149, 1978.

....characterized as RL systems that generalize online over sensory input. This generalization mechanism leads to several additional problems especially with respect to a proper propagation of RL values over the whole state action space. The rst implementation of an LCS, called CS1, can be found in [25]. Holland s goal was to propose a model of a cognitive system that is able to learn using both reinforcement learning processes and genetic algorithms [23, 20] The rst systems, however, were rather complicated and lacked eciency. Reinforcement values in LCSs are stored in a set (the population) ....

Holland, J.H., Reitman, J.S.: Cognitive systems based on adaptive algorithms. Pattern Directed Inference Systems 7 (1978) 125-149

....a mix of combinatorial and function optimization. Design applications include engineering design [22] communication network design [3, 4] and neural network design [10] machine learning There are many applications of GAs to learning systems, the usual paradigm being that of a classifier system [13]. In such systems the learning process is controlled by a GA that tries to evolve a population of rules to deal with some particular situation. Other approaches include the SAMUEL system where a GA evolve sets of sequential decision rules to be used by decision making agents [8] This can be ....

John H. Holland and J.S. Reitman. Cognitive systems based on adaptive algorithms. In D.A. Waterman and F. Hayes-Roth, editors, Pattern-Directed Inference Systems. Academic Press, 1978.

....problem of credit assignment has been discussed in a wide variety of contexts. The bucket brigade algorithm is one of the oldest versions discussed as an explicit 32 mechanism by Holland [17] or as an implicit mechanism in works such as [44] The variant of a profit sharing plan was introduced in [18]. The bucket brigade algorithm is just a special case of the general temporal difference methods (TDM) 31] like Q learning (though that is not the historical order of the two ideas) 42] Back propagation is another form of TDM and so the connection can also be made to the bucket brigade ....

J.H. Holland and J. S. Reitman. Cognitive systems based on adaptive algorithms. In Pattern Directed Inference Systems. Academic Press, 1978.

.... can influence future generations; 2) a mating operator, which produces offspring for the next generation; and (3) genetic operators, which determine the genetic makeup of offspring from the genetic material of the parents [22] Classifier systems were first introduced by Holland and Reitman [23, 24]. The shell for the classifier system used in the experiments was developed by Riolo [25] The CFS package of subroutines and data structures is domain . independent and provides routines to perform the major cycle of the classifier system. The CFS system was run in the stimulus response mode, ....

Holland, J.H. and Reitman, J.S. 1978. Cognitive Systems Based on Adaptive Algorithms. In Patterndirected Inference Systems, ed. D.A, Waterman and F. Hayes-Roth. New York: Academic Press.

.... by the GA, fitness inheritance [ 11 ] was employed, which assigns a newly generated individual the averaged fitness of its GA parents: Fparent 1 Fparent2 Fffspring = 2 Note the parallel between these procedures and the procedures typically used in Michigan style learning classifier systems[5][6] Also note that, as in the homogeneous case, we employ tournament selection set to minimize this value. We have run a wide variety of experiments with this system, and the GA demonstrates a robust ability to obtain a system of particles that have yield the desired target F . For instance, ....

Holland, J. H. and Reitman, J. S. (1978) Cognitive systems based on adaptive algorithms. In Waterman, D. A. and HayesRoth, F., Pattern directed inference systems. Academic Press, NY.

....to more wealth. And finally, reinforcement represents the amount of payment awarded to those classifiers that satisfy specific market criteria. Our reinforcement scheme corresponds to a modification of Holland and Reitman s epochal credit allocation plan scheme, the profit sharing plan (PSP) [12, 9], where a constant fraction of the current reward is paid to each classifier that becomes active since the last receipt of reward. Instead of paying a constant fraction, we reward classifiers according to their specificity: a classifier s parameter which determines the number of non # symbols in ....

John H. Holland and J. S. Reitman. Cognitive systems based on adaptive algorithms. In D. A. Waterman and F. Hayes-Roth, editors, Pattern-directed inference systems. New York: Academic Press,

....we describe MACS: a new LCS using this formalism. Experimental results are given in section 6 in order to compare it with YACS. 2 From Q learning to Learning Classi er Systems The rst proposals for a LCS devoted to RL problems are presented in [Hol76] The rst LCS, called CS1, can be found in [HR78]. Wilson [Wil95] introduced an algorithm similar to Q learning [Wat89] in LCSs instead of the traditional Bucket Brigade algorithm [Hol85] This work led to a revival of LCS research since the accuracy based approach in XCS overcomes the over generalization problem in previous LCSs [Wil89] The ....

J.H Holland and J.S Reitman. Cognitive Systems based on adaptive algorithms. Pattern Directed Inference Systems, 7(2):125149, 1978.

....low error on new training domains. Hence, under certain assumptions, the number of examples required for each domain decreases as the number of observed domains increases. 4.5. Learning Classifier Systems Learning classi er systems originated from the pioneer work of Holland (Holland, 1992; Holland and Reitman, 1978). An excellent review of the subject is given by Lanzi et. al (2000) A classi er system is a parallel, message passing, rule based system. Each message or rule referred in this context as a classi er is a condition action pair; if a message matches the condition part, the rule is candidate to ....

Holland John and Reitman J. (1978). Cognitive Systems Based On Adaptive Algorithms. In D. A. Waterman and F. Hayes Roth, editors, Pattern-directed inference systems, New York: Academic Press, Springer Verlag, 1978.

....developing a simulation of the anticipatory behavioral control. 3. CSs with anticipatory behavioral control (ACSs) The foundations for classifier systems were laid by Holland (1975) within the framework of his theoretical studies of genetic algorithms. The first classifier system was introduced by Holland and Reitman (1978). A comprehensive introduction is given by Booker, Goldberg and Holland (1989) or Goldberg (1989) 3.1 Introduction to ACSs ACSs consist of four basic components: an input interface with detectors for sensory input from the environment, an output interface with effectors for motor actions, a ....

Holland, J. H. & Reitman, J. S. (1978). Cognitive systems based on adaptive algorithms. In D. A.

....while learning is the main advantage of LCSs with respect to other reinforcement learning systems like Q learning[Watkins, 1989] It allows to aggregate several situations within a common description so that the representation of the problem gets smaller. The rst LCS, called CS1, can be found in [Holland and Reitman, 1978]. Wilson [Wilson, 1995] introduced an algorithm similar to Q learning [Watkins, 1989] in LCSs instead of the traditional Bucket Brigade algorithm [Holland, 1985] This work led to a revival of LCS research since the accuracy based approach in XCS overcomes the problem in previous LCSs where ....

Holland, J. and Reitman, J. (1978). Cognitive Systems based on adaptive algorithms. Pattern Directed Inference Systems, 7(2):125149.

....symbolic descriptions, whose structure is a priori unknown. Such symbolic descriptions frequently have to be developed from a set of given concept examples [11, 12] because in many practical domains it is very easy to come up with such a set but quite difficult to describe the concepts. Holland [10] introduced the idea to use Genetic Algorithms to improve rules already given or generated newly from scratch. His approach to such a classifier system, well known as Michigan Approach , works by manipulating a set (or a population) of rules. If the aim is to improve a given set of rules, then ....

J. H. Holland, and J. S. Reitmann, "Cognitive Systems based on Adaptive Algorithms", In PatternDirected Inference Systems D. A. Waterman and F. Hayes-Roth eds. Academic Press, New York, NY, 1978.

....the creation or modification of general symbolic descriptions, whose structure is a priori unknown. Such symbolic descriptions frequently have to be developed from a set of given concept examples [Lan, MiKo] because in many practical domains it is very easy to come up with concepts. Holland [HoRe] introduced the idea of using Genetic Algorithms to improve rules already given or generated newly from scratch. His approach to such a classifier system, well known as the Michigan Approach , works by manipulating a set (or a population) of rules that have the shape of Horn formulas. If the aim ....

J. H. Holland, and J. S. Reitmann, "Cognitive Systems based on Adaptive Algorithms", In Pattern-Directed Inference Systems D. A. Waterman and F. Hayes-Roth eds. Academic Press, New York, NY, 1978.

....1991; Packard, 1990; Smith Valenzuela Rendn, 1989) Fitness sharing works by reducing the fitnesses of similar population elements. Crowding (De Jong, 1975; Mahfoud, 1992, 1994, 1995a) is another type of niching method that has also been applied to classification (Booker, 1982; Goldberg, 1983; Holland Reitman, 1978; Sedbrook et al. 1991; Stadnyk, 1987) Crowding forces newly generated population elements to replace older elements that are similar. Sequential niching (Beasley et al. 1993) is a third approach, implemented by Sikora and Shaw (1994) in their genetic classification system. Sequential niching ....

Holland, J. H., and J. S. Reitman. 1978. Cognitive systems based on adaptive algorithms. In Pattern-directed inference systems, eds. D. A. Waterman and F. Hayes-Roth, 313329. New York: Academic Press.

No context found.

J. H. Holland and J. S. Reitman. Cognitive systems based on adaptive algorithms. In D. A. Waterman and F. Hayes-Roth, editors, Pattern-Directed Inference Systems. Academic Press, 1978.

No context found.

J. H. Holland and J. S. Reitman. Cognitive systems based on adaptive algorithms. In D. A. Waterman and F. Hayes-Roth, editors, Pattern Directed Inference Systems, pages 313-329. Academic Press, 1978.

No context found.

John H. Holland and J. S. Reitman. Cognitive systems based on adaptive algorithms. In D. A. Waterman and F. Hayes-Roth, editors, Pattern-directed inference systems. New York: Academic Press, 1978. Reprinted in: Evolutionary Computation. The Fossil Record. David B. Fogel (Ed.) IEEE Press, 1998. ISBN: 0-78033481 -7.

No context found.

J. Holland and J. Reitman. Cognitive systems based on adaptive algorithms. In D. Waterman and F. Hayes-Roth, editors, Pattern-Directed Inference Systems. Academic Press, 1978.

No context found.

J.H. Holland, J.S. Reitman. Cognitive systems based on adaptive algorithms, Pattern-directed inference systems, New York: Academic Press, 1978.

No context found.

J. Holland and J. Reitman. Cognitive systems based on adaptive algorithms. In D. A. Waterman and F. Hayes-Roth, editors, Pattern Directed Inference Systems, pages 313--329. New York: Academic Press, 1978.

No context found.

J. H. Holland and J. S. Reitman. Cognitive Systems based on adaptive algorithms. Pattern Directed Inference Systems, 7(2):125149, 1978.

No context found.

John H. Holland and J. S. Reitman. Cognitive systems based on adaptive algorithms. In D. A. Waterman and F. Hayes-Roth, editors, Pattern-directed inference systems. New York: Academic Press, 1978. Reprinted in: Evolutionary Computation. The Fossil Record. David B. Fogel #Ed.# IEEE Press, 1998. ISBN: 0-78033481 -7.

No context found.

J. H. Holland and J. S. Reitman, "Cognitive systems based on adaptive algorithms," in Pattern-directed Inference Systems, Academic Press, New York, 1978.

First 50 documents  Next 50

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC