Results 1 -
1 of
1
A genetic cascade-correlation learning algorithm
- In
, 1992
"... Gradient descent techniques such as back propagation have been used effectively to train neural network connection weights; however, in some applications gradient information may not be available. Biologically inspired genetic algorithms provide an alternative. Unfortunately, early attempts to use g ..."
Abstract
-
Cited by 14 (5 self)
- Add to MetaCart
Gradient descent techniques such as back propagation have been used effectively to train neural network connection weights; however, in some applications gradient information may not be available. Biologically inspired genetic algorithms provide an alternative. Unfortunately, early attempts to use genetic algorithms to train connection weights demonstrated that exchanging genetic material between two parents with the crossover operator often leads to low performance children. This occurs because the genetic material is removed from the context in which it was useful due to incompatible feature-detector mappings onto hidden units. This paper explores an approach in which a traditional genetic algorithm using standard two-point crossover and mutation is applied within the Cascade-Correlation learning architecture to train neural network connection weights. In the Cascade-Correlation architecture the hidden unit feature detector mapping is static; therefore, the possibility of the crossover operator shifting genetic material out of its useful context is reduced. 1 Problem Statement Although gradient descent techniques such as back propagation have been used effectively to train feedforward neural network connection weights, researchers have experimented with evolving an optimal set of connection weights with biologically inspired genetic algorithms. Genetic algorithms are adaptive search algorithms in which a population of individuals representing alternative solutions to a problem are allowed to propagate based on a measure of their fitness (Holland 1975). As the population evolves, the fitness of the individuals increases through the application of genetic recombination operators. Genetic algorithms have several advantages over the back propagation algorithm. First, because genetic algorithms work on a population of solutions in parallel there is less chance of converging to

