Advertisement

Genetic Algorithm vs Neural network

Started by October 11, 2006 04:58 AM
14 comments, last by Timkin 18 years, 1 month ago
Quote: Original post by Steadtler

Alright, Im not arguing with that. I just wish people would take the time to consider other options instead of going straight to overhyped methods.


I couldn't agree more. GAs and NNs are very sexy, but there are so many methods out there that offer as much or more bang for the buck.

-Kirk

Quote: Original post by Steadtler
I just wish people would take the time to consider other options instead of going straight to overhyped methods.


I second and third that. Neural nets and genetic algorithms, despite their simplicity, are often overkill. Many times a weight matrix, simple search tree, or even just a set of simple hardcoded instructions will be more effecient and easier to code and read.

Though I must admit genetic algorithms are fun to play with...
Advertisement
Thank you very much, all your answers have helped me a lot.
Quote: Original post by Alrecenk
Many times a weight matrix, simple search tree, or even just a set of simple hardcoded instructions will be more effecient and easier to code and read.


Actually, I can write an ANN in a single line of code representing
y=WTΦ(x)

and a multilayer ANN is no more difficult than nesting additional terms in the right hand side...

...but that's not the point. Actually, I do agree with the above posts as well... that one should understand the problem first before thinking of the solution. When the problem is translated into a set of tasks, the solution methods are generally self-evident (and don't generally involve over-hyped methods like ANNs and GAs).

On the GA classification front... from my perspective...

In the strictest terms, a GA is an optimisation method relying on blind search, in that any given iteration of the algorithm improves the quality of a candidate solution (in this case a population of candidates) relative to an objective function and uses blind search to do so. Blind search being search where no differntial surface information is available, only function evaluations.

In this sense, it's not regression, since regression seeks to identify a mapping between two manifolds. In the optimisation problem, we know what the mapping is; it's the objective function. However, you can express a regression problem as an optimisation problem in the parameter space of some fixed functional form and hence solve it using a GA.

Cheers,

Timkin
Isn't that what I just said? 8^)

Seriously, well stated Timkin.

-Kirk

Yes it is. ;) Just lending my support but offering it from my perspective.

This topic is closed to new replies.

Advertisement