Advertisement

The bias

Started by February 25, 2002 03:20 PM
0 comments, last by Tac-Tics 22 years, 9 months ago
I''ve been reading about NN''s and it''s all very interesting stuff. I have a question though about the bias for a NN. Does each individual Neurode have a bias or is one bias assigned to every Neural Layer? I''m just asking because I read two different tutorials that showed two slightly different representations and they didn''t really mention on what level the bias exists. Any help = thnx "I''''m not evil... I just use the power of good in evil ways."
well normally every neuron has a bias. But you can also use no biases, but connect every neuron via a weighted connection to a always full active neuron and then you don''t have to have an explicit learning rule for biases, you only have to update weigths. visualizations of this nets with so called on-neurons look a bit crappy, cause there are this lot of connections to this one neuron, but well, this can be solved nicely, too at the moment i cannot think of other disadvantages ...

@$3.1415rin

This topic is closed to new replies.

Advertisement