官术网_书友最值得收藏!

Artificial neurons

The core of a neural network is the artificial neuron. The artificial neuron is the smallest unit in a neural network that we can train to recognize patterns in data. Each artificial neuron inside the neural network has one or more input. Each of the vector input gets a weight:

The image is adapted from: https://commons.wikimedia.org/wiki/File:Artificial_neural_network.png

The artificial neuron inside a neural network works in much the same way, but doesn't use chemical signals. Each artificial neuron inside the neural network has one or more inputs. Each of the vector inputs gets a weight.

The numbers provided for each input of the neuron gets multiplied by this weight. The output of this multiplication is then added up to produce a total activation value for the neuron.

This activation signal is then passed through an activation function. The activation function performs a non-linear transformation on this signal. For example: it uses a rectified linear function to process the input signal:

The rectified linear function will convert negative activation signals to zero but performs an identity (pass-through) transformation on the signal when it is a positive number.

One other popular activation function is the sigmoid function. It behaves slightly different than the rectified linear function in that it transforms negative values to 0 and positive values to 1. There is, however, a slope in the activation between -0.5 and +0.5, where the signal is transformed in a linear fashion.

Activation functions in artificial neurons play an important role in the neural network. It's because of these non-linear transformation functions that the neural network is capable of working with non-linear relationships in the data.

主站蜘蛛池模板: 双鸭山市| 准格尔旗| 黄山市| 东乡族自治县| 内乡县| 霍山县| 当涂县| 娄烦县| 肃南| 边坝县| 巫山县| 连城县| 怀来县| 库尔勒市| 云安县| 漳平市| 香港| 常州市| 潞城市| 乌拉特后旗| 鄯善县| 吉安市| 广南县| 翁牛特旗| 周宁县| 浦江县| 灌阳县| 旬邑县| 广元市| 乐至县| 南部县| 那曲县| 武定县| 平昌县| 全椒县| 左贡县| 汕头市| 徐闻县| 广水市| 湘乡市| 敦化市|