Mathematics of neural networks in machine learning: Difference between revisions

Content deleted Content added
References: {{Mathematics of}}
1blulere (talk | contribs)
m Update main template with correct article name; if anyone else wishes to normalise 'ANN' -> 'neural network' throughout the article, feel free to Do so
 
(6 intermediate revisions by 6 users not shown)
Line 1:
{{MainShort description|ArtificialType neuralof network}}
{{Main|Neural network (machine learning)}}
 
An '''artificial neural network''' (ANN) or '''neural network''' combines biological principles with advanced statistics to solve problems in domains such as [[pattern recognition]] and game-play. ANNs adopt the basic model of neuron analogues connected to each other in a variety of ways.
 
== Structure ==
Line 28 ⟶ 29:
 
=== Bias ===
A bias term can be added, changing the form to the following:<ref name="DAWSON1998">{{cite journal|last1=DAWSON|first1=CHRISTIAN W|year=1998|title=An artificial neural network approach to rainfall-runoff modelling|journal=Hydrological Sciences Journal|volume=43|issue=1|pages=47–66|doi=10.1080/02626669809492102|doi-access=free|bibcode=1998HydSJ..43...47D }}</ref>
 
: <math> p_j(t) = \sum_i o_i(t) w_{ij}+ w_{0j}, </math> where <math>w_{0j}</math> is a bias.
Line 96 ⟶ 97:
[[Pseudocode]] for a [[stochastic gradient descent]] algorithm for training a three-layer network (one hidden layer):
 
initialize network weights (often small random values).
'''do'''
'''for each''' training example named ex '''do'''