Activation function: Difference between revisions

Revision as of 20:50, 5 October 2024

Revision as of 22:45, 5 October 2024

Line 38:

===Radial activation functions ===

{{Main|Radial function}}

A special class of activation functions known as [[radial basis function]]s (RBFs) are used in [[Radial basis function network|RBF networks]], which are extremely efficient as universal function approximators. These activation functions can take many forms, but they are usually found as one of the following functions:

* [[Gaussian function|Gaussian]]: <math>\,\phi(\mathbf v)=\exp\left(-\frac{\|\mathbf v - \mathbf c\|^2}{2\sigma^2}\right)</math>

* Multiquadratics: <math>\,\phi(\mathbf v) = \sqrt{\|\mathbf v - \mathbf c\|^2 + a^2}</math>