Content deleted Content added
Viktor Guer (talk | contribs) |
Filled in empty cells for ELiSH |
||
Line 226:
|-
|Exponential Linear Sigmoid SquasHing (ELiSH)<ref>{{Citation |last1=Basirat |first1=Mina |title=The Quest for the Golden Activation Function |date=2018-08-02 |url=https://arxiv.org/abs/1808.00783v1 |access-date=2024-10-05 |arxiv=1808.00783 |last2=Roth |first2=Peter M.}}</ref>
|[[File:Elish_activation_function.png|thumb|An image of the ELiSH activation function plotted over the range [-3, 3] with a minumum value of ~0.881 at x ~= -0.172.]]
|<math>\begin{cases}
\frac{x}{1+e^{-x}} & \text{if } x \geq 0 \\
Line 232:
\end{cases}
</math>
|<math>\begin{cases} \frac{2e^{2x}+e^{3x}-e^x}{e^{2x}+2e^x+1} & \text{if }x<0 \\ \frac{xe^{x}+e^{2x}+e^x}{e^{2x}+2e^x+1} & \text{if }x \geq 0 \end{cases}</math>
|<math>[-0.881\ldots, \infty)</math>
|<math>C^1</math>
|-
| [[Gaussian function|Gaussian]]
| |||