Activation function: Difference between revisions

Revision as of 19:12, 6 December 2024

Revision as of 19:42, 12 December 2024

Line 206:

|title = Elsevier Pattern Recognition

|date = 2023

|volume=160 |pages=12–21 |doi=10.1016/j.neunet.2022.12.019 |pmid=36592526 }}</ref>

}}</ref>

| <math> - </math>

| <math>(-\infty,+\infty)</math>

Line 225:

| <math>C^\infty</math>

|-

|Exponential Linear Sigmoid SquasHing (ELiSH)<ref>{{Citation |last1=Basirat |first1=Mina |title=The Quest for the Golden Activation Function |date=2018-08-02 |url=https://arxiv.org/abs/1808.00783v1 |access-date=2024-10-05 |arxiv=1808.00783 |last2=Roth |first2=Peter M.}}</ref>

|[[File:Elish_activation_function.png|thumb|An image of the ELiSH activation function plotted over the range [-3, 3] with a minumum value of ~0.881 at x ~= -0.172.]]

|<math>\begin{cases}