Activation function: Difference between revisions

Revision as of 13:42, 5 July 2024

Revision as of 20:54, 9 September 2024

Line 47:

=== Folding activation functions ===

{{Main|Fold function}}

Folding activation functions are extensively used in the [[convolutional neural network#Pooling layerslayer|pooling layers]] in [[convolutional neural network]]s, and in output layers of multiclass classification networks. These activations perform aggregation over the inputs, such as taking the [[mean]], [[minimum]] or [[maximum]]. In multiclass classification the [[Softmax function|softmax]] activation is often used.

=== Table of activation functions ===