Loss functions for classification: Difference between revisions

Revision as of 22:18, 5 December 2014

Revision as of 22:19, 5 December 2014

Line 20:

The hinge loss function is defined as

:<math>V(f(\vec{x}),y) = \max(0, 1-yf(\vec{x})) = |1 - yf(\vec{x})|_{+}</math>

The hinge loss provides a relatively tight, convex upper bound on the 0-1 [[indicator function]]. Specifically, the hinge loss equals the 0-1 [[indicator function]] when <math>sgn(f(\vec{x})) = y</math> and <math> |1 y- fyf(\vec{x}) | ≥ 1 </math>.

== Logistic Loss ==