Loss functions for classification: Difference between revisions

Revision as of 22:21, 5 December 2014

Revision as of 22:22, 5 December 2014

Line 20:

The hinge loss function is defined as

:<math>V(f(\vec{x}),y) = \max(0, 1-yf(\vec{x})) = |1 - yf(\vec{x})|_{+}</math>

The hinge loss provides a relatively tight, convex upper bound on the 0-1 [[indicator function]]. Specifically, the hinge loss equals the 0-1 [[indicator function]] when <math>sgn(f(\vec{x})) = y</math> and <math>|1 - \abs{yf(\vec{x})| ≥ 1 ≥1</math> .

== Logistic Loss ==