Autoencoder

This is an old revision of this page, as edited by Abtract (talk | contribs) at 19:29, 15 November 2007 (moved Autoencoder to Auto-encoder: more common spelling). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

An auto-encoder is an artificial neural network used for learning efficient codings. The aim of an auto-encoder is to learn a compressed representation (encoding) for a set of data. Auto-encoders use three layers:

  • An input layer. For example, in a face recognition task, the neurons in the input layer could map to pixels in the photograph.
  • A considerably smaller hidden layer, which will form the encoding.
  • An output layer, where each neuron has the same meaning as in the input layer.

If linear neurons are used, then an auto-encoder is very similar to PCA.