Auto-Encoder study notes
Basic Idea of Auto-encoder
| Concept | Key Features |
|---|---|
| Encoder | Transforms input data into a compressed, lower-dimensional representation. |
| Decoder | Reconstructs input data from the compressed form to closely resemble the original data. |
| Embedding | The compressed vector representation of input data created by the encoder. |
| Auto-Encoders | A neural network architecture for learning efficient data codings in an unsupervised manner. Utilizes encoder to compress data and decoder to reconstruct it, aiming to minimize the difference between the original and reconstructed data. |
Feature Disentangle
Idea: what’s in the embedding? Extract the information of different aspects.
For example:
Discrete Representation
- Vector Quantized Variational Auto-encoder (VQVAE)
