226. Training Methods for EBMs

Constrastive Method

Push down on the energy of training samples while pulling up on the energies of suitably placed contrastive samples.
The Disadvantage is that you always need contrastive samples in order to constrain the low-energy region.

Regularized Method

Push down on the energy of training samples and minimize the volume of the low-energy region.

Reference: A Path Towards Autonomous Machine Intelligence