Energy-Based Models
Summary
Energy-based models appear here as the probabilistic alternative favored for high-dimensional continuous data where explicit normalized probability models become awkward.
What The Wiki Currently Believes
- A Path Towards Autonomous Machine Intelligence uses energy-based modeling as part of a larger architecture for autonomous agents, world models, and intrinsic objectives.
- Introduction to Latent Variable Energy-Based Models explains why regularized EBMs are attractive for future autonomous intelligence and why contrastive sampling can scale poorly in high dimensions.
Evidence
The two sources are aligned: both treat EBMs less as a standalone recipe and more as a substrate for predictive representations and world models.
Open Questions
- Which regularized EBM training methods scale best for multimodal world models?
- How directly should current JEPA objectives be interpreted as energy-based objectives?