AI Research
Attention as Gibbs Distribution: Neat Math Trick or Transformer Revelation?
Physicists are invading AI again, swearing attention mechanisms are secretly Gibbs distributions. Proof dropped — but is it profound or just probabilistic poetry?