Gemma Scope 2: DeepMind's 110-Petabyte Probe into AI's Hidden Thoughts
Picture this: 110 petabytes of data, funneled into tools that let you spy on a language model's every flickering thought. Google DeepMind's Gemma Scope 2 isn't just an update—it's a full-frontal assault on AI opacity.
⚡ Key Takeaways
- Gemma Scope 2 provides full interpretability tools for entire Gemma 3 family up to 27B parameters.
- Features advanced SAEs, transcoders, and Matryoshka training to decode complex, multi-layer behaviors.
- Targets safety issues like jailbreaks and hallucinations; largest open release by an AI lab with 110PB data.
🧠 What's your take on this?
Cast your vote and see what theAIcatchup readers think
Worth sharing?
Get the best AI stories of the week in your inbox — no noise, no spam.
Originally reported by Google DeepMind Blog