Hoe AI-modellen feiten opslaan en ophalen: onderzoek naar Gemma's neurale circuits

Researchers have identified a three-phase circuit in Gemma language models that explains how factual information flows through neural networks. Using activation patching techniques, scientists discovered that facts are stored, routed, and retrieved across transformer layers, with the residual stream playing a central role in this process.