A Mathematical Framework for Transformer Circuits

This foundational work in mechanistic interpretability reverse-engineered small Transformers to identify "induction heads." These circuits are responsible fo...

Anthropic

Paper

Related papers

21

Anthropic
Anthropic
MATS
Theorem
UK AISI
Anthropic
Anthropic
Alignment Research Center
Anthropic
Truthful AI
University of California, Berkeley
Warsaw University of Technology
Anthropic
OpenAI
Meta Platforms
Anthropic
Center for AI Safety
Center for AI Standards and Innovation
Co-affiliated with Carnegie Mellon University
UK Artificial Intelligence Security Institute
Anthropic

Looking for more?

Open the arXiv / PDF link for the full paper. Abstract and authors appear here when enrichment has run.

All papers Company profile Search “A Mathematical Framework for Tr…” All catalogs