Sparse Transformer
OpenAI · Multimodal model · Registered 2026-03-04
IDENTITY
Confirmed by
Confirmed via https://openai.com/index/sparse-transformer
First registered
2026-03-04 (rss_pipeline)
Developer confirmed
2019-04-23
PROVENANCE
Confirmed developer
OpenAI
PASSPORT FIELDS
Parameters
~152M (largest reported configuration; varies by benchmark task)
Context window
Tens of thousands to up to ~1 million timesteps (theoretical upper bound demonstrated in paper)
PROVENANCE TIMELINE
2026-03-04
First recorded in AI news