A Self-Pruning Transformer: Extreme KV-Cache Compression with Universal AttentionDavis WertheimerHaochen Shenet al.2026COLM 2026Conference paper
Universal Position Interpolation: Unified Context Scaling for Hybrid Mamba-Transformer ModelsHaochen ShenDavis Wertheimeret al.2026ICLR 2026Conference paper