PaTH Attention: Position Encoding via Accumulating Householder Transformations
- Songlin Yang
- Yikang Shen
- et al.
- 2025
- NeurIPS 2025
Conference paper
Publications
34 results for Rameswar Panda
Scaling Stick-Breaking Attention: An Efficient Implementation and In-depth Study
- Shawn Tan
- Songlin Yang
- et al.
- 2025
- ICLR 2025
Conference paperSelf-MoE: Towards Compositional Large Language Models with Self-Specialized Experts
- Junmo Kang
- Leonid Karlinsky
- et al.
- 2025
- ICLR 2025
Conference paperReducing Transformer Key-Value Cache Size with Cross-Layer Attention
- William Brandon
- Mayank Mishra
- et al.
- 2024
- NeurIPS 2024
PosterGranite-Function Calling Model: Introducing Function Calling Abilities via Multi-task Learning of Granular Tasks
- Ibrahim Abdelaziz
- Kinjal Basu
- et al.
- 2024
- EMNLP 2024
Conference paperData Engineering for Scaling Language Models to 128K Context
- Yao Fu
- Rameswar Panda
- et al.
- 2024
- ICML 2024
Conference paperScaling Granite Code Models to 128K Context
- Matthew Stallone
- Vaibhav Saxena
- et al.
- 2024
- arXiv
PaperGranite code models: A family of open foundation models for code intelligence
- Mayank Mishra
- Matthew Stallone
- et al.
- 2024
- arXiv
PaperDense and Aligned Captions (DAC) Promote Compositional Reasoning in VL Models
- Sivan Doveh
- Assaf Arbelle
- et al.
- 2023
- NeurIPS 2023
Conference paperEnergy Transformer
- Benjamin Hoover
- Yuchen Liang
- et al.
- 2023
- NeurIPS 2023
Conference paper