Publications

843 results for Foundation Models

Data Engineering for Scaling Language Models to 128K Context
- - Yao Fu
  - Rameswar Panda
  - et al.
- 2024
- ICML 2024
Conference paper
Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark
- - Yihua Zhang
  - Pingzhi Li
  - et al.
- 2024
- ICML 2024
Conference paper
tinyBenchmarks: evaluating LLMs with fewer examples
- - Felipe Maia Polo
  - Lucas Weber
  - et al.
- 2024
- ICML 2024
Conference paper
What Improves the Generalization of Graph Transformers? A Theoretical Dive into the Self-attention and Positional Encoding
- - Hongkang Li
  - Meng Wang
  - et al.
- 2024
- ICML 2024
Conference paper
A Provably Effective Method for Pruning Experts in Fine-tuned Sparse Mixture-of-Experts
- - Mohammed Nowaz Rabbani Chowdhury
  - Meng Wang
  - et al.
- 2024
- ICML 2024
Conference paper
Risk Aware Benchmarking of Large Language Models
- - Apoorva Nitsure
  - Youssef Mroueh
  - et al.
- 2024
- ICML 2024
Conference paper
Asymmetry in Low-Rank Adapters of Foundation Models
- - Jiacheng Zhu
  - Kristjan Greenewald
  - et al.
- 2024
- ICML 2024
Conference paper
CharED: Character-wise Ensemble Decoding for Large Language Models
- - Kevin Gu
  - Eva Tuecke
  - et al.
- 2024
- ICML 2024
Workshop paper
Split, Unlearn, Merge: Leveraging Data Attributes for More Effective Unlearning in LLMs
- - Swanand Ravindra Kadhe
  - Farhan Ahmed
  - et al.
- 2024
- ICML 2024
Workshop paper
Generation constraint scaling can mitigate hallucination
- - Georgios Kollias
  - Payel Das
  - et al.
- 2024
- ICML 2024
Workshop paper