Mind the Memory Gap: Unveiling GPU Bottlenecks in Large-Batch LLM Inference
- Pol G. Recasens
- Ferran Agullo
- et al.
- 2025
- CLOUD 2025
Conference paper
Publications
245 results for Hybrid Cloud Infrastructure
A Lossless Compression for AI Models
- Moshik Hershcovitch
- Andrew Wood
- et al.
- 2025
- CLOUD 2025
Conference paperTowards Efficient Key-Value Cache Management for Prefix Prefilling in LLM Inference
- Yue Zhu
- Hao Yu
- et al.
- 2025
- CLOUD 2025
Short paperFrom Device Passthrough to Host Passout: Exploring RAS Risks in {High-Performance, Virtualized} AI-Systems
- Chathura Rajapaksha
- Sandhya Koteshwara
- et al.
- 2025
- OSDI 2025
PosterGranite Time Series: Lightweight Time-Series Models for Industrial Edge AI
- 2025
- AI Alliance Tokyo 2025
TalkScalable and Efficient LLM Serving with the vLLM Production Stack
- Junchen Jiang
- Yue Zhu
- 2025
- OSSNA 2025
TalkA Near-DRAM Accelerator for Compiler-Generated Fully Homomorphic Encryption Applications
- 2025
- ISCA 2025
Workshop paperHow Low Can LoRA Go: System-Level Throughput, Energy, and Model Quality Tradeoffs when Fine-Tuning Adapters
- Connor Espenshade
- Umesh Deshpande
- et al.
- 2025
- ISCA 2025
Workshop paperReimagining Cloud-Native Networks: The Critical Role of DRA
- Sunyanan Choochotkaew
- Lionel Jouin
- 2025
- KubeCon Japan 2025
TalkFast and Accurate Machine Learning Prediction of Back-End-of-Line Thermal Resistances in Backside Power Delivery and Chiplet Architectures
- Prabudhya Roy Chowdhury
- Aakrati Jain
- et al.
- 2025
- ECTC 2025
Conference paper