Mind the Memory Gap: Unveiling GPU Bottlenecks in Large-Batch LLM Inference
- Pol G. Recasens
- Ferran Agullo
- et al.
- 2025
- CLOUD 2025
Conference paper
Publications
14 results for Chen Wang
Evaluating the Network Effects of Orchestration Strategies for AI Workloads in Modern Data Centers
- José Santos
- Pavlos Maniotis
- et al.
- 2025
- NetSoft 2025
Conference paperPower-aware Deep Learning Model Serving with µ-Serve
- Haoran Qiu
- Weichao Mao
- et al.
- 2024
- USENIX ATC 2024
Conference paperTowards Pareto Optimal Throughput in Small Language Model Serving
- Pol G. Recasens
- Yue Zhu
- et al.
- 2024
- EuroMLSys 2024
Conference paperActo: Automatic End-to-End Testing for Operation Correctness of Cloud System Management
- Jiawei Tyler Gu
- Xudong Sun
- et al.
- 2023
- SOSP 2023
Conference paperA Mean-Field Game Approach to Cloud Resource Management with Function Approximation
- Weichao Mao
- Haoran Qiu
- et al.
- 2022
- NeurIPS 2022
Conference paperSIMPPO: A Scalable and Incremental Online Learning Framework for Serverless Resource Management
- Haoran Qiu
- Weichao Mao
- et al.
- 2022
- SoCC 2022
Conference paperReinforcement learning for resource management in multi-Tenant serverless platforms
- Haoran Qiu
- Weichao Mao
- et al.
- 2022
- EuroMLSys 2022
Workshop paperIs Function-as-a-Service a Good Fit for Latency-Critical Services?
- Haoran Qiu
- Saurabh Jha
- et al.
- 2021
- WoSC 2021
Conference paperTheta-Scan: Leveraging Behavior-Driven Forecasting for Vertical Auto-Scaling in Container Cloud
- Josep Lluis Berral
- David Buchaca
- et al.
- 2021
- CLOUD 2021
Conference paper