Queue Management for Large Language Model Serving
- Archit Patke
- Dhemath Reddy
- et al.
- 2024
- SoCC 2024
Conference paper
Publications
13 results for Haoran Qiu
O˜(T−1) Convergence to (Coarse) Correlated Equilibria in Full-Information General-Sum Markov Games
- Weichao Mao
- Haoran Qiu
- et al.
- 2024
- L4DC 2024
Conference paperWhen Green Computing Meets Performance and Resilience SLOs
- Haoran Qiu
- Weichao Mao
- et al.
- 2024
- DSN 2024
Workshop paperFlash: Fast Model Adaptation in ML-Centric Cloud Platforms
- Haoran Qiu
- Weichao Mao
- et al.
- 2024
- MLSys 2024
Conference paperEfficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction
- Haoran Qiu
- Weichao Mao
- et al.
- 2024
- ASPLOS 2024
Workshop paperQueue Management for Large Language Model Serving
- Archit Patke
- Dhemath Reddy
- et al.
- 2024
- ASPLOS 2024
Workshop paperO˜(T−1) Convergence to (Coarse) Correlated Equilibria in Full-Information General-Sum Markov Games
- Weichao Mao
- Haoran Qiu
- et al.
- 2024
- arXiv
PaperMulti-Agent Meta-Reinforcement Learning: Sharper Convergence Rates with Task Similarity
- Weichao Mao
- Haoran Qiu
- et al.
- 2023
- NeurIPS 2023
Conference paperOn the Promise and Challenges of Foundation Models for Learning-based Cloud Systems Management
- Haoran Qiu
- Weichao Mao
- et al.
- 2023
- NeurIPS 2023
Workshop paperPALM: Adaptive Resource Allocation for Datacenter Power Capping
- Haoran Qiu
- Linghao Zhang
- et al.
- 2023
- NeurIPS 2023
Workshop