Anomaly Detection in a Large-scale Cloud Platform
Mohammad Saiful Islam, William Pourmajidi, et al.
ICSE 2021
We present bespoke energy efficiency optimizations in high performance computing (HPC) environments using holistic approach to data collection, analysis and proactive management of resources and workloads. Our solution has three major components: i) platform for collecting, storing and processing data from multiple sources across hardware and software stacks, ii) collections of regression machine learning (ML) algorithms for making workloads classifications and energy usage predictions, iii) agent-based decision-making framework for delivering control decisions to middleware and infrastructure thus supporting real time or near real energy efficiency optimizations. We will present some concrete examples of using our proposed approach in HPC environment.
Mohammad Saiful Islam, William Pourmajidi, et al.
ICSE 2021
Karan Bhukar, Harshit Kumar, et al.
ICSE 2024
Matthew Arnold, Jeffrey Boston, et al.
MLSys 2020
Shai Ginsburg, Patil Korkeen, et al.
AAAI 2024