Event Details

Cloud by design is provisioned for peak workloads. So it tends to stay underutilized most of the time. Operating a public cloud is costly. Different approaches are being explored to increase the cloud utilization rate. We explore utilizing these idle cloud resources to run High-Throughput Computing (HTC) jobs. HTC jobs are loosely coupled and doesn’t require high communication among compute nodes. This ‘HTC service’ is being made available in the Massachusetts Open Cloud Marketplace, Giji. The service creates VM on preemptible resources, suspends or resumes VM instances for the HTC jobs based on configurable thresholds and current cloud utilization levels. The Slurm Workload Manager is used to manage the HTC jobs. Slurm user experience via its command line is preserved.