Vancouver, BC
May 21-24, 2018

Event Details

Please note: All times listed below are in Central Time Zone

Ceph and the CERN HPC Infrastructure

For the past 5 years, CERN IT has employed Ceph technology to build scale-out storage for our OpenStack cloud. For the block and object storage use-cases, with and without erasure coding, Ceph has demonstrated to be flexible and scalable while being resiliant to infrastructure failures.

But as our computing requirements evolve, the importance of a scale-out HPC filesystem is emerging. We therefore present usage of CephFS -- managed by Manila -- in production for our HPC and general IT infrastructure. We highlight the key metrics required by our users, including POSIX compliance, small-file latency, metadata throughput and scalability, and fault tolerance, while showing the results of industry-standard and new microbenchmarks.

Monday, May 21, 2:20pm-3:00pm(UTC -5)
Difficulty Level: Intermediate
Dan is a Storage Engineer and Ceph Manager in CERN IT's Storage Group. Prior to working on storage, Dan worked in Grid Computing for the ATLAS experiment at CERN. Dan earned a PhD in Computer Engineering at the University of Victoria in 2008. FULL PROFILE
Arne Wiebalck is a systems engineer at CERN, the European Organization for Nuclear Research. He studied physics and obtained a PhD in Computer Science from Heidelberg University in Germany, before he joined CERN more than 10 years ago. For several years he worked as a developer and engineer for CERN’s mass storage and distributed file systems. With the adoption of agile methods in CERN IT,... FULL PROFILE