May 8-11, 2017

Event Details

Please note: All times listed below are in Central Time Zone

A Series of Unfortunate Deployments: Running a Lambda Architecture on OpenStack

We share the harrowing tale of a team of operators, devops engineers, and developers as they pursue their goal of deploying a scalable, high-performance chemistry search engine based on the Lambda architecture in Openstack.  This is not a story for the faint of heart, dear listener.

Tragedies in this talk include:

  •  Laggard networks! (VXLAN/VLAN trade-offs) 
  •  Murderous kernels! (CPU pinning and pre-allocated hugepages) 
  •  Recalcitrant storage! (Cinder backed with flash; Problems found in os-brick and multipathd)

What can I expect to learn?

This is the story of our team’s efforts to deploy a Lambda architecture search engine on Openstack, showcasing the trials and tribulations we encountered on our journey.  We share both what worked for us and what didn’t.  How taking advantage of all that Nova Compute offers made this deployment a success. We also highlight the importance of the Openstack operators working closely with developers to ensure maximize performance and stability.  Openstack is excellent for all things, but best when both devs and operators tailor the environment to match the expected workloads.

Monday, May 8, 12:05pm-12:45pm (4:05pm - 4:45pm UTC)
Difficulty Level: Advanced
Rackspace Hosting, Inc.
I have worked at Rackspace Hosting, Inc for over 5 years.  During that time, I've worked the support queue, mentored/coached new hires, worked in Public Cloud Ops, and had a stint in Rackspace Product before landing in the Private Cloud world.    FULL PROFILE
CAS, Senior Technologist
Scott is a Senior Technologist with CAS, a division of the American Chemical Society.  He has over 16 years of experience in developing Java-based distributed search and retrieval applications for chemists and information professionals. FULL PROFILE
RackSpace Inc
Monica is DevOps Engineer at CAS, a division of the American Chemical Society. She is currently supporting application development by managing the infrastructure of the full application stack and deployment pipeline on OpenStack. She has over 7 years of professional experience in IT, including areas of system administration, development, and middleware application support.  FULL PROFILE