Tag: cern


OpenStack in action 3! The Open Revolution / Paris, November 29th, 2012

December 11th, 2012 — 7:47am

On Thursday November 29th, eNovance has organized the 3rd edition of the « OpenStack in action ! » event in Paris. The day was intense and we had great speakers coming from all around the world to talk about OpenStack.

The majority of the 200 attendees was of course french but people came from 15 different countries to see speakers such as Mark Collier and Thierry Carrez, from the OpenStack foundation who explained the foundation priorities for 2013 and told us more about the technical committee; Rick Clark, from Cisco who underlined the importance of open source and its strengths, Adolfo Brandes, flying from Brazil to encourage companies to work efficiently on open source softwares thanks to Upstream University

This edition showed how OpenStack is gaining interest and is growing in Europe at a fast pace.

European companies and entities were widely represented, among them: Stackops (Spain), Hastexo (Austria), the CERN (Switzerland), eNovance and Cloudwatt (France)…

Arturo Suarez from Stackops showed us interesting metrics on Cloud adoption in Europe and why OpenStack is a land of opportunities for doing business in the region.

Florian Haas (Hastexo) and James Duncan (Inktank) told us more about Ceph, the new yet very promising technology for storage and its integration on OpenStack.

Jan van Eldik, came to present the “already famous” CERN’s case study and explained why they chose an OpenStack Private Cloud (and a big one!) for their infrastructure…and, they have the ambition to ramp this infrastructure to 1500 hypervisors and between 100 000 and 300 000 VMs by 2015!

Cloudwatt, the new French company also chose OpenStack to build a massive Public Cloud in France. eNovance is helping them design and build their infrastructure.

Cloudwatt has a capital of 225 million euros and its goals are clear and ambitious : build a European Cloud that will be able to compete with american giants such as AWS, Microsoft Azure and Google…. France has never seen projects of this magnitude and the French government has clearly showed its engagement to promote the execution of this important project of common European interest (the French government invested 75 million euros in Cloudwatt). eNovance and Cloudwatt, both French sponsors of the OpenStack foundation showed how OpenStack allows service providers to be aggressive in terms of pricing on the very competitive IaaS market and are deeply committed in showing the way to OpenStack adoption in Europe.

All the companies that are involved in OpenStack underlined the importance of developing the community, multiplying the contributors and sharing the work in order to keep this fast pace of development and add new great features to OpenStack every 6 months.

Thanks to the HR investments several contributing companies made to work on OpenStack, we can see now that Quantum (network) is already a core project in the Folsom release and Ceilometer (metering) has been accepted in incubation in the future Grizzly release.

We were also please to welcome “newcomers” for this 3rd edition: HP, Suse, NetApp and IBM came to talk about their different contributions to the project and to explain why and how they are integrating their services on OpenStack. Whether we are talking about huge OpenStack based public clouds or different services related to storage or distributions, the presence of these companies gave a brand new scope to the visibility of OpenStack in France and Europe.

Comment » | Communication, community, Event

1st Swiss OpenStack User Group

December 5th, 2012 — 5:27pm

The first Swiss OpenStack user meeting  took place on 15th November 2012 at ETH in Zurich. The meeting was a combination of the Swiss OpenStack user group along with the zhgeeks regular meeting.

Around 90 people attended which provided for a lively atmosphere with a good opportunity for audience interaction and participation. Photos are here. Discussions continued well on into the night taking advantage of Zurich’s fine gastronomy and beverages.

ICCLab Introduction

Thomas M. Bohnert gave an overview of the ICCLab which covered the role of the InIT Cloud Computing Lab’s investigations in cloud technologies. Some of the lightning talks later covered some areas of ICCLab research.

CERN and OpenStack

Tim Bell gave a rapid overview of OpenStack architecture, news from the summit, the foundation structure and use of OpenStack at CERN.  The tools and procedures in use in the CERN computer centre are being adapted to be more sustainable and efficient by engaging and adapting open source solutions. Slides are available here.

He had a lot of ground to cover in 30 minutes! Given that the audience ranged from relative novices in OpenStack up to those deploying, it is also a wide range of details to cover in a single talk.

Amongst the questions were what is the impact of moving towards clouds on the current MONARC grid model as used by the WLCG. One of the common challenges for CERN is how to solve the “Changing the engine while the plane is flying” problem.  Even though there is an extended shutdown of the LHC during 2013/2014 in order to ugrade to higher energy, the physics analysis of the data taken in the first run from 2010 to 2012 will continue. Any major architecture changes on the grid must be performed in a staged fashion as there are over 130 sites and 200,000 servers to consider so big bang migrations are not realistic. Thus, the approach we are taking is one of running the grid services on top of the CERN private cloud. This allows us to gain improvements in efficiency via more dynamic workload placement and simplified operations procedures without needing to break compatibility. As the users of the service wish, resources can be moved between standard batch services on the grid and those available as VMs on the cloud.

Following up from this question was whether the other centres in the WLCG would be following the same approach. Each tier-1 is an independent organisation and can make its own choices within the framework of the WLCG. CERN is just one of the sites and each of the sites are able to make their own decisions based on individual requirements. Research into areas such as federated clouds is ongoing but no decisions for production federated clouds have been made.

Developing OpenStack APIs

Thijs Metsch from Intel gave a lightning talk on developing OpenStack APIs. Since OpenStack is a modular architecture, it is possible to plug in additional API functionality. This process is made more straightforward by the use of WSGI and python. Examples of this already implemented are the OCCI API and others such as CDMI are also coming along. Cloudscaling recently announced their implementation of the Google Compute Engine API for OpenStack. Thus, the choice of API can be made independently from the choice of IaaS technology.

Thijs demonstrated how this could be done by creating a simple python RESTful API and showed us the python code to implement it.


ICCLab Proof of Concept

Fabrice Manhart from the ICCLab presented the ICCLab proof of concept OpenStack cloud. ICCLab use Foreman and Puppet, as do CERN, and have good experiences with this combination. Being able to re-install their 15 hypervisors in 15 minutes is a typical case.

Swiss Academic Cloud Proof of Concept

Dean Flanders from Friedrich Miescher Institute for Biomedical Research /SwiN presented their OpenStack based cloud which is testing out new computing models in a research environment. They selected OpenStack for its flexibility (and price :-). Their cloud allows researchers to provision their own machines rapidly. Amongst the areas they are investigating is the use of flash storage, aiming to reach 100TB SSD capacity. This approach follows work in the SDSC on Gordon which is a 16K cores 300TB flash based facility using OpenStack and ScaleMP.

While it is still early days for OpenStack, they are looking into new areas such as cloud bursting and workload balancing.

Software Defined Networking at ICCLab

Philipp Aeschlimann from ICCLab presented the current status of software-defined networking and their investigations as part of ICCLab. There is a lot of interest in the OpenStack community around these features and Quantum functionality covers many features. There was a live demonstration given showing OpenStack Folsom, Quantum and Floodlight.

OpenStack at SWITCH

SWITCH  provide facilities for the universities and academic organisations in Switzerland. Joel Casutt presented their early work to extend their existing services to include cloud services based on OpenStack. They are currently building up the hardware aiming to provide a free pilot service in April. During the summer, this experience will be reviewed along with the charging structure to be used going forward.

CloudBroker

Wibke Sudholt from Cloudbroker  presented their open source broker solution. Within the SCIentific gateway Based User Support (SCI-BUS) EU FP7 project, CloudBroker has extended its CloudBroker Platform so that it now also allows access to Amazon and IBM public clouds as well as to private cloud infrastructures based on OpenStack and Eucalyptus. While the initial aims were to use the EC2 API in OpenStack, there were some missing features and functionalities such as auto-deployment so it was necessary to use some of the OpenStack APIs to achieve full function. Using OpenStack clouds in universities allowed this porting to be done without having to set up their own OpenStack instance. The XML support was also not as good as JSON in some areas.

Thoughts

Even in a country with a small population such as Switzerland, there are many areas of OpenStack work. Per-capita, the Swiss user group attracted 5 times more people that the Chinese user group meeting (where 3,000 people attended). There was only time for 6 lightning sessions of 10 minutes but we are now planning the second meeting to allow those who could not show their work!

Many of the attendees were investigating/testing proof of concepts. The number of production deployments are small amongst those attending. As this is often the first investigations into cloud services, this is not too surprising. Many of the deployments were using Puppet as well. During the evening, we discussed the competition for talent. Given that many CERN people are on short term contracts, the interest in OpenStack and Puppet skills makes for a good skill on their CVs.

A recent blog  on comparing Google trends follows similar lines. The interactive report is here . Unfortunately, there is not enough data from Switzerland to determine the interest in different cloud products.

Overall, there was a lot of enthusiasm but this was balanced with caution that comes from uncovering some of the difficulities to understand clouds and how best to deploy OpenStack.

The most frequent question at the end was “When will we meet up again?”. Stay tuned for more CHOSUG!

Comment » | community, Meetup

Back to top