Embed Size (px)
DESCRIPTION
This presentation was part of the OpenStack Boston Meetup on Oct 23th, 2013. OpenStack is being proposed as a platform for the Massachusetts Open Cloud. The Massachusetts Open Cloud (MOC) will be a public cloud based on a new model that allows many companies and institutions to participate in its implementation and operation. It will provide services ranging from what is termed Infrastructure as a Service (IaaS), the provisioning of basic computation in the form of virtual machines, up through higher layers such as application and Big Data platforms and services. A central focus of the MOC will be its use for solving problems that require analysis of massive data sets such as those targeted by the Commonwealth’s Big Data Initiative, taking advantage not only of services offered by the MOC but the ability to efficiently exchange large volumes of data between MOC users. Unlike existing proprietary public clouds, where all of the technology is controlled by a single entity, the MOC will operate as a marketplace in which hardware capacity, software and services can be flexibly supplied, purchased, and resold by many participants.
Citation preview
The Massachusetts Open Cloud (MOC)
Orran Krieger (BU)Peter Desnoyers (NEU), Daniel Kamalic (BU)
Credit/Collaborators: John Goodhue(MGHPCC), Peter Desnoyers (NEU), Chris Hill (MIT), Azer Bestavros (BU), Daniel
Kamalic (BU), Jonathan Appavoo (BU), Alex Benik (Battery), Azer Bestavros (BU), John Byers (BU), David Cohen (EMC), Chrys Lynch (Atlas), Gene Cooperman (NEU), Peter Desnoyers (NEU), Srini Devadas
(MIT), Shafi Goldwasser (MIT), Sharon Goldberg (BU), John Goodhue (MGHPCC), Michael Goroff, Jan Mark Holzer (Red Hat), David Emory Irwin (UMass), Frans Kaashoek (MIT), Orran Krieger (BU), Jim
Kurose (UMass), Barney Maccabe (ORNL), Sam Madden (MIT), Jeff Nick (Pivotal), Paul Rad (Rackspace), Andrei Ruckenstein (BU), Larry Rudolph (MIT), Margo Seltzer (Harvard), Prashant Shenoy (UMass), Salil
Vadham (Harvard), Daniel Wichs (NEU), Nickolai Zeldovich (MIT), Michael Zink (UMass)…
Cloud computing
• Clouds having a dramatic impact:
• Consumer: on-demand access to inexpensive computational capacity, pay for what you use
• Producer: economy of scale, automation
• Like power, most computation will move into public clouds.
Problems with today's “closed” public clouds
• Highly prescriptive in HW, computational model, economic model; focus on scale-out web applications
• Operational/performance data limited to the single provider
• Limiting research, innovation by third parties
➡ technology companies locked out of public clouds; disconnect with private clouds
➡ difficult for anyone else to efficiently support/innovate Big data platforms,
• No visibility/auditing of internal operations:
➡ Major security challenge for hosting critical datasets
• Accretion of features/services into Provider offering
• Monoculture increasingly dangerous
• Vendor lock in by features, interfaces, and pricing model.
A new model is required: an “open cloud”
• Multiple “partners” participate in implementing and operating cloud
• Each partner determines how to charge for her services
• Operational data visible to stakeholders
• Domain specific “intermediaries”:
• provide customers with simple model
• enable optimization
• Multi-sided marketplace
HPSeaMicro
Quanta
WebBig Data
HPC
RackspaceHP
...
...Red Hat
The Opportunity• OpenStack provides most of what we need:
• modular structure with multiple independent services and support for plugins
• 15 MW MGHPCC data center, low power cost, excellent network connectivity...
• MGHPCC consortium: BU, MIT, NE, UMass, Harvard.
• Operate production cloud capacity for research computation & enable Big Data & HPC users
• Enable research in Big Data, Cloud Computing
• Incredible regional cluster of technology companies and innovative users of technology
• Commonwealth Big Data Initiative
• Launched attempt to create “Massachusetts Open Cloud (MOC)” as a partnership: State, MGHPCC, Industry
Value to Technology Partners
• A neutral platform where private-cloud participants can integrate, test and certify their HW and SW
• Access to users and rich data about how products are used
• Demonstrate technologies to be sold to private and public clouds
• Evaluate new products with real customers at an early stage
• A platform to engage with the broad research community in the participating institutions
• Access to a community of students across the institutions working on Cloud Computing and Big Data
• An environment to demonstrate value to State, Federal
Status• Key part of State’s big data ini4a4ve: LOI for $3M: will host the states public data sets and enable startups in Big Data...
• MLSC funding $4.5M to create cloud for life sciences users to advantage research and local life science industry
• Approval from consor4um to use HGHPCC 15MW data center• ORNL puPng together plan to par4cipate.• By the end of October full proposal to State for $3M, need to raise at least $9M in matching involvement from founding partners: – Pending & exis4ng commits: XXXX– In conversa4on: XXXX– > $6M locked down, expect remaining commitments to come in on 4me
• In a good posi4on to compete for $10M NSFcloud testbed grant in Dec
7
Our ask
• Le\ers of support (by next week)• Use cases• Development collabora4on• People interested in posi4ons...
8
