Embed Size (px)
Citation preview
Mandie Quartly, Ph.D.WW lead, Machine Learning & High Performance Analytics, OpenPOWER ISV Ecosystem@mandieq
© 2017 OpenPOWER FoundationSource
Houston, we have a problem...
© 2017 OpenPOWER Foundation
Accelerated innovation through collaboration of
partners
Driving industry performance leadership
Vibrant ecosystem through open development
What's OpenPOWER all about?
OpenPOWER is an open development community using the POWER Architecture
© 2017 OpenPOWER Foundation
Chip / SOC
Boards / Systems
I/O / Storage / Acceleration
System / Integration
Software
Implementation / HPC / Research
This is what a revolution looks like
© 2017 OpenPOWER Foundation
Speed to innovation | Standards | Choice
© 2017 OpenPOWER Foundation
Open allows you to create what you need
© 2017 OpenPOWER Foundation
So what's new?
© 2017 OpenPOWER Foundation
continents
80+ technologies revealed
innovations under way 100s
members 300+
30 6 countries
So much going on...
© 2017 OpenPOWER Foundation
Recent OpenPOWER Summit Europe (October 2016)
Videos and presentations available at:
http://openpowerfoundation.org/openpower-summit-europe/
Overview of announcements / news: https://openpowerfoundation.org/press-releases/european-market-adopting-openpower-technology-accelerated-pace/
© 2017 OpenPOWER Foundation
CAPI SNAP Framework announced
Seven active OpenPOWER contributors
Make it easy for developers to take
advantage of FPGA accelerators
Make it open source – leading to continuing improvements and open collaboration
Two key directives
© 2017 OpenPOWER Foundation
OpenPOWER Ambassador program
https://openpowerfoundation.org/ambassadors/
https://www.youtube.com/watch?v=-bTr4EI38Kc
© 2017 OpenPOWER Foundation
OpenPOWER Innovation in the DesignPower Systems S822LC for High Performance Computing (aka Minsky)
NVIDIA: Tesla P100 GPU Accelerator with NVLink (GPU↔GPU & GPU↔CPU)
Ubuntu by Canonical: Launch OS supporting NVLink and Page Migration Engine
Wistron: Platform co-design
Mellanox: InfiniBand/Ethernet Connectivity in and out of server
HGST: Optional NVMe Adapters
Broadcom: Optional PCIe Adapters
QLogic: Optional Fiber Channel PCIe
Samsung: 2.5” SSDs
Hynix, Samsung, Micron: DDR4
IBM: POWER8 CPU with NVLink
© 2017 OpenPOWER Foundation
Available now: Barreleye G1
In partnership with Avago, IBM, Mellanox, PMC & Samsung
© 2017 OpenPOWER Foundation
http://blog.rackspace.com/first-look-zaius-server-platform-google-rackspace-collaboration
S822LC For High Performance Computing
• 2 socket, 2U
• POWER8 with NVIDIA NVLink
• Up to 4 integrated NVIDIA “Pascal” P100 GPUs
S822LC For Big Data
• 2 socket, 2U
• Storage-centric and high through-put workloads
• Big data acceleration with work CAPI and GPUs
S821LC
• 1 socket, 2U
• Storage rich for big data applications
• Memory Intensive workloads
S822LC
• 2 socket, 2U
• Memory Intensive workloads
S812LC
• 2 sockets, 1U
• Dense computing
NEWNEWNEWNEW
NEWNEWBig Data
High Performance Computing ComputeIntensive
The IBM Power Systems LC LineOpenPOWER servers for cloud and cluster deployments that are different by design
© 2017 OpenPOWER Foundation
2014 2015 2016
Developer Platform
System SW
HW Architecture
Accelerator
Compliance
SP010 – Tyan OpenPOWER Customer Reference System CAPI – Coherent Accelerator Processor Interface
AFU – Accelerator Function UnitFSI – Field Replaceable Unit (FRU) Service Interface
25g IO Compatibility
Memory
OpenPOWER I/O
12 Work Groups
CharterCompliance SpecificationDraft Review WG Spec
CompSTD
CharterOpenPOWER ISA Profile V1IO Device Architecture V2Coherent Accel Intf Arch
OpenPOWER ISA Profile V2IO Device Architecture V3Coherent Accel Intf Arch
Charter P8 SP010Data
P8 2U2SReference
P8+ 1U1SReference
P8+ 2U2SReference
OPMB Intf. Spec V1Charter
CharterCAPI AFU Intf Spec V1
OpenCL SDK CAPI AFU Intf Spec V2
Charter
CAPI LinuxSDK 64b ABI
Platform Ref
Sys I/O Enablement GuideCharter
Charter 25g IO Spec
OPMB – OpenPOWER Memory Bus ABI – Application Binary Interface
FSI Specification FSI SpecCharter
SDK – Software Developer Kit
Charter Pers Med
Charter Integrated Solutions Integrated Solutions
Personalised Medicine
OpenPOWER Ready
Physical Science
Charter
Charter
© 2017 OpenPOWER Foundation
OpenPOWER Ready
● Products / solutions may display badge
● Participants request to use it● Compatibility● Not Certification or
Compliance ● OpenPOWER Ready™ List
http://openpowerfoundation.org/technical/openpower-ready/
© 2017 OpenPOWER Foundation
Announcing OpenCAPI
● Two major technology trends will heavily impact the industry– Hardware acceleration will become
commonplace– New advanced memory technologies will change
the economics of computing
● Existing system interfaces are insufficient to address these disruptive forces– Traditional I/O architecture results in very high
CPU overhead– Systems must be able to integrate multiple
memory technologies with different access methods and performance attributes
● These challenges must be addressed in an open architecture allowing full industry participation
© 2017 OpenPOWER Foundation
OpenCAPI – membership
© 2017 OpenPOWER Foundation
http://opencapi.org/
http://genzconsortium.org/
http://www.ccixconsortium.com/
Newly announced open consortia
focused on collaboratively solving
industry problems
Focused on coherency for high speed interconnects
Underlying packet based protocol that can transport both CCIX and Open CAPI.
Enables memory operations to direct attach and disaggregated memory and storage
New high speed physical layer Building on PCIe Gen4
Who is using OpenPOWER and how?
Who is using OpenPOWER and how?
STFC Hartree Centre
Power Acceleration and Design CentreCollaboration with IBM and NVidia
Panther System: 32x POWER8 + NVidia K80 GPUs
“take advantage of IBM and NVIDIA’s technological leadership in supercomputing and the Hartree Centre's expertise and experience in delivering solutions to real-world problems”
Who is using OpenPOWER and how?
Tencent
Integration of OpenPOWER systems into their Hyper Scale Data Centres for Big Data workloads
Recent results running Spark Terasort:3x better performance vs former x86 infrastructure, with 2/3rd fewer servers.
512x SuperMicro POWER8 servers
Results: http://sortbenchmark.org/
Who is using OpenPOWER and how?
https://www.youtube.com/watch?v=GZAFzlWN8FU
KineticaGPU-powered database
“insights in real time from live data”
Kinetica on OpenPOWER = 2.6X faster than x86
POWER8 with NVLink + NVidia P100 GPUs compared to x86 + NVidia K80 GPUs
Who is using OpenPOWER and how?
Utility company
Deep learning video analysis of drone footage of high voltage power transmission towers
Inspect ~10x more towers per day, with increased safety
PowerAI + S822LC for HPC POWER8 with NVLink + NVidia P100 GPUs
Who is using OpenPOWER and how?
Video analytics using FGPAConnected via CAPI – only with POWER8
CAPI = 30 fpsSoftware = 2 fps
ibm.biz/powercapi
© 2017 OpenPOWER Foundation
● Change is inevitable● Open is good● What's the best tool for the job?
Main website → openpowerfoundation.org
@mandieq
Reference material
© 2017 OpenPOWER Foundation
AC
TIO
NA
CT
ION
OU
TC
OM
EO
UT
CO
ME
INT
ER
ES
TIN
TE
RE
ST
Technology and Software Innovators
Technology and Software Innovators
Discuss areas of collaboration and synergy in OpenPOWER.
Sign up for membership and join a work group.
Build technical and business relationships.
Discuss areas of collaboration and synergy in OpenPOWER.
Sign up for membership and join a work group.
Build technical and business relationships.
Develop collaborative innovations
with compelling value
Develop collaborative innovations
with compelling value
Innovators, Integrators, and Partners
Innovators, Integrators, and Partners
Deep understanding of workload demands and
consumption preferences of end users.
Team with innovators and end users to drive requirements, engage in specific projects.
Deep understanding of workload demands and
consumption preferences of end users.
Team with innovators and end users to drive requirements, engage in specific projects.
Deliver collaborative innovations
with compelling value
Deliver collaborative innovations
with compelling value
End UsersEnd Users
Strategic imperatives and workload demands for performance and cost
optimization.
Require open software and systems with choice and
flexibility.
Engage directly on system design options.
Strategic imperatives and workload demands for performance and cost
optimization.
Require open software and systems with choice and
flexibility.
Engage directly on system design options.
Deploy collaborative innovations
with compelling value
Deploy collaborative innovations
with compelling value
Engage in the OpenPOWER community
© 2017 OpenPOWER Foundation
Membership Level Annual Fee$ USD FTEs Technical Steering Committee Board / Voting position
Platinum $100k 10 One seat per member not otherwise represented
Includes board positionIncludes TSC position
Gold $60k 3 May be on TSC if Work group lead
Gold members may elect one board representative per three
gold members
Silver $20k $5k if <300 employees 0 May be on TSC if
Work group lead
Sliver members may elect one board representative for all silver
members
Silver ISV $0 if ISV is <300 employees 0 May be on TSC if
Work group lead
Sliver members may elect one board representative for all silver
members
Associate & Academic $0 0 May be on TSC if
Work group leadMay be elected to one community observer, non-voting Board seat
Membership agreement, Bylaws, and IP Rights Policy available for reviewwww.openpowerfoundation.org
Membership agreement, Bylaws, and IP Rights Policy available for reviewwww.openpowerfoundation.org
Anyone may participate in OpenPOWER. Membership levels are designed for those that are investing to grow and enhance the OpenPOWER community and its proliferation within the industry.
Membership Options
New
© 2017 OpenPOWER Foundation
Announcements at OpenPOWER Summit Europe
● CAPI SNAP: The Simplest Way for Developers to Adopt CAPI https://openpowerfoundation.org/blogs/capi-snap-simple-developers/
● OpenPOWER Makes FPGA Acceleration a “SNAP” https://openpowerfoundation.org/blogs/openpower-makes-fpga-acceleration-snap/
● Barcelona Supercomputing Center Adds HPC Expertise to OpenPOWER https://openpowerfoundation.org/blogs/barcelona-supercomputing-center-adds-hpc-expertise-to-openpower/
● Advancing the Human Brain Project with OpenPOWER https://openpowerfoundation.org/blogs/advancing-human-brain-project-openpower/
● Innovation Unleashed: OpenPOWER Developer Challenge Winners Announced https://openpowerfoundation.org/blogs/innovation-unleashed-openpower-developer-challenge-winners-announced/
● New Physical Science Work Group Addresses Physics, Chemistry, and more with OpenPOWER https://openpowerfoundation.org/blogs/physical-science-wg/
● Making Unforgettable MRAM Memory with OpenPOWER https://openpowerfoundation.org/blogs/making-unforgettable-mram-memory-openpower/
© 2017 OpenPOWER Foundation
http://developers.openpowerfoundation.org/
Industry Landscape• Two major technology trends will heavily impact the industry
• Hardware acceleration will become commonplace as microprocessor technology and design continues to deliver far less than the historical rate of cost/performance improvement per generation
• New advanced memory technologies will change the economics of computing
• Existing system interfaces are insufficient to address these disruptive forces• Traditional I/O architecture results in very high CPU overhead when applications communicate with I/O or
Accelerator devices at the necessary performance levels• Systems must be able to integrate multiple memory technologies with different access methods and
performance attributes
• These challenges must be addressed in an open architecture allowing full industry participation
• Establish sufficient volume base to drive cost down• Support broad ecosystem of software and attached devices
OpenCAPI Approach • What is OpenCAPI?
• OpenCAPI is an Open Interface Architecture that allows any microprocessor to attach to• Coherent user-level accelerators and I/O devices• Advanced memories accessible via read/write or user-level DMA semantics• Agnostic to processor architecture
• Key Attributes of OpenCAPI• High-bandwidth, low latency interface optimized to enable streamlined implementation of attached
devices• 25Gbit/sec signaling and protocol built to enable very low latency interface on CPU and attached device• Complexities of coherence and virtual addressing implemented on host microprocessor to simplify attached
devices and facilitate interoperability across multiple CPU architectures
• Attached devices operate natively within an application’s user space and coherently with processors• Allows attached device to fully participate in application without kernel involvement/overhead
• Supports a wide range of use cases and access semantics• Hardware accelerators• High-performance I/O devices• Advanced memories
• 100% Open Consortium / All company participants welcome / All ISA participants welcome
© 2017 OpenPOWER Foundation
CCIX membership (Feb 2017)
http://www.ccixconsortium.com/
© 2017 OpenPOWER Foundation
Gen-Z membership (Feb 2017)
http://genzconsortium.org/
