Upload
jakub-pavlik
View
97
Download
0
Embed Size (px)
Citation preview
OpenStack Journey in Tieto Elastic Cloud
Agenda• About Tieto
• The starting point
• PoC Findings
• Production Architecture
© Tieto Corporation
About TietoTieto is the #1 cloud service provider in Northern Europe with over 150 cloud customers in the region.
Tieto aims to become customers’ first choice for digitalization as the leading Nordic IT service provider.
Turnover is approximately €1.5 billion
Tieto’s shares are listed on NASDAQ in Helsinki and Stockholm
NorwayFinland
Sweden
Czech
Republic
India
RussiaEstonia
3
OpenStack in Tieto (where we started)✓ In 2015 Tieto provides scale-up focused IaaS cloud
offerings and unique application-focused PaaS services.
✓ Shared platform with full API-controlled infrastructure for horizontally scalable workload was missing.
✓ Since 2013, first internal projects evaluating OpenStack Havana, Icehouse in software development projects, utilizing Neutron / Open vSwitch.
✓ In 2016 announcing OpenStack cloud service for Tieto customers, based on tcp cloud (Mirantis) distribution and OpenContrail.
© Tieto Corporation
Tieto Goals
✓ Remove Vendor Lock-in
✓ Seamless On-Demand Capacity Fulfillment
✓ Robust Automation and Orchestration
✓ Adopt Innovative Open Source Solutions
✓ Infrastructure as a Code
© Tieto Corporation
We started with installer-centric distributions
● Initial evaluation deployments with PackStack/RDO, Fuel 5
with releases around Havana/Icehouse
● Was easy to learn, deploy first environments, gain some
experience
● … happy admins seeing first successful ping through
overlay
© Tieto Corporation
But then we realized it’s bring up and leave
● Systems were not easy to maintain later● Configuration in a flat file
○ compute node config looks like this ..., control node this …
○ deviations problematic to manage● Not safe to rerun without existing "compare
configuration" check● Manual changes need always to be documented as an
extra effort to ensure they’re reproducible
© Tieto Corporation
… leads to mixed configuration approach
● troubles to customize or extend○ partly due to difference in complexity Puppet vs
SaltStack/Ansible, yet improved with Reclass● results in mixed configuration approach
○ combination of configuration tool, scripts and manual changes
○ manual change has no record for later auditing or troubleshooting support
© Tieto Corporation
✓ Open Source – contribute own stuff
✓ Automation – fully automated approach without any manual tasks.
✓ Life cycle – not just deployment tool.
✓ Integration – natively integrated monitoring, log collections or self-generated documentation.
✓ OpenContrail knowledge – skilled team with huge operation experience for OpenContrail and OpenStack
✓ Not just OpenStack - partner who can implement any kind of open source (containers, CI/CD pipelines)
Key Criterias - Why tcp cloud?
© Tieto Corporation
Tieto Implementation Phases
• Design Orchestration• An internal application decomposition• Deployment automation• Staging environment
• Lab Setup• Based on OpenVswitch• RDO
• 2 datacenters• Model driven deployment automation
POC with OpenCont
rail (Q4 2015)
Production (Q2 2016)
Future
Lab testing
(Q1 2015)
• Another 4 datacenters• Up to 200 compute nodes• Docker integration (Kubernetes)
Neutron SDN solution✓ All clouds are about networking
✓ Key and the most crucial component of OpenStack
✓ High Availability, Scalability, Migration, Multi-tenancy, Performance, Security
✓ LBaaS, FWaaS, Service Chaining
✓ Possible solutions:
✓ Vanilla Neutron
✓ Midokura
✓ OpenContrail
© Tieto Corporation
Open source solution with possibility to buy commercial support
Licensing
High availability
Cloud gateway routing
Performance
Key Criterias - Why OpenContrail?
Interconnection between SDN and Fabric
Containers
Nord-South must be routed on physical Edge Routers Juniper MX
Native HA support is the most important criterion
Pps, bandwidth, scalability, etc. (9.6 Gbps)
Dynamically connection legacy world through EVPN or ToR Switches
Use same platform for containers
Tieto Facts✓ tcp cloud Mk.20 (Mirantis)
distribution✓ OpenContrail 2.21✓ Glance image repository
stored at Ceph✓ Cinder backend on Ceph✓ Heat orchestration
© Tieto Corporation
Cloud Modules Drivers/Backends
Nova Cinder Neutron CM
Monitoring & Billing by
© Tieto Corporation
Openstack Cluster Deployment - sample
© Tieto Corporation16
Experience so far
● complains we had on installer-type distros resolved● we got a robust, scalable infrastructure with
configuration under control● new challenges appear, mainly related to personal skills
and way of working○ sysadmins had to learn developers tools
© Tieto Corporation 17
Still not enough flexible?● over 30 management VMs● need to maintain, patch operating systems● more-or-less manual management of VMs, virtual
drives, too many haproxies, keepalived’s● long time to recover - reprovision manage VMs
OpenStack is just another application workload
© Tieto Corporation
Mirantis Cloud Platform Operations-Centric Fabric for BM, VM and Containers
Host Host Host Host Host Host Host Host
Kubernetes
Host Host Host
K8s master K8s minionsBMaaS pool
Ironic
OpenStack Control Plane
OpenStack Computes
K8s workloads
Mon
itorin
g an
d Lo
ggin
g
Bare Metal VMs Containers
Life
cycl
e M
anag
emen
t
18
© Tieto Corporation
OpenStack on Kubernetes
19
© Tieto Corporation
HA Transformation
© Tieto Corporation21
PODs mapping to Nova service
© Tieto Corporation22
Lifecycle Workflow example
© Tieto Corporation
Same Metadata Model
23
● No difference between Mk.20 and MCP
● Provide Hybrid - containers or VM
● Reclass YAML as primary method of defining sites
● Metadata model allows:• Hierarchical definition of
sites• Single location for all
operations● All changes as code commits
• Audit trail
© Tieto Corporation
Tieto Dashboard
Backup slides
© Tieto Corporation28
Service Chaining Use Cases
NFV through Contrail
2 firewalls between application stacks
© Tieto Corporation
MCP Galera HA
29