View
119
Download
2
Embed Size (px)
DESCRIPTION
“There has been substantial investment recently in the innovation of application life cycle management tools from both open and closed source organisations. This helps enforce business and domain specific rules and ensures that in the application lifecycle for each stage is enforced and clear deliveries are enforced from business requirement to deployment a bond is made by architectural, design and implementation compliance safeguards. Many such allow software design standards and business rules to be codified in a purpose made meta-languages.” Testing-Alliance.com (2014)
Citation preview
Jonathon Wright ([email protected])http://www.linkedin.com/in/automa
tion
Unicom ALM Conference (Thursday @ 11:30 AM, 27th February 2014)
Solution Lifecycle Management (SLM) in the Cloud
@jonathon_wright#UNICOMSeminars
@jonathon_wright#UNICOMSeminars
The current economic climate is making companies review their approach to IT even more closely
Information Technology
IT 1956
1969
1973
1974
1982
1983
1990
1998
2004
2005
2007
2008
2015
“There has been substantial investment recently in the innovation of application life cycle management tools from both open and closed source organisations. This helps enforce business and domain specific rules and ensures that in the application lifecycle for each
stage is enforced and clear deliveries are enforced from business requirement to deployment a bond is made by architectural, design and implementation compliance safeguards. Many such allow software design standards and business rules to be codified in a purpose made
meta-languages.” Testing-Alliance.com (2014)
www.unicom.co.uk@jonathon_wright#UNICOMSeminars
Background – About me
www.slideshare.net/Jonathon_Wright
LinkedIn + Email ([email protected])
www.linkedin.com/in/automation
platform, technology, client, browser, version, language, test type agnostic
Executing Cloud Tests
VM Dispenser TechnologyCloud Test Environments
written natural language(ATDD, BDD, TDD, Waterfall)
Creating Cloud Tests
Background – What I do - Agile-Portfolio.com
service-oriented architectureBuilt in the Cloud
@jonathon_wright#UNICOMSeminars
SAAS
“Over the past three years we have been developing a Azure cloud based solution to provide"Test Automaton as a Service" using a hybrid automation approach specifically designed with
the Hybrid Cloud (Private/Public) in mind to utilise the instant scalability, flexibility and availability of the Cloud.”
@jonathon_wright#UNICOMSeminars
TestDirector 1.511995
19
95
1998 TestDirector 5
2000
2004 Quality Centre 8 Quality Centre 112010
- HP Application Lifecycle Management
- HP Agile Manager- HP Executive Dashboard
2014 - TODAY
Evolution of ‘Application Lifecycle Management’ over three decades
20
04
20
10
20
14
Background – Three Decades in ALM vs. SLM – 1990s
@jonathon_wright#UNICOMSeminars
Distributed Teams – Application Lifecycle Management - Test Director
SolutionInternal intranet testing
engineering site.
Test Management Tool (no requirements management).
Problem SpaceTesting of VOIP & SIP across
Europe & the US.
Graduate Tester
1st Gen(Standalone)AUTSUT
Locations:5Teams:10 Client
Server
Tool(s): 1
Licenses 10+
Budget in thousands, company in
millions
Automation ArchitectCore Hours 1am to 10am (EST)
Graduate TestersCore Hours 9am to 5pm (EST)
Automation TestersCore Hours 9am to 5pm (GMT)
Background – Three Decades in ALM vs. SLM – 2000s
@jonathon_wright#UNICOMSeminars
Distributed Teams – Application Lifecycle Management - Test Director
SolutionIntroduction of Business
Process Modelling.
Real-time ‘Actionable Insight’ over WSDL/SOAP.
Problem SpaceTesting of Fixed Income
platforms across the globe.
Test Architect
3rd Gen(Distributed)SUT
Locations:20
+
Teams:100+Tool(s): 15+
Budget in millions, company in
billions
Web
AUT
Test Consultants (UK)Core Hours 9am to 5pm (GMT)
Test Consultants (NY)Core Hours 9am to 5pm (EST)
Test Consultants 9am to 5pm (UTC+8)
Development Capability (US)Core Hours 9am to 5pm
Development Capability (EUR)Core Hours 9am to 5pm
Licenses 100+
Background – Three Decades in ALM vs. SLM – 2010s
@jonathon_wright#UNICOMSeminars
Solution Lifecycle Management in the Cloud – Commodity Trading Platform
SolutionContinuous Build & Delivery
(PTaaS/TaaaS/IaaS/PaaS/TaaS)Real-time SLM in the Cloud.
Input - ATDD/WebServices/XAMLOutput – CI/WebServices/XML
Reporting – Realtime Dashboards
Problem SpaceTesting of Commodity
Trading Platforms across the globe.
Global Head of
Automation
4th Gen(Cloud)
Locations:25
+
Teams:50+Tool(s): 20+
Budget in millions, company in
billions
AUTSUT
Cloud
Test Consultants (NY)Core Hours 9am to 5pm (EST)
Test Consultants (UK)Core Hours 9am to 5pm (GMT)
Test Consultants 9am to 5pm (UTC+8)
Development Capability (EUR)Core Hours 9am to 5pm
Licenses PAYU
Background – Three Decades in ALM vs. SLM – Today
@jonathon_wright#UNICOMSeminars
Enterprise Distributed Agile Portfolio Management in the Cloud - Global Investment Bank
SolutionPure Agile Portfolio
Management across over 300 business workstreams.
Scalable Testing as a Service resourcing pool 10,000+.(Across 2,600+ Applications)
Problem SpaceTesting of GT (Global
Technology) Platforms for across the globe.
Agile Portfolio
Management
5th Gen(APM)
Locations:10
0s
Teams:1k+Tool(s): 50+
Budget 78 million, company investment 4
billion
Cloud
SUT AUT
Test Consultants (NY)Core Hours 9am to 5pm (EST)
Test Consultants 9am to 5pm (UTC+8)
wAg
ile T
eam
s (A
sia)
Core
Hou
rs 9
am to
5pm
(UTC
+8)
wAgile Teams (US)Core Hours 9am to 5pm (EST)
wAgile Teams (EUR)Core Hours 9am to 5pm (CET)
Test Consultants (UK)Core Hours 9am to 5pm (GMT)
TESTINGAS A SERVICE
(TaaS)INFRASTRUCTURE
AS A SERVICE(IaaS)
SOFTWARE AS A SERVICE(SaaS)
REAL-TIME VISIBILITY AND CONTROL
INSTANT SCALABILITYSCALE UP AND DOWN
HIGH AVAILABILITY
CMMI
PLATFORM AS A SERVICE(PaaS)
ISO 29119
PAY AS YOU USE(PAYU)
SLA’s
Background – My Journey to the Cloud
@jonathon_wright#UNICOMSeminars
“We’ve all heard the claims that cloud computing will, without any up-front investment, provide instant scalability, flexibility, and availability for testing-on-demand. But how well
does this work in practice?”
SLM Ready?
Cloud Power
Solution Lifecycle
Management in the Cloud
Where are we going next?
@jonathon_wright#UNICOMSeminars
www.unicom.co.uk
Q1) What is ‘Solution Lifecycle Management’ in the Cloud?
@jonathon_wright#UNICOMSeminars
“Existing technologies of virtualisation, business process modelling, cloud based ‘application lifecycle management’ solutions and rapid and easy internet access allow for the
development of approaches that allow companies to leverage ‘Software as a Service’ and pay only for what they use (PAYU).”
Q2) – Which ‘Application Lifecycle Management’ Tools?
@jonathon_wright#UNICOMSeminars
“My current landscape consisted of over 300+ solutions under test (SUT), representing 2,700+ applications under test (AUT), across 50+ global locations with over 10,000
practitioners worldwide.”
• Delivering business value, not just driving process efficiency
• Supporting individual, team, and institutional management
• Extending life cycles to include delivery• Managing software that gets deployed everywhere
• Integrating across tools
@jonathon_wright#UNICOMSeminars
Q3) Business Benefits of ‘Solution Lifecycle Management’*?
*Source - The Forrester Wave™: Application Life-Cycle Management, Q4 2012
• Using reporting and dashboards to provide ‘Business Insight’
“Improve Reporting of Business-Oriented Metrics to Demonstrate the Value of QA – more organisations are beginning to centralise QA practices and develop TCOEs most still need to prove the business value of QA by reporting operational metrics linked to specific business
outcomes” - World Quality Report (2013-14)
CMM Phase Criteria
Level 1 Initial
processes are disorganized, even chaotic. Success is likely to depend on individual efforts, and is not considered to be repeatable, because processes would not be sufficiently defined and documented to allow them to be replicated
Level 2 Repeatablebasic project management techniques are established, and successes could be repeated, because the requisite processes would have been made established, defined, and documented
Level 3 Defined an organization has developed its own standard software process through greater attention to documentation, standardization, and integration
Level 4 Managed an organization monitors and controls its own processes through data collection and analysis
Level 5 Optimisedprocesses are constantly being improved through monitoring feedback from current processes and introducing innovative processes to better serve the organization's particular needs
www.unicom.co.uk
Capability Maturity Model (CMM®)Assessment to provide a current software ‘process’ maturity level & the target maturity level:
* Reference models: CMMI (Capability Maturity Model Integration) IPD-CMM (Integrated Product Development Capability Maturity Model) P-CMM (People Capability Maturity Model) SA-CMM (Software Acquisition Capability Maturity Model) SE-CMM (Systems Engineering Capability Maturity Model) SW-CMM (Capability Maturity Model for Software)
Q4) Is our business ready for ‘Solution Lifecycle Management’?
@jonathon_wright#BCS_SIGIST
www.unicom.co.uk
Q5) Are we ready for ‘Solution Lifecycle Management’?
@jonathon_wright#BCS_SIGIST
Dashboards
Funnel Virtualisation“Encourage simplicity”
Documentation
Living Meta Data“Master the Data”
Team Working
Remote collaboration“Collaborate inventively”
Activity Streams
Real-time info“Embrace cloud workforces”
Q6) How to become an ‘Ambassador of Data’ / ‘Business Insight’?
vs.
Funnel Virtualisation
BusinessInsight
Data
Data
Data
Data
Data
Data
Data
Data
Data
Data
Data
Data
DataData
Data
Data
DataData
@jonathon_wright#UNICOMSeminars www.unicom.co.uk
“Data security and safeguarding access to cloud infrastructure remain a priority for CIOs – especially given the number of highly publicized recent security breaches. The hybrid cloud option is becoming more popular, as it allows companies to split between public and private
cloud infrastructures.” - World Quality Report (2013-14)
“Everyday business and consumer life creates 2.5 quintillion bytes of data per day and 90% of the data in the world today has been created in the last two years?” – Data Explosion
Development
SD-PM SD-TEST SD-AUTOMATIONVendors
Tier 3 - Sub-Domains – Application Level (x2,738)
Tier 2 - Domains – Solution Level (x330)
Domain Leads
Domain StakeholdersDomain PMDomain Test Managers
Tier 0 – Programme Level (x4)
Heads of Testing
Head of Automation Global Technology Office
Tier 1 - Workstream – Portfolio Level (x8)
Portfolio Test Managers
Workstream Stakeholders
Workstream LeadsAPM
ProductsOrganisation
al Agile
Portfolio Reporting
Hybrid Cloud
Distributed AgileProject ArtefactsALM
ProductsLocal
Network
APM Products Global-widePublic Cloud
Executive (Business Insight)
SLM Products
EnterpriseAgile
Private Cloud
EnterpriseReporting
Q7) Real-world ‘Agile Portfolio Management’?
SLM Ready
Cloud Power
Solution Lifecycle
Managementin the Cloud
“To the cloud”
@jonathon_wright#UNICOMSeminars
www.unicom.co.uk
Q8) Should we move to the cloud?
New Challenges & Opportunities ?
A match made in heaven?
@jonathon_wright#UNICOMSeminars
and/or
“Make greater use of the cloud for testing – Organisations are taking a cautious approach to ‘Testing in the Cloud’ we advice developing a specific strategy for migrating testing to the
Cloud, factoring in explicit requirements, tools and opportunities that the cloud offers” - World Quality Report (2013-14)
Consumer Freedom
www.unicom.co.uk@jonathon_wright#UNICOMSeminars
“Enable sophisticated modelling of the components of cloud deployments, including servers, storage, databases and data.
For the consumption of cloud resources” - PlanForCloud.com (2012)
CompareTesting.com
Instant scalability
Flexible Test ExecutionFlexible Test Assets Environments on-demand
Geo-based execution
Instant Accessibility
99.9% Availability (100% Web)
Instant Portability
Best of Breed (BoB) tools on demand
No upfront investment
Pay As You Use (PAYU)
New Opportunities
www.unicom.co.uk@jonathon_wright#UNICOMSeminars
PrivateCombination
Public
SUT SUTSUT
CommunityClouds
PublicClouds
PrivateClouds
TaaaS.net TaaaS.net
“... the prediction that 60% of the average enterprise will have 60% of its applications in the cloud.”
- Karl Flinders, Computer Weekly (2011)
Q9) Cloud Type
SLM Ready
You are here@jonathon_wright#UNICOMSeminars
Q10) Built ‘Solution Lifecycle Management’ platform, you have?
Transform Integrate Learn Use the insightCourtesy of Intel© Corporation
2014
The Future - Agile Portfolio Management
@jonathon_wright#UNICOMSeminars Twitter with how many slides in this presentation? 25
“The best aspects of these proven approaches demonstrate how they have evolved over the
past decade, and this echoes some of the changes towards more lean and agile business methodologies. They are in a constant state of
evolution – just as the underpinning technology evolves over time.”
My section in the ‘Experiences in Test Automation’ book(Dorothy Graham & Mark Fewster) 2012.
Final Thoughts – Solution Lifecycle Management in the Cloud
• World Quality Report
• Previous Conference Exposure STARWest – California Fusion – Sydney BCS – London EuroSTAR – Sweden ANZTB – New Zealand Unicom - London
• Upcoming Unicom Conferences in 2014 Enterprise Collaboration through BPM – March 2014
(http://www.capgemini.com/thought-leadership/world-quality-report-2013-14)