The Valueof Quality

Topics

The Real Valueof Software Development

Complex Software is Everywhere!

Product Lines of Code

Typical Order Entry System 1,2 Million

F-22 Raptor 1,2 Million

Space Shuttle 2 Million

Microsoft Word 2 Million

F-35 Joint Strike Fighter 5,7 Million

Typical Airline Reservation System 6 Million

Mercedes Benz S Class 29 Million

The ability to use, develop, integrate and deliver custom software is strategic for most organizations

However, unlike other strategic business processes, there are often large gaps – which creates risk:No consistent processes are being applied to the development and management of custom software.

Reporting on developer productivity, software quality and business value is missing.

Development processes and activities are not predictable and repeatable.

Complexity of software (and value opportunities) grow without associated maturity and team capabilities

Business Runs On Software

How well a firm executes itsbusiness strategies is tied to how

good it is at creating and managing

custom applications!David Chappell

BUT

Software development is difficult, takes a long time, costs a lot of money and

often fails!The Voice of Experience

At First, It‘s Easy

Over Time, Things Get Complicated ...

So, Management Is Added …

… And Process …

… Which Leads To Specialization …

… And Adding Of Indirect Labor …

But Wait – There’s More!

Business demand outpaces the abilityof developers to deliver applications

60

40

20

0

-20

-40

Market Conditions

Business Requirements

Application Delivery

60

40

20

0

-20

-40

60

40

20

0

-20

-40

Remote Access

Value Delivery Impediments

No Progress Monitoring

Unmanageable Complexity

Lack of KPIs and Insight

Loss of Focus

Non-Repeatable Work

Business Requirements Grow Exponentially

Inconsistent (or no) Processes

Poor Communication Across Functional Silos

Unpredictable Results

Hidden Risks

Wasted Time and Effort

Scope Creep

ALM is the marriage of

Business Management and

Software Engineering!

Monitor

OperateWorking software in productionValue realized

The Value Delivery Cycle

“Conventional” QA

QA

Testing postimplementation. Mostly

manual with limitedautomation.

UAT

UAT post implementation

and systemstesting

Operationsreadiness

verification

Pre-deploymentverification

Document requirements as BRDs and

functional specs

Write code to implement

requirements

Business Value of Quality Enablement

From “Testing“ to “Quality Enablement“

Measuring Quality

Common Quality Issues and Blockers

Blocker: Misunderstood Requirements

Requirements don’t reflect customer intentRework, long delivery cycles and frustration.

Storyboarding ToolGraphical mockups and visual prototypes in new PowerPoint add-on reducemisunderstandings and clarify intent.

Feedback ManagerStand-alone feedback tool allows stakeholders to provide comprehensive feedbackon any artifact, including storyboards, directly to development teams.

Problem

Solution

Solution

Misunderstood Requirements

Session 06Operations and Feedback

Blocker: Quality is an Afterthought

Quality not built in from the startFailure to meet user needs, rework, long delivery cycles and customer dissatisfaction.

Unit TestingExtensible unit test framework targets specific needs or technologies to ensure code correctness.

Fakes and stubs frameworkPowerful mocking framework to simplify unit testing and isolate logic.

Problem

Solution

Solution

Session 03Test Specification and Execution

Blocker: Unmet User Expectations

Delivered functionality fails to satisfy usersFailure to meet user needs, rework, long delivery cycles and customer dissatisfaction.

Problem

Solution

Exploratory TestingAd-hoc exploratory tests help uncover usability and consistency issues, and resultin actionable bugs and reusable test cases.

Session 03Test Specification and Execution

Blocker: Unmet Operations Readiness

Delivered code fails to perform as plannedFailure to meet IT maintenance needs, rework, long delivery cycles and customer dissatisfaction.

Web TestingLightweight web tests validate correct functionality and behavior, both in testing and production.

Load TestingPowerful load test frameworks simulates thousands of simultaneous usersto ensure performance, stability and uptime.

Problem

Solution

Solution

Blocker: Can’t Get Actionable Feedback

Delayed feedback on code changesFixing critical bugs takes a long time, increases in context switching,rework and long delivery cycles.

Continuous IntegrationBuild, deploy and test complex applications on every check-in toquickly identify problematic code changes.

Lab ManagementSelf-service test lab provisioning speeds manual and automated build-deploy-test feedback cycles.

Problem

Solution

Solution

Sessions 03 and 06Operations and FeedbackTest Specification and Execution

Limited Visibility into Quality States

Lack of visibility into overall qualitySlows fixes of bugs, increases context switching, rework and long delivery cycles.

ReportingOut-of-the-box and ad-hoc reports track quality against requirements,builds, releases and other artifacts.

Problem

Solution

Session 04Test Controlling and Tracking

Blocker: Operational Requirements Not Met

Production errors not caught quickly enoughLonger bug fix cycle times, customer dissatisfaction, and costly remediation.

Monitor in-production applicationsManagement pack templates make real time monitoring of production applications easy.

Problem

Solution

Session 05Test Infrastructure

Disparate Management Tools

Isolated tools and workflowsPoor communication, longer production bug fix cycle times, and customer dissatisfaction.

Integrated Incident management toolsCommon view of incidents to both Operations and Development.

Shared artifactsReuse development artifacts, such as tests, inside System Center to reducerework and discover production issues early.

Problem

Solution

Solution

Production Incidents Hard to Debug and Resolve

Production errorsDifficult to identify root cause, debug code and resolve defects.

Actionable diagnosticsIntelliTrace in production to speed debugging and code fix.

Translatable artifactsSystem Center logs can be converted to IntelliTrace logs for developer use.

Problem

Solution

Solution

Slow Feedback Creates Waste

Slow feedbackTime lags between work and feedback result in wasted time, increased context switching, and rework.

Lab ManagementSelf service test lab provisioning speed build-deploy-test feedback cycle.

Problem

Solution

Session 06Operations and Feedback

Software Testing with Visual Studio

Save time and reduce risksIntegrated test tools

Advanced test toolsintegrated

solution

Continuously deliver value

storyboard and user feedback tools

Visual Studio 2012 Quality Enablement

Analysts praise Visual Studio 2012