72
® Copyright © 2004 Intel Corporation. No part of this presentation may be copied without the written permission of Intel Corporation. Lessons Learned in Large Scale Process Improvement Erik Simmons, Intel Corporation New Culture Current Culture Disconfirmation Event Defining the Future State Decision to Change Gap Analysis “Unfreezing” the culture Making Changes “Refreezing” the culture Agenda Setting Matching Redefining Clarifying “Routinizing”

Lessons Learned in Large Scale Process Improvement

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Lessons Learned in Large Scale Process Improvement

®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Lessons Learned in Large Scale

Process ImprovementErik Simmons, Intel Corporation

New Culture

Current Culture

Disconfirmation Event

Defining the Future State

Decision to Change

Gap Analysis

“Unfreezing”the culture

Making Changes

“Refreezing”the culture

Agenda S

ettin

g

Matc

hin

g

Redefinin

g

Cla

rify

ing

“Routin

izin

g”

Page 2: Lessons Learned in Large Scale Process Improvement

2®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Contents

Background for context

The Lessons:

1. Take time to learn about your culture

2. Understand how organizational change takes place

3. Start by establishing a life cycle for development

4. Use Evolutionary Delivery to drive change

5. Diffusion of Innovations provides important vocabulary and structure for change agency

6. Explicitly define and document success using measurable, quantifiable language

7. Employ an effective business model within the group that drives change

Background for context

The Lessons:

1. Take time to learn about your culture

2. Understand how organizational change takes place

3. Start by establishing a life cycle for development

4. Use Evolutionary Delivery to drive change

5. Diffusion of Innovations provides important vocabulary and structure for change agency

6. Explicitly define and document success using measurable, quantifiable language

7. Employ an effective business model within the group that drives change

Page 3: Lessons Learned in Large Scale Process Improvement

3®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

About Intel

• Year founded: 1968

• Number of employees: 85,000 (48,000 US)

• Revenues (2004): $34.2 billion

• Over 450 products and services

• Over 290 offices and facilities in 45 countries

• Year founded: 1968

• Number of employees: 85,000 (48,000 US)

• Revenues (2004): $34.2 billion

• Over 450 products and services

• Over 290 offices and facilities in 45 countries

Page 4: Lessons Learned in Large Scale Process Improvement

4®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Intel Employee Facts

• 16% work at more than one campus

• 64% work with three or more teams

• 67% work in virtual teams

• 69% work with people in different time zones

• 70% collaborate with team members they don’t meet face-to-face

• 16% work at more than one campus

• 64% work with three or more teams

• 67% work in virtual teams

• 69% work with people in different time zones

• 70% collaborate with team members they don’t meet face-to-face

Page 5: Lessons Learned in Large Scale Process Improvement

5®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Intel Values

• Customer Orientation

• Discipline

• Quality

• Risk Taking

• Great Place to Work

• Results Orientation

• Customer Orientation

• Discipline

• Quality

• Risk Taking

• Great Place to Work

• Results Orientation

Page 6: Lessons Learned in Large Scale Process Improvement

6®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Cultural Highlights

• Egalitarian: No offices (except in acquired firms), little affordance for seniority, work judged on merit

• Open and Direct: Constructive confrontation, open door policy, rigorous annual review process

• Entrepreneurial: Own your own employability, assume responsibility, take informed risks

• Teaming, yet Competitive: Many dispersed teams, virtual teams, but annual review is at the individual level

• Dedicated and Aggressive: Continual pressure to improve, sense of urgency, market focus, aggressive goals, dedication to meet commitments

• Dynamic: Frequent reorganizations, employee movement; shifts to attack new opportunities

• Egalitarian: No offices (except in acquired firms), little affordance for seniority, work judged on merit

• Open and Direct: Constructive confrontation, open door policy, rigorous annual review process

• Entrepreneurial: Own your own employability, assume responsibility, take informed risks

• Teaming, yet Competitive: Many dispersed teams, virtual teams, but annual review is at the individual level

• Dedicated and Aggressive: Continual pressure to improve, sense of urgency, market focus, aggressive goals, dedication to meet commitments

• Dynamic: Frequent reorganizations, employee movement; shifts to attack new opportunities

Page 7: Lessons Learned in Large Scale Process Improvement

7®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

What is Organizational Change?

Organizational Change IS NOT:

• Simple

• A transitory event or “program”

• A goal unto itself

Organizational Change IS NOT:

• Simple

• A transitory event or “program”

• A goal unto itself

Organizational Change is:

• A disruptive force

• A creative force

• Uncomfortable for many people

Organizational Change is:

• A disruptive force

• A creative force

• Uncomfortable for many people

• Effective, organic adoption of practices

• Essential for sustained success

Organizational Change IS:

• A disruptive force

• A creative force

• Uncomfortable for many people

Organizational Change IS:

• A disruptive force

• A creative force

• Uncomfortable for many people

• Effective, organic adoption of practices

• Essential for sustained success

Source: The Change-Able™ Organization

Page 8: Lessons Learned in Large Scale Process Improvement

8®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

The Role of a Change Agent

A change agent serves as a catalyst for change and a lightning rod for innovation by:

• Illustrating gaps and areas for improvement

• Shaping the environment to improve change effectiveness and receptivity

• Providing subject matter expertise

• Guiding the group through the details and challenges of the change process

• Confronting facts and speaking the truth

A change agent serves as a catalyst for change and a lightning rod for innovation by:

• Illustrating gaps and areas for improvement

• Shaping the environment to improve change effectiveness and receptivity

• Providing subject matter expertise

• Guiding the group through the details and challenges of the change process

• Confronting facts and speaking the truth

Change Agents wear many hats

Page 9: Lessons Learned in Large Scale Process Improvement

9®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

The Duality of Change Agency

Change agents that are too different from the people they seek to change can be ineffective because they are “outsiders”

BUT…

Change agents that are too much like the people they serve provide fewer innovations than those with very different backgrounds!

Change agents that are too different from the people they seek to change can be ineffective because they are “outsiders”

BUT…

Change agents that are too much like the people they serve provide fewer innovations than those with very different backgrounds!

Q: Should we use internal change agents or external change agents?

A: Both…

Page 10: Lessons Learned in Large Scale Process Improvement

10®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

The Benefits of Size

• Large companies have more organizational slack; they can devote greater resources to continuous improvement

• They have more simultaneous projects, so it can be easier to pilot new methods and practices in low-risk situations

• With so many sets of eyes and ears, many sources of new practices can be monitored at once and shared through communities of practice

• Larger companies are often more mature than smaller companies, and have lost the “start-up” atmosphere that can eschew rigorous practices

• Large companies have more organizational slack; they can devote greater resources to continuous improvement

• They have more simultaneous projects, so it can be easier to pilot new methods and practices in low-risk situations

• With so many sets of eyes and ears, many sources of new practices can be monitored at once and shared through communities of practice

• Larger companies are often more mature than smaller companies, and have lost the “start-up” atmosphere that can eschew rigorous practices

Page 11: Lessons Learned in Large Scale Process Improvement

11®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

The Drawbacks of Size

Organizational complexity! Decision authority, resource allocation, and program management are all tougher

A large potential audience for training, consulting, and related project work stretches available resources

Changing practices on a team can have unintended side effects on large, multi-team projects

Geographic dispersion means that face-to-face time could be impossible or impractical

Organizational complexity! Decision authority, resource allocation, and program management are all tougher

A large potential audience for training, consulting, and related project work stretches available resources

Changing practices on a team can have unintended side effects on large, multi-team projects

Geographic dispersion means that face-to-face time could be impossible or impractical

Page 12: Lessons Learned in Large Scale Process Improvement

®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Lesson 1:

Take time to learn about your culture

Page 13: Lessons Learned in Large Scale Process Improvement

13®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

The Three Levels of Culture

Observed Artifacts

Espoused Values

Tacit Assumptions

The objects, concepts, and processes meaningful to a culture

Spoken or written strategies, goals, values, and philosophy

Unspoken, shared beliefs on which the culture is built

Culture is complex, and a superficial understanding is just as dangerous as no understanding at all

Page 14: Lessons Learned in Large Scale Process Improvement

14®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Elements of a Culture - Part 1

1. Mission, vision, strategy, etc. - Who are we?

2. Org structure, processes, etc. - How do we work?

3. Metrics and measurement - What defines success?

4. Language and concepts - How do we communicate?

5. Group membership - What is my community?

6. Leadership and authority - Who is in charge here?

7. Rewards and status - What is promoted and incented?

1. Mission, vision, strategy, etc. - Who are we?

2. Org structure, processes, etc. - How do we work?

3. Metrics and measurement - What defines success?

4. Language and concepts - How do we communicate?

5. Group membership - What is my community?

6. Leadership and authority - Who is in charge here?

7. Rewards and status - What is promoted and incented?

Common Issues

Page 15: Lessons Learned in Large Scale Process Improvement

15®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Elements of a Culture - Part 2

1. What is our relationship to the outside world?

2. What is real, and what is true?

3. What do we believe about human nature?

4. What kinds of human relationships do we foster?

5. How do we think about time and space?

1. What is our relationship to the outside world?

2. What is real, and what is true?

3. What do we believe about human nature?

4. What kinds of human relationships do we foster?

5. How do we think about time and space?

Deeper Assumptions

Page 16: Lessons Learned in Large Scale Process Improvement

16®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Learning About A Culture

•The best way to understand culture is through group activities, since culture is a group phenomenon

•Even in structured group discussions, the shared tacit assumptions of a culture are difficult to expose

•These basic assumptions influence all other elements of the culture and the organization

•The best way to understand culture is through group activities, since culture is a group phenomenon

•Even in structured group discussions, the shared tacit assumptions of a culture are difficult to expose

•These basic assumptions influence all other elements of the culture and the organization

Use a multi-faceted approach…

Page 17: Lessons Learned in Large Scale Process Improvement

®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Lesson 2:

Understand how organizational change takes place

Page 18: Lessons Learned in Large Scale Process Improvement

18®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

The Organizational Change Process

• Change occurs in a somewhat predictable order (though the decision to change can occur earlier than shown)

• Organizational change frequently occurs via iterative steps, even when a clear end vision exists

• Change occurs in a somewhat predictable order (though the decision to change can occur earlier than shown)

• Organizational change frequently occurs via iterative steps, even when a clear end vision exists

New Culture

Current Culture

Disconfirmation Event

Defining the Future State

Decision to Change

Gap Analysis

“Unfreezing”the culture

Making Changes

“Refreezing”the culture

Page 19: Lessons Learned in Large Scale Process Improvement

19®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

The Role of Disconfirmation

In established cultures, change requires some powerful stimulus that disconfirms the current way of doing things

Disconfirmation can come in many forms:

•Our competition’s performance

•Degraded reputation with customers or end users, loss of market share, reduced revenue or profit

•Legal challenges, trade sanctions, monetary penalties

•Internal performance objectives, annual goals

•Mergers and acquisitions, outside hiring of upper management, etc.

•Education, training, and benchmarking

•Etc…

In established cultures, change requires some powerful stimulus that disconfirms the current way of doing things

Disconfirmation can come in many forms:

•Our competition’s performance

•Degraded reputation with customers or end users, loss of market share, reduced revenue or profit

•Legal challenges, trade sanctions, monetary penalties

•Internal performance objectives, annual goals

•Mergers and acquisitions, outside hiring of upper management, etc.

•Education, training, and benchmarking

•Etc…

Page 20: Lessons Learned in Large Scale Process Improvement

20®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Some Recent Examples

“Tech Stocks Tumble as

Intel Disappoints…”

“... today lowered the mid-

point of projected Q3 earnings

by $450 Million...”

“CEO issues frank memo on performance”

INTC

“… a string of product delays and manufacturing glitches.”

Page 21: Lessons Learned in Large Scale Process Improvement

21®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

A Battle of Anxieties

Disconfirmation creates Survival Anxiety, the fear that we will not succeed by following our current course

Then, when people consider change, Learning Anxiety is a natural result because they fear:

•Temporary incompetence while learning new skills

•Temporary lack of productivity (and the potential consequences)

•Loss of identity or group membership

•Loss of influence

Disconfirmation creates Survival Anxiety, the fear that we will not succeed by following our current course

Then, when people consider change, Learning Anxiety is a natural result because they fear:

•Temporary incompetence while learning new skills

•Temporary lack of productivity (and the potential consequences)

•Loss of identity or group membership

•Loss of influence

Since disconfirmation can’t always be controlled, promote change by reducing learning anxiety instead

Page 22: Lessons Learned in Large Scale Process Improvement

22®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Reducing Learning Anxiety

Learning anxiety can be reduced in many ways:

• Obvious, continuous management sponsorship and support

• Clearly stated goals and expectations that allow for learning

• Consistency between what is promoted and what is rewarded

• Excellent training using a variety of formats

• “Sandboxes” where practice can occur without fear of severe consequences on real projects

• Use of coaches and mentors

• Peer groups for support and sharing

Learning anxiety can be reduced in many ways:

• Obvious, continuous management sponsorship and support

• Clearly stated goals and expectations that allow for learning

• Consistency between what is promoted and what is rewarded

• Excellent training using a variety of formats

• “Sandboxes” where practice can occur without fear of severe consequences on real projects

• Use of coaches and mentors

• Peer groups for support and sharing

Page 23: Lessons Learned in Large Scale Process Improvement

23®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

New vs. Established Competencies

New Competency

Established Competency

•Success is rewarded

•Failure is rewarded

• Inaction is punished

•Success is rewarded

•Failure is rewarded

• Inaction is punished

•Success is rewarded

•Failure is punished

• Inaction is punished

•Success is rewarded

•Failure is punished

• Inaction is punished

In a low learning anxiety environment, nothing but inaction can be punished - it must be OK to fail, but unacceptable not to try

Page 24: Lessons Learned in Large Scale Process Improvement

®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Lesson 3

Start by establishing a life cycle for development

Page 25: Lessons Learned in Large Scale Process Improvement

25®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Life Cycle vs. Process

A life cycle for development provides a set of common milestones and work states

These elements enable communication across teams and projects to occur more easily, with greater comprehension

Without a documented life cycle, it is difficult to impossible to make improvements in a predictable, controlled fashion

A life cycle for development provides a set of common milestones and work states

These elements enable communication across teams and projects to occur more easily, with greater comprehension

Without a documented life cycle, it is difficult to impossible to make improvements in a predictable, controlled fashion

Note: A product development life cycle is not the same as a process – a PLC is a framework for development practices

A good PLC should not inadvertently specify a particular development methodology; beware of over-constraint, and allow tailoring for local circumstances

Note: A product development life cycle is not the same as a process – a PLC is a framework for development practices

A good PLC should not inadvertently specify a particular development methodology; beware of over-constraint, and allow tailoring for local circumstances

Page 26: Lessons Learned in Large Scale Process Improvement

26®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Example: The Intel Product Life Cycle

Roadmaps: Internal Product

Roadmap

ExternalProduct

Roadmap Program Termination Approval (PTA)

ConceptApproval

(CA)

DevelopmentInvestmentApproval

(DIA)

ImplementationPlan Approval

(IPA)

ApprovalMeetings:

ProductReadinessApproval

(PRA)

ShipReleaseApproval

(SRA)

PDT Postmortem

Product Documentsand Reviews:

Product Overview

Proposal (POP)

ProgramImplementation

Plan(PIP)

Statementof Work(SOW)

PilotAuthorization

(PA)

ProductDiscontinuance

Approval(PDA)

QualificationReport

BusinessInput:

MarketSegmentAnalysis

(MSA)

Platform Strategy

Document (PSD)

Product Requirements

Document (PRD)

DesignSpecs

Risk Assessment

(RA)

Product Qualification

Qualification Plan

Prototype Qualification

(PTQ)

Production Qualification

(PDQ)

ProductionMaterialApproval(PMA)

Full Qualification

(FLQ)

Planning DevelopmentExploration Production

TechnicalProduct

Specification(TPS)

Product Readiness

Review(PRR)

Reference Implementation

Page 27: Lessons Learned in Large Scale Process Improvement

27®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Example: IPLC Tailored for Iterative SW

Planning MaintenanceIterations and Releases

DevelopmentInvestmentApproval

(DIA)

Product Iteration Plan

Approval(IPA)

Project Milestones:

Product Documentation:

ProductOverviewProposal

(POP)

ProductIteration

Plan(PIP)

ProductDiscontinuance

Approval(PDA)

Exploration

Evolutionary Product Life Cycle

IterationRequirements

IterationRelease

Approval(IRA)

ProductReference

Manual

IterationTest Plan

IterationEstimate

IterationData Model

InstallChecklist

HighLevel

Design(HLD)

PostProjectReview(PPR)

Mid-IterationReview(MIR)

Page 28: Lessons Learned in Large Scale Process Improvement

®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Lesson 4

Use Evolutionary Delivery to drive change

Page 29: Lessons Learned in Large Scale Process Improvement

29®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Evolutionary Delivery

Evolutionary Delivery (Evo):

• Is a program and project management process that emphasizes learning and adaptation

• Works exceptionally well on fast-paced, large projects

• Uses a series of small steps to deliver results frequently

• Measures success by results delivered rather than adherence to checklists and processes

• Can be used to get better control on quality, performance, and cost than conventional project management methods

Evolutionary Delivery (Evo):

• Is a program and project management process that emphasizes learning and adaptation

• Works exceptionally well on fast-paced, large projects

• Uses a series of small steps to deliver results frequently

• Measures success by results delivered rather than adherence to checklists and processes

• Can be used to get better control on quality, performance, and cost than conventional project management methods

"Nothing is particularly hard if you divide it into small steps.“- Henry Ford

Page 30: Lessons Learned in Large Scale Process Improvement

30®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

10 Principles of Evo

Source: Evo course materials by Tom Gilb. © [email protected]. Used by permission.

1. Any project can be managed better using Evo control

2. Any project can be delivered as a series of smaller steps

3. No one can possibly know what all the project goals should be in advance

4. No one can know all the results of a design idea in advance

5. You must be prepared to ‘compromise intelligently’ with reality (change requirements and design during the project based on results)

1. Any project can be managed better using Evo control

2. Any project can be delivered as a series of smaller steps

3. No one can possibly know what all the project goals should be in advance

4. No one can know all the results of a design idea in advance

5. You must be prepared to ‘compromise intelligently’ with reality (change requirements and design during the project based on results)

“One change always leaves the way open for the establishment of others. “- Niccolo Machiavelli

Page 31: Lessons Learned in Large Scale Process Improvement

31®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

10 Principles of Evo

6. Early delivery means early payback

7. The customer is always right, even when they change their goals.

8. There is no ‘real end’ to a project if we have competition.

9. You cannot foresee every change, but you can foresee change itself

10. ‘Useful results’ are your only justification for existence

6. Early delivery means early payback

7. The customer is always right, even when they change their goals.

8. There is no ‘real end’ to a project if we have competition.

9. You cannot foresee every change, but you can foresee change itself

10. ‘Useful results’ are your only justification for existence

Source: Evo course materials by Tom Gilb. © [email protected]. Used by permission.

Page 32: Lessons Learned in Large Scale Process Improvement

32®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Evo and PDSA

Evo embodies the Plan, Do, Study, Act cycle as taught by Shewhart and Deming

Evo embodies the Plan, Do, Study, Act cycle as taught by Shewhart and Deming

Plan

DoStudy

Act1. Plan a change or

improvement

2. Carry out the plan

3. Study the results

4. Adopt the change, abandon it, or run through the cycle again

Page 33: Lessons Learned in Large Scale Process Improvement

33®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Stakeholders, Values, and Success

Evo relies on a rich assessment of stakeholder values, which are quantified for measurability

• These values become the definition of success for individual project steps and the entire project

Each project step’s results are compared against the definition of success to assess impact

• Stakeholders help prioritize and guide the project through the choice of the next Evo step

Evo relies on a rich assessment of stakeholder values, which are quantified for measurability

• These values become the definition of success for individual project steps and the entire project

Each project step’s results are compared against the definition of success to assess impact

• Stakeholders help prioritize and guide the project through the choice of the next Evo step

Knowing current stakeholder values is important in Evo - it won’t work without it!

Page 34: Lessons Learned in Large Scale Process Improvement

®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Lesson 5

Diffusion of Innovations provides

important vocabulary and structure

for change agency

Page 35: Lessons Learned in Large Scale Process Improvement

35®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Diffusion of Innovations

Diffusion of Innovations is “the process by which an innovation is communicated through channels over time to certain members of a social system.” – Everett Rogers

Diffusion of Innovations is “the process by which an innovation is communicated through channels over time to certain members of a social system.” – Everett Rogers

Improved seeds & farming methods

New antibiotics

Cell phones

PDAs

Dvorak keyboard

BETA format video

Page 36: Lessons Learned in Large Scale Process Improvement

36®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Models for Diffusion

• People Mover: Personal contact between the change agent and the adopter

• Communication: Use of “mass media” to communicate, rather than people

• On-The-Shelf: Innovation packaged by experts as a complete solution for non-experts to use

• Vendor: Outsourced innovation diffusion

• Rule: Imposed innovation from another source based on authority, often accomplished through policy or standards

• People Mover: Personal contact between the change agent and the adopter

• Communication: Use of “mass media” to communicate, rather than people

• On-The-Shelf: Innovation packaged by experts as a complete solution for non-experts to use

• Vendor: Outsourced innovation diffusion

• Rule: Imposed innovation from another source based on authority, often accomplished through policy or standards

These models can be used alone or in combination

Page 37: Lessons Learned in Large Scale Process Improvement

37®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

The Four Elements of Diffusion

Innovation

CommunicationChannels

Time

Social System

Page 38: Lessons Learned in Large Scale Process Improvement

38®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Innovation Attributes

How visible the innovation is to other groups or individuals

Observability

The degree to which the innovation can be sampled or tried in part

Trialability

How complex the innovation is to learn and use

Complexity

How well the innovation fits with the culture and past practices of the organization

Compatibility

Potential improvement to the current situation if adopted

Relative Advantage

Attribute Description

Page 39: Lessons Learned in Large Scale Process Improvement

39®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Innovation Attribute Examples

Relative Advantage: Reduced TTM, greater efficiency, cost savings, or improved quality; greater standing in the company, conformance to standards

Compatibility: Fit with existing processes; reuse of concept or vocabulary; new infrastructure required; fit with company culture

Complexity: Amount of training required before use; educational prerequisites; depth and breadth of information

Trialability: Feasibility, risks, and cost of partial or temporary implementation; degree that trial reduces uncertainty

Observability: Presence of tangible, intelligible results; breadth of results’ application

Relative Advantage: Reduced TTM, greater efficiency, cost savings, or improved quality; greater standing in the company, conformance to standards

Compatibility: Fit with existing processes; reuse of concept or vocabulary; new infrastructure required; fit with company culture

Complexity: Amount of training required before use; educational prerequisites; depth and breadth of information

Trialability: Feasibility, risks, and cost of partial or temporary implementation; degree that trial reduces uncertainty

Observability: Presence of tangible, intelligible results; breadth of results’ application

Page 40: Lessons Learned in Large Scale Process Improvement

40®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Organizational Innovation Decisions

Organizations use a slightly different innovation decision process from individuals:

Agenda Setting

Matching

Redefining

Clarifying

“Routinizing”

• General problems that create the need for innovation

• Matching a known problem with an innovation

• Re-invention of the innovation and modification of processes

• Better defining the organization’s relationship with the innovation

• The innovation is integrated and loses its identity

Page 41: Lessons Learned in Large Scale Process Improvement

41®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Two Models of Organizational Change

Ag

en

da

Se

ttin

g

Ma

tch

ing

Re

de

finin

g

Cla

rify

ing

“Ro

utin

izin

g”

New Culture

Current Culture

Disconfirmation Event

Defining the Future State

Decision to Change

Gap Analysis

“Unfreezing”the culture

Making Changes

“Refreezing”the culture

Page 42: Lessons Learned in Large Scale Process Improvement

®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Lesson 6

Explicitly define and document success using measurable,

quantifiable language

Page 43: Lessons Learned in Large Scale Process Improvement

43®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Specifying Success Criteria

To specify success criteria for a change agency project:

• Start by specifying high-level objectives and a Statement of Work

• For each objective, develop one or more quantified measures to serve as criteria

• Use a balanced scorecard approach to measurement

In some cases, you will have to rely on indirect or surrogate measures as criteria

Many success criteria are not Boolean, but rather measure success over some interval

To specify success criteria for a change agency project:

• Start by specifying high-level objectives and a Statement of Work

• For each objective, develop one or more quantified measures to serve as criteria

• Use a balanced scorecard approach to measurement

In some cases, you will have to rely on indirect or surrogate measures as criteria

Many success criteria are not Boolean, but rather measure success over some interval

Page 44: Lessons Learned in Large Scale Process Improvement

44®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Words We Like to Hear…

“I am CERTAIN that were it not for the profound learningsthat I received from you in your Requirements Engineering curriculum, these results… would not have occurred. I recently learned that the increased sales projections due to XYZ (of which ABC is just the first deliverable) are estimated to be between two and three Billion dollars!”

- A Satisfied Customer, 2004

“I am CERTAIN that were it not for the profound learningsthat I received from you in your Requirements Engineering curriculum, these results… would not have occurred. I recently learned that the increased sales projections due to XYZ (of which ABC is just the first deliverable) are estimated to be between two and three Billion dollars!”

- A Satisfied Customer, 2004

Page 45: Lessons Learned in Large Scale Process Improvement

45®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Scorecard Overview

It is not necessary to use all categories on a single project; choose a subset based on needs and opportunities

1. Reaction and Satisfaction

2. Knowledge and Skills Transfer

3. Application and Implementation

4. Business Impact

5. Financial Benefits & ROI

6. Intangible Benefits

1. Reaction and Satisfaction

2. Knowledge and Skills Transfer

3. Application and Implementation

4. Business Impact

5. Financial Benefits & ROI

6. Intangible Benefits

Source: Adapted from The Consultant’s Scorecard, Jack Phillips

There are several categories of success criteria to consider:

Page 46: Lessons Learned in Large Scale Process Improvement

46®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

The Landing Zone

For larger projects, a Landing Zone may help summarize the detailed goals and serve as a general definition of success. Here is an example Landing Zone for a new car:

For larger projects, a Landing Zone may help summarize the detailed goals and serve as a general definition of success. Here is an example Landing Zone for a new car:

< $20,000< $22,000< $27,000Price

Target + heated seats

Min + GPS system

A/C, Air bags, CD

Features

> 30/35> 25/30> 20/25Mileage (city/hwy)

5 + 1 child5 Adults4 adultsSeating

OutstandingTargetMinimumCriterion

Page 47: Lessons Learned in Large Scale Process Improvement

47®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Landing Zone Usage

Landing Zones are useful for several things:

•Gain explicit consensus at the start of a project on the definition of success

•Quantify the achievement levels required as an input to feasibility and risk analysis

•Drive tradeoff discussions and decision making throughout the project

•Define decision authority limits for the team

•Monitor and communicate product attribute status to decision forums and management during development

Landing Zones are useful for several things:

•Gain explicit consensus at the start of a project on the definition of success

•Quantify the achievement levels required as an input to feasibility and risk analysis

•Drive tradeoff discussions and decision making throughout the project

•Define decision authority limits for the team

•Monitor and communicate product attribute status to decision forums and management during development

Page 48: Lessons Learned in Large Scale Process Improvement

48®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Planguage for Success Criteria

Planguage is an informal but structured keyword-driven planning language created by Tom Gilb

• Planguage is very well suited to specifying success criteria for projects

• Its strength is its ability to create measurable, concise statements

Planguage is an informal but structured keyword-driven planning language created by Tom Gilb

• Planguage is very well suited to specifying success criteria for projects

• Its strength is its ability to create measurable, concise statements

Planguage aids communication about complex ideas

Page 49: Lessons Learned in Large Scale Process Improvement

49®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Example Engagement Objectives

Objectives:

1. Improve the quality of requirements for project X.

2. Train project team members in requirements review techniques

3. Assist in establishing group policy for requirements engineering practices and process

Objectives:

1. Improve the quality of requirements for project X.

2. Train project team members in requirements review techniques

3. Assist in establishing group policy for requirements engineering practices and process

Let’s look closer at the first objective… How would we quantify it so it is measurable?

Page 50: Lessons Learned in Large Scale Process Improvement

50®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

From Objective to Success Criterion

Requirements Quality: Improve requirements quality on project X.

Scale: Total major defects per page remaining at time of baseline.

Meter: Inspection of a sample of requirements, 1 hr. per page rate, assuming 50% effectiveness.

Minimum: No more than 5 major defects per page

Target: No more than 3 major defect per page

Outstanding: Less than 1 major defect per page

Past [Sample of first 20 requirements]: 20 majors per page

Requirements Quality: Improve requirements quality on project X.

Scale: Total major defects per page remaining at time of baseline.

Meter: Inspection of a sample of requirements, 1 hr. per page rate, assuming 50% effectiveness.

Minimum: No more than 5 major defects per page

Target: No more than 3 major defect per page

Outstanding: Less than 1 major defect per page

Past [Sample of first 20 requirements]: 20 majors per page

Page 51: Lessons Learned in Large Scale Process Improvement

®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Lesson 7

Employ an effective business model within the group that

drives change

Page 52: Lessons Learned in Large Scale Process Improvement

52®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

The Opportunity

A relatively small team of change agents can have a large positive effect on an organization if they:

• Work on expressed business unit problems, not their own agenda

• Manage opportunities via portfolio management to ensure they are addressing the most important needs first

• Deliver meaningful results early and often

• Have a clear exit strategy for each engagement, and emphasize knowledge transfer rather than staff augmentation

A relatively small team of change agents can have a large positive effect on an organization if they:

• Work on expressed business unit problems, not their own agenda

• Manage opportunities via portfolio management to ensure they are addressing the most important needs first

• Deliver meaningful results early and often

• Have a clear exit strategy for each engagement, and emphasize knowledge transfer rather than staff augmentation

Page 53: Lessons Learned in Large Scale Process Improvement

53®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Sample Vision and Mission

Vision: Product development at <company or group name> is repeatable, competitive, and continuously improving.

Vision: Product development at <company or group name> is repeatable, competitive, and continuously improving.

Mission: We create and deploy methods and tools that improve product development practices. We engage with teams to work on their problems, and measure success by achieved business results.

Mission: We create and deploy methods and tools that improve product development practices. We engage with teams to work on their problems, and measure success by achieved business results.

Page 54: Lessons Learned in Large Scale Process Improvement

54®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Basic Business Model

•Projects are planned, managed, and executed according Evolutionary Delivery principles

•Change agents work directly with teams using the People Mover model, assisted by other models as needed

•Resources are allocated and reallocated to projects using portfolio management process with defined prioritization criteria

•Change agent resources are provided to teams at no cost (except possibly travel) as an incentive to adopt new behaviors

•Every engagement must have a statement of work, measurable success criteria, and documented exit strategy

•Projects are planned, managed, and executed according Evolutionary Delivery principles

•Change agents work directly with teams using the People Mover model, assisted by other models as needed

•Resources are allocated and reallocated to projects using portfolio management process with defined prioritization criteria

•Change agent resources are provided to teams at no cost (except possibly travel) as an incentive to adopt new behaviors

•Every engagement must have a statement of work, measurable success criteria, and documented exit strategy

Page 55: Lessons Learned in Large Scale Process Improvement

55®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Operational Guidelines

The group operates internally according to Change-ABLE™principles:

• Linked teams are used on engagements and internal projects (training development, etc.)

• All members post and maintain a Top 5 document for their personal yearly, quarterly, monthly objectives

• Engagement and project status is communicated regularly using OSIR (Objectives, Status, Issues, Recommendations) format

• Resources are re-allocated quickly to meet challenges and new opportunities based on OSIR reports

• Group decision making follows a consultative model

The group operates internally according to Change-ABLE™principles:

• Linked teams are used on engagements and internal projects (training development, etc.)

• All members post and maintain a Top 5 document for their personal yearly, quarterly, monthly objectives

• Engagement and project status is communicated regularly using OSIR (Objectives, Status, Issues, Recommendations) format

• Resources are re-allocated quickly to meet challenges and new opportunities based on OSIR reports

• Group decision making follows a consultative model

Source: The Change-Able™ Organization

Page 56: Lessons Learned in Large Scale Process Improvement

56®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Summary

1. Take time to learn about your culture

2. Understand how organizational change takes place

3. Start by establishing a life cycle for development

4. Use Evolutionary Delivery to drive change

5. Diffusion of Innovations provides important vocabulary and structure for change agency

6. Explicitly define and document success using measurable, quantifiable language

7. Employ an effective business model within the group that drives change

1. Take time to learn about your culture

2. Understand how organizational change takes place

3. Start by establishing a life cycle for development

4. Use Evolutionary Delivery to drive change

5. Diffusion of Innovations provides important vocabulary and structure for change agency

6. Explicitly define and document success using measurable, quantifiable language

7. Employ an effective business model within the group that drives change

Page 57: Lessons Learned in Large Scale Process Improvement

57®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Questions?

• “There is nothing more difficult to take in hand, more perilous to conduct, or more uncertain in its success, than to take the lead in the introduction of a new order of things.”- Machiavelli

• “After you've done a thing the same way for two years, look it over carefully. After five years, look at it with suspicion. And after ten years, throw it away and start all over.”- Alfred Edward Perlman

• “It is not necessary to change. Survival is not mandatory.”- Deming

• “There is nothing more difficult to take in hand, more perilous to conduct, or more uncertain in its success, than to take the lead in the introduction of a new order of things.”- Machiavelli

• “After you've done a thing the same way for two years, look it over carefully. After five years, look at it with suspicion. And after ten years, throw it away and start all over.”- Alfred Edward Perlman

• “It is not necessary to change. Survival is not mandatory.”- Deming

Page 58: Lessons Learned in Large Scale Process Improvement

58®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

For More Information

Diffusion of Innovations, 4th ed., Everett Rogers, Free Press 1995.

Network Models of the Diffusion of Innovations, Thomas Valente, Hampton Press 1995.

Software Engineering Technology Infusion Within NASA, Marvin Zelkowitz, IEEE Transactions on Engineering Management, Vol. 43, No. 3, August 1996.

Models of Technology Transfer (A Dialectical Case Study), in IEEE Conference: The New International Language, Portland, OR July 1991.

The Sources of Innovations, Eric von Hipple, Oxford University Press 1988

Diffusion of Innovations, 4th ed., Everett Rogers, Free Press 1995.

Network Models of the Diffusion of Innovations, Thomas Valente, Hampton Press 1995.

Software Engineering Technology Infusion Within NASA, Marvin Zelkowitz, IEEE Transactions on Engineering Management, Vol. 43, No. 3, August 1996.

Models of Technology Transfer (A Dialectical Case Study), in IEEE Conference: The New International Language, Portland, OR July 1991.

The Sources of Innovations, Eric von Hipple, Oxford University Press 1988

Page 59: Lessons Learned in Large Scale Process Improvement

59®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

For More Information

The Corporate Culture Survival Guide, Edgar Schein, Jossey-Bass 1999.

Organizational Culture and Leadership, 2nd Ed., Edgar Schein, Jossey-Bass 1992.

Influence: The Psychology of Persuasion, Robert Cialdini, Perennial Currents 1998

Competitive Engineering, Tom Gilb, Elsevier 2004.

Principles of Software Engineering Management, Tom Gilb, Addison Wesley 1988.

The Change-ABLE™ Organization, William Daniels, John Mathers, Wiley 1997

The Corporate Culture Survival Guide, Edgar Schein, Jossey-Bass 1999.

Organizational Culture and Leadership, 2nd Ed., Edgar Schein, Jossey-Bass 1992.

Influence: The Psychology of Persuasion, Robert Cialdini, Perennial Currents 1998

Competitive Engineering, Tom Gilb, Elsevier 2004.

Principles of Software Engineering Management, Tom Gilb, Addison Wesley 1988.

The Change-ABLE™ Organization, William Daniels, John Mathers, Wiley 1997

Page 60: Lessons Learned in Large Scale Process Improvement

60®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

For More Information

Managing Transitions: Making the Most of Change, 2nd Ed., William Bridges, Perseus 2003.

Managing Transitions: Making the Most of Change, 2nd Ed., William Bridges, Perseus 2003.

Page 61: Lessons Learned in Large Scale Process Improvement

®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Backup

Page 62: Lessons Learned in Large Scale Process Improvement

62®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Evolution vs. Transformation

Cultures evolve continually based on new experiences, external forces, etc.

•We can influence the evolution of a culture, but we cannot totally control it

Culture change can also be transformational, but this requires that we disrupt the status quo

Cultures evolve continually based on new experiences, external forces, etc.

•We can influence the evolution of a culture, but we cannot totally control it

Culture change can also be transformational, but this requires that we disrupt the status quo

Organizational culture is a result of the company’s past successes as well as failures, and should be treated carefully - it is a source of strength

Page 63: Lessons Learned in Large Scale Process Improvement

63®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Transition Management

Ending the old

The “Neutral Zone”

Beginning the new

Source: Adapted from Managing Transitions, 2nd ed., William Bridges

Comfort Discomfort & Loss

Uncertainty & Opportunity

Promise

� � ��☺ ☺

Page 64: Lessons Learned in Large Scale Process Improvement

64®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Individual Innovation Decisions

Knowledge

Persuasion

Decision

Implementation

Confirmation

• Awareness of the innovation or a problem/opportunity

• Data gathering, uncertainty reduction, opinion formation

• Adoption or rejection (can change at any time later)

• Overt behavior change for organization or individual

• Data to support continuance or discontinuance

Order varies, and steps are sometimes revisited or skipped!

Page 65: Lessons Learned in Large Scale Process Improvement

65®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Adoption Decision Types

1. Optional innovation decisions made by an individual

2. Collective innovation decisions made by a group through consensus

3. Authority innovation decisions made by a few members of a group and imposed on others

4. Contingent innovation decisions that can be made only after another decision

1. Optional innovation decisions made by an individual

2. Collective innovation decisions made by a group through consensus

3. Authority innovation decisions made by a few members of a group and imposed on others

4. Contingent innovation decisions that can be made only after another decision

Decision type has a powerful effect on strategies and models to use for process improvement

Page 66: Lessons Learned in Large Scale Process Improvement

66®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Adoption Incentives

There are many ways to characterize incentives:

• Adopter versus change agent or champion

• Individual versus group or system

• Positive versus negative

• Monetary versus non-monetary

• Immediate versus delayed

There are many ways to characterize incentives:

• Adopter versus change agent or champion

• Individual versus group or system

• Positive versus negative

• Monetary versus non-monetary

• Immediate versus delayed

Page 67: Lessons Learned in Large Scale Process Improvement

67®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Measurement and Feedback

Within a change agency effort, measurement and feedback can take on many forms:

• Plan-Do-Study-Act

• Six Sigma: Define, Measure, Analyze, Improve, Control (DMAIC)

• Traditional Business Process Improvement (BPI) or Gap Analysis

• The Scientific Method (hypothesis testing and experimental design)

• And more…

Within a change agency effort, measurement and feedback can take on many forms:

• Plan-Do-Study-Act

• Six Sigma: Define, Measure, Analyze, Improve, Control (DMAIC)

• Traditional Business Process Improvement (BPI) or Gap Analysis

• The Scientific Method (hypothesis testing and experimental design)

• And more…

Be sure to close the feedback loop regardless of method used

Page 68: Lessons Learned in Large Scale Process Improvement

68®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Measurement Fundamentals

• A process that is not under statistical control cannot be systematically improved because special variation has not been eliminated

• In most environments, many potential causes will exist for any observed improvement

• The act of observing and measuring will influence both human behavior and process output (the Hawthorne Effect)

• Measurement systems are evaded and sabotaged in cultures where the data is used for employee performance and not just continuous improvement

• A process that is not under statistical control cannot be systematically improved because special variation has not been eliminated

• In most environments, many potential causes will exist for any observed improvement

• The act of observing and measuring will influence both human behavior and process output (the Hawthorne Effect)

• Measurement systems are evaded and sabotaged in cultures where the data is used for employee performance and not just continuous improvement

Page 69: Lessons Learned in Large Scale Process Improvement

69®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Advice…

• Be conservative in claiming causality for improvement in some quantity; give credit to other sources when they exist

• Get others (your stakeholders, for example) to state the value of your work

• It will take some time to establish a measurement system in a group where none has existed before; don’t expect too much too soon

• It is best to have a written policy on valid and invalid uses for measurement data, reinforced frequently and enforced rigorously by senior management.

• Be conservative in claiming causality for improvement in some quantity; give credit to other sources when they exist

• Get others (your stakeholders, for example) to state the value of your work

• It will take some time to establish a measurement system in a group where none has existed before; don’t expect too much too soon

• It is best to have a written policy on valid and invalid uses for measurement data, reinforced frequently and enforced rigorously by senior management.

Page 70: Lessons Learned in Large Scale Process Improvement

70®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

VisionVision SkillsSkills IncentivesIncentives ResourcesResources ActionPlan

ActionPlan

SkillsSkills IncentivesIncentives ResourcesResources ActionPlan

ActionPlan

VisionVision IncentivesIncentives ResourcesResources ActionPlan

ActionPlan

VisionVision SkillsSkills ResourcesResources ActionPlan

ActionPlan

VisionVision SkillsSkills IncentivesIncentives ActionPlan

ActionPlan

VisionVision SkillsSkills IncentivesIncentives ResourcesResources

Change

Confusion

Anxiety

No

Change

Frustration

False

Starts

American Productivity & Quality Center 1993 The Change Management Toolkit for Reengineering, Executive Overview 1994

Elements of Change – Another View

Page 71: Lessons Learned in Large Scale Process Improvement

71®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Planguage for Success Criteria

Ambition: A short description of the success criterion.

Scale: The scale of measure used to quantify the statement.

Meter: The measurement process used to establish location on a Scale.

Minimum: The minimum level required to avoid political, financial, or other type of failure.

Target: The level at which good success can be claimed.

Outstanding: A stretch goal if everything goes perfectly.

Wish: A desirable level of achievement that may not be attainable through available means.

Ambition: A short description of the success criterion.

Scale: The scale of measure used to quantify the statement.

Meter: The measurement process used to establish location on a Scale.

Minimum: The minimum level required to avoid political, financial, or other type of failure.

Target: The level at which good success can be claimed.

Outstanding: A stretch goal if everything goes perfectly.

Wish: A desirable level of achievement that may not be attainable through available means.

Planguage has keywords for various situations. For success criteria, a subset will do in most cases:

Continued…

Page 72: Lessons Learned in Large Scale Process Improvement

72®Copyright © 2004 Intel Corporation. No part of this presentation may

be copied without the written permission of Intel Corporation.

Planguage for Success Criteria

Past: An expression of previous results for comparison.

Trend: An historical range or extrapolation of data.

Record: The best known achievement.

Fuzzy concepts requiring more details: <fuzzy concept>.

Qualifiers (used to modify other keywords): [when, which, …].

A collection of objects: {item1, item2, …}.

The source for any statement: �.

Past: An expression of previous results for comparison.

Trend: An historical range or extrapolation of data.

Record: The best known achievement.

Fuzzy concepts requiring more details: <fuzzy concept>.

Qualifiers (used to modify other keywords): [when, which, …].

A collection of objects: {item1, item2, …}.

The source for any statement: �.

• Many other keywords exist for special situations

• Use only the keywords that make sense in the context of the project