View
1.029
Download
23
Category
Tags:
Preview:
DESCRIPTION
Ever wondered which application lifecycle management (ALM) area poses the greatest challenge to organizations? Has the recession impacted new application development projects? Should testers possess development experience? Attend this exploration of data in the World Quality Report and find out. Published jointly by Capgemini and HP, the 2009 World Quality Report answers these questions and many others. The World Quality Report is based on survey findings of hundreds of testers, business analysts and developers across the globe. It is a revealing record of emerging trends in quality and a forecast of how these trends will shape ALM and associated software in the future.
Citation preview
©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
World Quality Report: How does your organization stack up against today’s trends in software quality and testing?Murat AksuGlobal Head of HP Software Alliance, CapgeminiCharlie Li Global Testing Services North America Lead, Capgemini
2World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
Demographics of Participants
Industry Notes
Tools and Technology
State of Quality
Test Organization & Outsourcing
Testing and Cloud
Agile
Key Trends
Agenda
©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
DEMOGRAPHICS OF PARTICIPANTS
4World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
Quality report profile - geography
North America
52%
Europe
30%
Asia
9%
Rest of the World
9%
5World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
Quality Report Profile – Size Of The Company
Enterprise Large Mid Size Small
0%
5%
10%
15%
20%
25%
30%
35%
40%
27%
17% 18%
38%
©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
INDUSTRY NOTES
7World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
7
Industry notes: consumer products and retail
“I don’t get no
RESPECT!”
8World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
8
Industry notes: high tech
“Iphone came
first!”“Droid is faster!”
9World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
9
Industry notes: financial services
“I’m repaying the
bailout money from
my phone”
10World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
10
Industry notes: telecommunications
11World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
11
Industry notes: public sector
“Yes we can???”
©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
Application lifecycle management (ALM) is the marriage of business management to software engineering made possible by tools that facilitate and integrate requirements management, architecture, coding, testing, tracking, and release management.*
*Wikipedia
TOOLS AND TECHNOLOGY
13World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
0%
5%
10%
15%
20%
25%
30% 29%
25%
16%
12%9%
2%
7%
Leverage Of Automation Technology Across ALM
Test Cases Defect
Manage-
ment
Require-
ments
Use
Case
Business IP
Domain
Mgmt
All of the
AboveBusiness
Flow
Modeling
14World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
How much ROI are you getting from investments?
49% 48%38%
43%
8% 7%
9%7%
12% 14%
18%17%
8%18%
20% 20%
18%
11% 11% 9%6% 3% 4% 5%
Asia Europe ROW USA
100%
Up to 80%
Up to 50%
Less than 25%
None
Can't Quantify
15World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
Need For Automation Investment
Business
flow
Modeling
Require-
ments
Test
Management
and
Execution
Defect
Manage-
ment
Environ-
ments and
Data
Management
None, we
have all that
we need
0%
5%
10%
15%
20%
25%23%
20% 20%19%
14%
3%
©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
STATE OF QUALITY
17World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
Overall quality getting better? (Last two years)
0% 20% 40% 60% 80% 100%
Consumer Products & Retail
Distribution/Logistics
Financial Services
Health Care/Life Sciences
Manufacturing
Media and Entertainment
Public Sector / Government
Technology
Telecommunications
57%
67%
75%
81%
81%
77%
50%
87%
81%
81%
43%
33%
25%
19%
19%
23%
50%
13%
20%
19%
Yes
No
18World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
What test methodology/process do you use?
15%
7% 4%
73%
TMAP TMMI We don’t have a testing
methodology
We use our own internal
methodology
19World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
Organizations following defined test process?
20%11%
17%
11%0%
18% 17%16%
80%
64% 67% 63%
Asia Europe ROW USA
More than 50% of the time
About 50% of the time
Up to 25% of the time
Less than 10% of the time
Not Applicable/We don’t have a testing methodology
©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
TEST ORGANIZATION&
TEST OUTSOURCING
21World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
12%
67%
21%
4%
78%
17%
8%
72%
20%
11%
72%
17%
Very little
Few years’ relevant industry domain knowledge
Experts in our industry domain
QA need to have domain knowledge?
NA
EU
ROW
ASIA
22World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
QA with strong technical skills better?
NA
EU
ROW
ASIA
29%
39%
32%
0%
5%
10%
15%
20%
25%
30%
35%
40%
45%
No Sometimes Yes
23World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
Most important skills when hiring QA
9%10%
14%
4%
5%5%22%
31%
Development skills (C++, Java, etc)
Scripting skills (Perl, Python, etc)
Database skills
Mainframe skills
Networking skills
Security skills
Business Knowledge
QA skills
24World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
Do you outsource QA?
33%
67%
15%
85%
65%
35%
51%
49%
Yes
No
NA
EU
ROW
ASIA
25World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
Where do you prefer to have your outsourced QA?
31%
26%
21%
7%
6%5% 3% 1%
Contractors co-located
India
Near shore
South America/Latin America
Eastern Europe
South East Asia
China
Africa
©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
TESTING & CLOUD
28World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
What percentage of your company’s applications
are virtualized?
0%
5%
10%
15%
20%
25%
30%
35%
Up to 25% Up to 50% Up to 75% Greater than 75%
None
35%
25%
12%
4%
24%
Percent Virtualized
29World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
Top cloud migration challenges
0% 10% 20% 30%
Application performance issues
Security and vulnerability problems
Application functionality issues
Infrastructure performance problems
We have not seen any issues
We have issues but we do not know the reasons
25%
20%
17%
16%
15%
7%
30World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
How are you leveraging cloud in your testing
efforts?
0% 10% 20% 30%
We spin up test environments using cloud services
We use testing tools hosted in the cloud
We leverage cloud services to generate traffic for our
performance testing efforts
We do not leverage virtualization/cloud in our testing
efforts
24%
17%
18%
41%
©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
AGILE
32World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
Do you leverage Agile methods in your application
delivery?
0% 20% 40% 60% 80% 100%
Consumer Products
Distribution/Logistics
Energy, Utility and Chemicals
Financial Services
Health Care/Life Sciences
Manufacturing
Media and Entertainment
Other
Public Sector / Government
Retail
Technology
Telecommunications
25%
30%
43%
31%
47%
50%
55%
44%
69%
50%
20%
54%
75%
70%
57%
69%
53%
50%
45%
56%
31%
50%
80%
46%
No
Yes
20%
80%
44%
56%
40%
60%
41%
59%
No Yes
NA
EU
ROW
ASIA
33World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
What percentage of your application delivery
projects leverage Agile methodology?
0%
5%
10%
15%
20%
25%
30%
35%
Less than 10%
10% to 25% 25% to 50% 50% to 75% 75% and above
34%
29%
14%13% 12%
34World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
What is the biggest challenge working with
offshore resources for Agile delivery?
0%
10%
20%
30%
40%
50%
Agile delivery cannot be successful leveraging offshore
resources
Lack of automation
Lack of collaboration technologies
Lack of communication
/ communication
problems
We do not have any challenges
with the offshore
resources for Agile delivery
9%6%
20%
43%
22%
©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
Key Trends
36World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
36
World Quality Report 2010-2011
Economy rebuilding from 2009: (71%) investing in new application
development in 2010-2011 for Competitive advantage
More IT investments are shifting from operational focus towards building
new applications that bring competitive business advantage
Doing more with less here to stay: both developers and testers
experience an increased workload
Heavier workload lead to need for greater efficiency, more consistent QA
methodology and better reuse of automated testing assets
Tester isn’t just tester anymore, more well rounded skills required and
more specialization
37World Quality Report 2010© Copyright Capgemini 2010 All Rights Reserved
in collaboration with
37
World Quality Report 2010-2011
Reduced budgets fueling Agile adoption: most experimenting, utilizing agile
only in a portion of new IT projects
Increased but calculated and cautious move to the cloud. 59% with less than
25% applications in the cloud
Cost reduction is the number one reason for companies to move their
applications to the cloud, followed by increased agility
45% encounter application performance and security issues when moving to
the cloud despite strict SLAs
Increased outsourcing with preference for contractor and near shore
Download The World Quality Report
www.capgemini.com
39 ©2010 Hewlett-Packard Development Company, L.P.
To learn more on this topic, and to connect with your peers after
the conference, visit the HP Software Solutions Community:
www.hp.com/go/swcommunity
40
Recommended