Upload
blake-houston
View
225
Download
0
Embed Size (px)
Citation preview
®
IBM Software Group
© 2003 IBM Corporation
IBM Software Development PlatformSoftware QualitySales 201 Training
2005
IBM Software Group
2
Agenda
Strategy IBM Software Development Platform e-Business on demand
Overview of IBM Software Quality products and offerings IBM Rational Functional Tester
IBM Rational Robot
IBM Rational Manual Tester
IBM Rational Performance Tester
IBM Rational PurifyPlus
IBM Rational Test RealTime
Exercises
Additional References
IBM Software Group
3
Imperatives in Today’s World: Innovation & Productivity
Improvingthe productivity
of resources deployed.
Innovatingthe business to capture
new value.
ITITBusinessBusiness
IBM Software Group
4
IT is the lever to maximize flexibility and responsiveness while containing cost
An on demand operating
environment is an integrated
infrastructure aligned to
business goals and
processes in a resilient and
secure manner
On DemandOperating
Environment
On Demand Operating
Environment
All designed with an architecture that allows you to manage services as components
Results: Simplification and Optimization of IT to meet the needs of the business responsively
Business-Driven Development
Infr
astr
uctu
re
Man
agem
entIntegration
On Demand Operating
Environment
IBM Software Group
5
Operations ApplicationDevelopers
BusinessAnalysts
Business ViewBusiness View
Poor visibility and governanceover IT investments
Lack of actionable information Blind decision-making
ApplicationDevelopment View
ApplicationDevelopment View
The challenge: Poor visibility, lack of cohesion across business and technology domains
OperationsView
OperationsView
Overwhelming complexity Relentless time-to-market
pressure Uncontrolled change
Inadequate service levels Inability to rapidly deploy
applications Complex, multi-tier operating
environments
IBM Software Group
6
BusinessAnalysts
Operations ApplicationDevelopers
Business ViewBusiness View
Clear view of technology ROI Top-down and bottom-up visibility into
technology projects Objective decision-making support
ApplicationDevelopment View
ApplicationDevelopment View
The solution: Breaking down the silosA shared view of the development lifecycle
OperationsView
OperationsView
Rapid application development and deployment
Improved collaboration Asset reuse
Improved service and quality compliance
Predictable deployments Accelerated diagnosis and
repair
IBM Software Group
7
Transform and simplify software development
• Higher productivity - 50% + increase in developer productivity
• Improved quality - 80% fewer bugs • Greater predictability
• Higher productivity - 50% + increase in developer productivity
• Improved quality - 80% fewer bugs • Greater predictability
Business-driven developmentBusiness-driven development
• Align Technology and Business priorities
• Improve efficiency and responsiveness
• Create innovative products
• Align Technology and Business priorities
• Improve efficiency and responsiveness
• Create innovative products
Development as a business process Development as a business process
An integrated approach to software development that aligns line-of-business, development and operations teams to improve business performance
An integrated approach to software development that aligns line-of-business, development and operations teams to improve business performance
Software development becomes a driver of competitive advantage
IBM Software Group
8
Operations
Business
Discover, develop, and deploy assets
Discover business & technology assets Business priorities Requirements Middleware and software assets
Develop at the speed of business Rapid application development Model-driven architecture Asset-based development Direct-to-middleware productivity
Deploy to closed-loop environments Automated applications deployment Streamlined composite application
management Direct-to-operations productivity
Prioritize Plan Manage Measure
Optimize Iterate
IBM Software Group
9
Model the BusinessModel the Business Define
RequirementsDefine
Requirements
Analyze& DesignAnalyze& Design
ImplementImplement
TestTestDeployDeploy
ManageManage
OptimizeOptimize
The business-driven development lifecycle
Executive
Application Support
ArchitectProject Manager
Tester
Deployment Manager
Developer
BusinessBusiness
DevelopmentDevelopmentOperationsOperations
Manage change& assets
Manage change& assets
Prioritize Plan Manage Measure
Optimize Iterate
End User
Operations Manager
AnalystGovernGovern
IBM Software Group
10
AnalystAnalyst ArchitectArchitect DeveloperDeveloper TesterTester
Rapidly construct, transform,integrate
and generate
code
Rapidly construct, transform,integrate
and generate
code
Design, create,
and execute
tests
Design, create,
and execute
tests
Model, simulate, assemble,
and monitor processes
Model, simulate, assemble,
and monitor processes
Visuallymodel
applications and data
Visuallymodel
applications and data
Provision, configure, tune and
troubleshoot applications
Provision, configure, tune and
troubleshoot applications
Follow a common process Manage and measure
projects and portfolios Manage requirements
Follow a common process Manage and measure
projects and portfolios Manage requirements
Manage changeand assets
Manage quality
Manage changeand assets
Manage qualityProject ManagerProject Manager
ExecutiveExecutive
Align investments with business objectives Analyze and monitor project portfolios Align investments with business objectives Analyze and monitor project portfolios
Deployment Manager
Deployment Manager
The IBM Software Development PlatformA complete, open, modular, and proven solution
IBM Software Group
11
Agenda
Strategy IBM Software Development Platform e-Business on demand
Overview of IBM Software Quality products and offerings IBM Rational Functional Tester
IBM Rational Robot
IBM Rational Manual Tester
IBM Rational Performance Tester
IBM Rational PurifyPlus
IBM Rational Test RealTime
Exercises
Additional References
IBM Software Group
12
Focus # 1: Discover AssetsOptimize Business Investments
Identify and analyzeBusiness processesRequirementsSoftware Assets
Packaged applicationsExisting applications
Middleware Impact of potential change
Business process optimization is the #1 priority in 2004 — Business process optimization is the #1 priority in 2004 — Information Week Study 2Q04 Information Week Study 2Q04 —— 400 business-technology 400 business-technology executivesexecutives
DISCOVER
IBMSOFTWARE
DEVELOPMENT PLATFORM
IBM Software Group
13
Rapid application development Model-driven architecture Asset based development Direct-to-middleware
productivity Service-oriented architecture Tightly integrated run-time
test and deploy Anytime, anywhere, team
collaborative environments
Focus # 2: Develop AssetsImprove Time-to-Value
Dramatically acceleratethe development cycle
IBMSOFTWARE
DEVELOPMENT PLATFORM
IBM Software Group
14
Focus # 3: Deploy AssetsDeliver Business Results
Unify development and operations teams
Accelerate deployment and provisioning
Automate applications monitoring
Monitor business performance and analyze ROI
Verify and manage change
Enable closed-loop deployment
IBMSOFTWARE
DEVELOPMENT PLATFORM
IBM Software Group
15
A team-based approachAll tools and team members support all development imperatives
AnalystAnalyst ArchitectArchitect DeveloperDeveloper TesterTester
Rapidly construct, transform,integrate
and generate
code
Rapidly construct, transform,integrate
and generate
code
Design, create,
and execute
tests
Design, create,
and execute
tests
Model, simulate, assemble,
and monitor processes
Model, simulate, assemble,
and monitor processes
Visuallymodel
applications and data
Visuallymodel
applications and data
Provision, configure, tune and
troubleshoot applications
Provision, configure, tune and
troubleshoot applications
Follow a common process Manage and measure
projects and portfolios Manage requirements
Follow a common process Manage and measure
projects and portfolios Manage requirements
Manage changeand assets
Manage quality
Manage changeand assets
Manage qualityProject ManagerProject Manager
ExecutiveExecutive
Align investments with business objectives Analyze and monitor project portfolios Align investments with business objectives Analyze and monitor project portfolios
Deployment Manager
Deployment Manager
IBM Software Group
16
Capabilities Product Description
Key ProductsBusiness Analyst
Tester Developer
IBM Rational Manual Tester
IBM Rational Functional Tester
IBM Rational Performance Tester
IBM Rational Robot
IBM Rational PurifyPlus
IBM Rational Test RealTime
IBM Rational TestManager
Runtime analysis Component, functional and
performance testing Cross-platform test execution
support Test & planning reporting
IBM Software Quality Offerings
Ensures reliability, functionality, scalability
Reduces cycle time Accommodates multiple
skill sets, roles Shares responsibility for
quality across team
IBM Software Group
17
From the Industry AnalystsIBM Rational Software Quality Products
Ovum "IBM Rational has been focusing on strategic integration of the ASQ* toolset
with the complete IBM Software Development Platform, including the use of the Eclipse framework for software tool integration. We expect over the next 18 months IBM Rational's ASQ tools will again provide best-of-breed, single-point test tools, which will excel by operating within a formidably integrated environment across the development, test and delivery lifecycle. As a bonus, the fact that the platform is based on Eclipse open standards means that you will not be locked into IBM Rational-only tools.“
– Source Paul Herzlich (Ovum) 08.04 - Ovum Evaluates: Software Testing Tools
IDC - Noted Rational’s “extremely well established and complementary product
set to IBM’s.” Source: Worldwide Distributed Automated Software Quality Tools 2004-2008
Forecast and 2003 Vendor Shares M. Webster (IDC) 08.04
* Automated Software Quality
IBM Software Group
18
Agenda
Strategy IBM Software Development Platform e-Business on demand
Overview of IBM Software Quality products and offerings IBM Rational Functional Tester
IBM Rational Robot
IBM Rational Manual Tester
IBM Rational Performance Tester
IBM Rational PurifyPlus
IBM Rational Test RealTime
Exercises
Additional References
IBM Software Group
19
Challenges of Functional TestingChallenges of Functional Testing
Control cost of test automation Inexperienced testers face steep
learning curve for tools
Test maintenance grows with project
Testing Tools Lack Flexibility Power users hands are tied by tool
limitations
Control cost of test automation Inexperienced testers face steep
learning curve for tools
Test maintenance grows with project
Testing Tools Lack Flexibility Power users hands are tied by tool
limitations
“I need one tool for both my expert and
novice testers.”
“Our script language limits our ability to overcome some
automation obstacles.”
IBM Software Group
20
IBM Rational Functional Tester Automated regression testing for Web,
J2EE, .Net and terminal-based applications
Key Benefits Minimize test maintenance with scripts
resilient to application changes Wizard enhanced automation to
speed test creation for the new user Powerful scripting language and IDE
for the professional tester Supports Team oriented parallel
development
Functional Testing with IBM Rational Functional Tester Test automation for the novice and the professional
IBM Software Group
21
Challenge Overcome the complexity of test automation to ensure teams
spend more time on high value quality assessment rather than on low return test maintenance.
Challenge Overcome the complexity of test automation to ensure teams
spend more time on high value quality assessment rather than on low return test maintenance.
Resolution Provide technologies to enable
novice testers to craft complex tests with no programming Data driven wizard
Dynamic data verification
Reduce script maintenance Wizard driven global updates to
centralized object map
Resolution Provide technologies to enable
novice testers to craft complex tests with no programming Data driven wizard
Dynamic data verification
Reduce script maintenance Wizard driven global updates to
centralized object map
Challenge 1: Controlling the Cost of AutomationChallenge 1: Controlling the Cost of Automation
IBM Software Group
22
Challenge Fulfill both standard test needs as well as expert
requirements to ensure usage limited only by the imagination of the project team.
Challenge Fulfill both standard test needs as well as expert
requirements to ensure usage limited only by the imagination of the project team.
Resolution Provide two test script
development languages Java
Visual Basic .NET
Give professional testers the flexibility to overcome testing challenges in the language of their choice
Resolution Provide two test script
development languages Java
Visual Basic .NET
Give professional testers the flexibility to overcome testing challenges in the language of their choice
Challenge 2: Tools Lack FlexibilityChallenge 2: Tools Lack Flexibility
IBM Software Group
23
Challenge 3: Test Team IntegrationChallenge 3: Test Team Integration
Challenge Accommodate the requirements of both dedicated,
independent QA teams as well as integrated project teams to ensure high operational integrity.
Challenge Accommodate the requirements of both dedicated,
independent QA teams as well as integrated project teams to ensure high operational integrity.
Resolution Provide version control
support in the box with ClearCase LT
Provide integrations for standard version control features
Check In/Out
Compare withPrevious Versions
Show change history
Resolution Provide version control
support in the box with ClearCase LT
Provide integrations for standard version control features
Check In/Out
Compare withPrevious Versions
Show change history
IBM Software Group
24
What is Automated Testing?
Using automation tools to record actions taken against an application.
Test scripts are derived from these recordings which are then used for subsequent test execution.
Record
Enhance
Execute
Record
Enhance
Execute
IBM Software Group
Manual testing can’t keep pace!Manual testing
can’t keep pace!Rerun the first tests and...
Time
Tests
...take more time
...take more time
...the new tests...
Build 1 Build 2 Build 3, 4, 5 …
Challenge of Manual Testing with Short Test Cycles
Manual testing alone can’t keep pace with the rapid development of applications Quality will be sacrificed to keep on schedule
IBM Software Group
26
Effective Test AutomationCreating an automated test is a three steps process
Script Recording Capture user interactions with the system under test
Record
IBM Software Group
27
Effective Test AutomationCreating an automated test is a three step process
Script Recording Capture user interactions with the system under test
Script Enhancing Modify scripts for situation specific challenges
EnhanceRecord
IBM Software Group
28
Execute
Effective Test AutomationCreating an automated test is a three step process
Script Recording Capture user interactions with the system under test
Script Enhancing Modify scripts for situation specific challenges
Script Execution Ensure reliable playback for local or remote execution
EnhanceRecord
IBM Software Group
29
IBM Rational Functional Tester
Linux-based test authoring
ClearCase LT
IBM Rational Functional Tester Overview
Manual Tester
Eclipse Java Development Tools
Wizard and table-assisted data-driven tests
Tests Java, .NET, Web and terminal emulator-based apps
Java and VB.NET-based test scripts
Test Script Language• User has choice of two test script
languages – Java and VB.NET• Use of Java implies editing and
debugging in Eclipse/RAD/RSA-based editor
• Use of VB.NET implies usage of Microsoft VS.NET-based editor/debugger
• Identical capabilities in both editors
GUI Technologies• Automates regression testing
of Java, .NET, Web and terminal emulator-based applications
Data-driven Testing• Simplified data-driven testing
enabled by wizards and Excel-like data tables
Improved Linux support• Users can author and modify test
scripts on Linux (no script recorder)• Scripts can also be executed on
Linux
Eclipse availability• When using Java scripting,
runs inside Eclipse/RSA/RAD shell
• Full Eclipse JDT features are accessible
• Accessible to developers from within their IDE
Manual Tester in the box • Customers receive one Manual
Tester license per Functional Tester license
• Improve return on manual testing efforts while adopting automated test methods
ClearCaseLT in the box• Supports parallel development
of manual tests• Enables remote test access for
distributed teams
Automated functional
regression testing
IBM Software Group
30
IBM Rational Functional Tester New Positioning
Lowering the Cost of Functional Testing
Supports Integration of Test Team with Rest of the Project Team
Offers Extensive Customization Options
Broader environment support
Adds support for testing VS.NET Winforms applications
Adds ability to edit and playback scripts on Linux (no recording)
Advances in ease of use
Choice of script languages
Wizard for data-driven testing
Improved object map maintenance capabilities
Ships with full-use copies of IBM Rational Manual Tester and IBM Rational ClearCaseLT and customers can download Rational TestManager
What’s New in Atlantic
IBM Software Group
31
Rational Functional Tester – Key Features and Benefits Test Java, Web & VS.NET Winform
appsLower TCO with a
single tool supporting a broad array of
industry standard application
development technologies
Java or VB.NET scripting language
Easier adoption of the tool – Teams select
the language they are most familiar with.
Helps sell to Microsoft customers
Add-on for Terminal-based application
testingCentral QA and IT teams can support
client-server, web and legacy application
testing with single tool
Wizards for data-driven testing
Eliminates manual coding required to vary
data in test script
Expanded dynamic
verificationAbility to use
regular expressions in
data pools created with new wizard for data-
driven testing
Advanced Object Map
MaintenanceGlobal Find and
Modify tools further reduce
test maintenance
IBM Software Group
32
Rational Functional Tester – Key Features and Benefits Version Control “in-
the-box”
Collocated teams can support multiple
versions of test scripts and parallel development paths with no additional
tools to buy. Distributed teams can upgrade to ClearCase to
facilitate remote testing, whether off-
site or off-shore.
Ability to install, edit and execute tests on Linux Developers and
testers in diverse, heterogeneous environments benefit from a
common toolset
IBM Software Group
33
Broad Environment Support Test Web, Java. .net and terminal-based
applications Create data driven tests without coding Static data and properties verification Dynamic data validation without coding
Flexible and Extensible Scripts Flexible coding language Powerful, professional debugger Object map editing flexibility Version control of scripts
Script Execution Options Reliable playback with ScriptAssure Remote and local playback on various platforms
Broad Environment Support Test Web, Java. .net and terminal-based
applications Create data driven tests without coding Static data and properties verification Dynamic data validation without coding
Flexible and Extensible Scripts Flexible coding language Powerful, professional debugger Object map editing flexibility Version control of scripts
Script Execution Options Reliable playback with ScriptAssure Remote and local playback on various platforms
Summarizing Key Features in IBM Functional TesterSummarizing Key Features in IBM Functional Tester
IBM Software Group
34
Reduce Test Script MaintenanceReliable Playback with Script Assure
DeterminesMatch
Version 1.0 Version 2.0
TesterSees
ToolSees
No User No User Intervention Intervention
Required With Required With ScriptAssureScriptAssureTMTM
IBM Software Group
35
Case StudySAS Institute, Inc.
Challenge Improve communication between developers and testers
Solution IBM Rational Functional Tester
Enables best-of-breed automated functional and regression testing from within an Eclipse environment, including testing from within IBM WebSphere Studio and Rational XDE Developer
Benefits Productivity and quality improvements
– Efficiency has gone up and the quality of software delivery has gone up
Bring quality issues to the surface faster
– fix these issues and deliver software on time
Minimize script maintenance through resilient reusable test scripts
Achieved better results by using a consistent methodology
More information http://www-306.ibm.com/software/success/cssdb.nsf/CS/JENS-5WVSPY?OpenDocument&Site=software
IBM Software Group
36
Competitive AdvantagesIBM Rational Functional Tester
Part of a proven, complete, open and modular software development platform Single vendor solution
Integration with other development tools
Provides a shared development/test environment and common language on application development projects using Eclipse or Visual Studio.net
Choice of a Java or Visual Basic.net scripting language
Allows testers to leverages existing Java or VB.net skills on program teams
Product wizards to help build complex tests without coding
Provides a single tool to test Java, Web, .net and terminal-based applications
ScriptAssure technology for building robust, resilient test scripts
IBM Software Group
37
ResourcesIBM Rational Functional Tester
IBM Rational Functional Tester Web page http://www-306.ibm.com/software/awdtools/tester/functional/index.html
Rational Functional Tester evaluation copy http://www14.software.ibm.com/webapp/download/preconfig.jsp?id=2005-01-
19+04%3A01%3A18.402144R&S_TACT=104CBW71&S_CMP=
Introduction to IBM Rational Functional Tester http://www-128.ibm.com/developerworks//rational/library/04/r-3228/
developerWorks testing resources http://www-130.ibm.com/developerworks/rational/products/xdetester
Success stories http://www.ibm.com/software/success/cssdb.nsf/topstoriesFM?OpenForm&Site=rational
Training http://www-306.ibm.com/software/sw-training/
Events http://www-306.ibm.com/software/sw-events/
IBM Software Group
38
Agenda
Strategy IBM Software Development Platform e-Business on demand
Overview of IBM Software Quality products and offerings IBM Rational Functional Tester
IBM Rational Robot
IBM Rational Manual Tester
IBM Rational Performance Tester
IBM Rational PurifyPlus
IBM Rational Test RealTime
Exercises
Additional References
IBM Software Group
39
Execute
Effective Test AutomationCreating an automated test is a three step process
Script Recording Capture user interactions with the system under test
Script Enhancing Modify scripts for situation specific challenges
Script Execution Ensure reliable playback for local or remote execution
EnhanceRecord
IBM Software Group
40
Recording Scripts
Create a Test Script that captures all system-user interaction
Test scripts are recorded on the fly, as user navigates application
Verification points are inserted to validate system response
Key considerations when recording scripts Environment Support
Flexible verification ability
IBM Software Group
41
Environment Support for Recording Scripts
IBM Rational Robot has special environment support for key development languages Java, HTML, .NET, Visual Basic, MFC
PowerBuilder, Delphi, Oracle Forms
Robot also has a general recording engine which can be used against other windows and terminal emulation environments
IBM Software Group
42
You See…
Verification Points in Recording Scripts
Automated Validation Robot captures data and properties that can be invisible to users
During script execution, current results are compared to stored baselines
Discrepancies are flagged and reported to user
13 different verification points are available to validate system behaviorincluding Rational SiteCheck for web site link checking
Robot Sees DataRobot Sees Data
Robot Sees PropertiesRobot Sees Properties
IBM Software Group
43
Enhancing Scripts
Enhancing Scripts with basic coding extends their value and reach SQA Basic code is added to perform
a variety of functions
Typical Modifications: Conditional branching, datapooling, refactoring
Key considerations when enhancing scripts Flexible coding language
Extensibility of language and playback engine
IBM Software Group
44
Flexible Coding Language for Enhancing Scripts
IBM Rational Robot uses the SQA Basic Language Uses Visual Basic syntax
Augments VB commands with test specific functions
Easy to read language very suitable to those will little programming experience
Flexible power to enhance scripts Programmatic access to all GUI objects
Datapool facility enables data driven tests
Programmatic access to Windows API
Programmatic access to COM objects
IBM Software Group
45
Solving Custom Problems with ExtensibilitySolving Custom Problems with Extensibility
Robot has an extensibility interface to allow support for custom controls Development partners have been trained
Can manufacture support for ActiveX, .NET Windows Forms, Java & Win32 including MFC and ATL GUI controls
Eliminates the work around Allowing testers to focus on the
task of testing
Robot has an extensibility interface to allow support for custom controls Development partners have been trained
Can manufacture support for ActiveX, .NET Windows Forms, Java & Win32 including MFC and ATL GUI controls
Eliminates the work around Allowing testers to focus on the
task of testing
IBM Software Group
46
Executing Tests
Scripts are executed, discrepancies are noted Scripts are executed
and test logs created
Test logs are highlight differences between actual and expected results
Key considerations when executing scripts Multiple execution points
Coordination of scripts
IBM Software Group
47
Automated Testing
Script Execution Options Scripts can be run from Robot GUI
Scripts can be executed from Command line
Scripts can be run from TestManager
Offers ability to run scripts on remote machines
Test Run from Robot or Command Line
Remote Tests RunFrom Test Manager
Master
IBM Software Group
48
Effective Test Automation
Powerful and flexible scheduling TestManager will coordinate timing and dependencies
Schedule execution on remote computers from central control station
TestManager is configuration aware, i.e.:
Tests designated as Windows XP will only be run on XP machines
Agent
Agent
Agent
Master
IBM Software Group
49
Broad Environment Support Support for all major development
environments
Flexible and Extensible Scripts Simple, yet powerful, scripting language
for enhancing scripts
Support available for custom control
Script Execution Options Run scripts from Robot, TestManager or
command line
Broad Environment Support Support for all major development
environments
Flexible and Extensible Scripts Simple, yet powerful, scripting language
for enhancing scripts
Support available for custom control
Script Execution Options Run scripts from Robot, TestManager or
command line
Summarizing Key Features in IBM Rational RobotSummarizing Key Features in IBM Rational Robot
IBM Software Group
50
Case StudyCorporate Express
Challenges Cut testing time and challenges in manual testing process
manual regression testing found to be tedious, time-consuming and error-prone
Improve repeatability of tests
Improve confidence in software quality at release
Solution Automated the manual process with IBM Rational Robot
Benefits Cut testing time from days to weeks, over 75%
31/2 weeks of testing in 3 days
Team confidence that each regression test is executed accurately and with a consistent process from one release to the next
More information http://www-306.ibm.com/software/success/cssdb.nsf/CS/JENS-5WPKR2?OpenDocument&Site=software.
IBM Software Group
51
Resources
IBM Rational Robot Web page http://www-306.ibm.com/software/awdtools/tester/robot/index.html
IBM developerWorks page for IBM Rational Robot http://www-136.ibm.com/developerworks/rational/products/robot
Success stories http://www.ibm.com/software/success/cssdb.nsf/topstoriesFM?OpenForm&Site=rational
Training http://www-306.ibm.com/software/sw-training/
Events http://www-306.ibm.com/software/sw-events/
IBM Software Group
52
Agenda
Strategy IBM Software Development Platform e-Business on demand
Overview of IBM Software Quality products and offerings IBM Rational Functional Tester
IBM Rational Robot
IBM Rational Manual Tester
IBM Rational Performance Tester
IBM Rational PurifyPlus
IBM Rational Test RealTime
Exercises
Additional References
IBM Software Group
53
What is Manual Testing?
Using human labor to validate the business use cases and fitness for use of an application, system or device
Includes labor to plan, design, execute and evaluate the status of the application or device under test
Experience indicates over 75% of the testing done today is performed manually
IBM Software Group
54
Why Teams use Manual Testing?
Recruitment of subject-matter experts and end-users to test
Poor or non-existent test automation-ready interfaces
Strict regulatory or process requirements aren’t met with automation tools
IBM Software Group
55
Rational Manual Tester Positioning
Advances Manual Testing
Simplifies Through Assistance
Satisfies Diverse Needs
Supports manual testing done by analysts, subject-matter experts and technical/non-technical testers
Develop detailed, easy to follow manual tests
Minimize test maintenance and ensure test consistency
Reduce human error during data entry and data verification
Support diverse usage models and processes
Ships with full copy of ClearCaseLT for version control of tests
Key Capabilities
IBM Software Group
56
Challenges of Manual TestingChallenges of Manual Testing
Labor Intensive Too much time is spent creating
and maintaining manual test documentation
Labor Intensive Too much time is spent creating
and maintaining manual test documentation
“More time is spent maintaining test
documentation than on executing tests.”
“We struggle to document even a
minimum set of tests.”
IBM Software Group
57
Challenges of Manual TestingChallenges of Manual Testing
Labor Intensive Too much time is spent creating
and maintaining manual test documentation
Unreliable
Inadvertent human-error often skews test results
Labor Intensive Too much time is spent creating
and maintaining manual test documentation
Unreliable
Inadvertent human-error often skews test results
“Our results are unreliable due to
human error.”
“Our tests aren’t detailed enough for the testers to consistently
execute them.”
IBM Software Group
58
Challenges of Manual TestingChallenges of Manual Testing
Labor Intensive Too much time is spent creating
and maintaining manual test documentation
Unreliable
Accidental human-error often skews test results
Resistant to Change
Each project has diverse processes, tester skill sets and types of applications and devices under test
Labor Intensive Too much time is spent creating
and maintaining manual test documentation
Unreliable
Accidental human-error often skews test results
Resistant to Change
Each project has diverse processes, tester skill sets and types of applications and devices under test
“Each project has different standards, which are hard to
manage manually.”
“No single tool or process works for the different software and hardware systems we
must test.”
IBM Software Group
59
Challenge 1: Labor Intensive
Challenge Creating and maintaining manual tests is labor intensive
and difficult with tools such as Microsoft Word or Excel.
Challenge Creating and maintaining manual tests is labor intensive
and difficult with tools such as Microsoft Word or Excel.
Resolution Implement a solution that
promotes the best practice of modular tests which can share common content
Leverage existing Word or Excel test documents to quick-start test development
Resolution Implement a solution that
promotes the best practice of modular tests which can share common content
Leverage existing Word or Excel test documents to quick-start test development
Share test
content
IBM Software Group
60
Challenge Human error often skews tests results
Challenge Human error often skews tests results
Resolution Assist testers with the tasks
most prone to error – data entry and data verification
Build manual tests that are clear, concise and easy for the tester to follow
Resolution Assist testers with the tasks
most prone to error – data entry and data verification
Build manual tests that are clear, concise and easy for the tester to follow
Challenge 2: UnreliableChallenge 2: Unreliable
IBM Software Group
61
Challenge Each project has diverse processes, tester skill sets and
types of applications and devices under test
Challenge Each project has diverse processes, tester skill sets and
types of applications and devices under test
Resolution Provide a solution that testers
of all skills levels can leverage
Customize the tool to fit each project’s process metrics and values
Leverage a solution that is independent of the software or hardware under test
Resolution Provide a solution that testers
of all skills levels can leverage
Customize the tool to fit each project’s process metrics and values
Leverage a solution that is independent of the software or hardware under test
Challenge 3: Resistant to ChangeChallenge 3: Resistant to Change
For all skill levels
For any target of test
For any process
IBM Software Group
62
IBM Rational Manual Tester
ClearCase LT
Test Import / Results Export
IBM Rational Manual Tester Overview
Data entry & validation assistance
Custom test fields
Test step reuse library
Rich test editor
Customizable• Add new data fields to
individual test steps• Apply internally-defined
naming conventions
Tool Assistance• Automated data entry• Automated data
comparison and results storage
• Reduces opportunity for manual error during test execution
Import/Export• Imports manual test source
files from Microsoft Word, Microsoft Excel and Rational TestManager
• Exports test results to CSV format for additional analysis
Manual test authoring and
execution
ClearCaseLT in the box• Supports parallel development of
manual tests• Enables remote test access for
distributed teams
Rich Text Editor• Modify test font, size,
color; attach images and files
• Supports creation of both test steps and verification points
• Ensures clarity of test step direction and consistency of test execution
Reuse Library• Library for common test
procedures• Drag-and-drop construction of
new tests• Automatic global update when
modifying any one instance of linked content
IBM Software Group
63
Rational Manual Tester – Key Features and Benefits Rich Text Editor
Reduces the ambiguity that often plagues other methods used to define and deliver test step directions
Import From Word, Excel or TestManager
Easier adoption of the tool
Multiple Validation Points
Allows test results to be reported and analyzed at either a high
level or a granular level
Reuse PalettePromotes shared
content which results in time & cost saving in
test maintenance & greater control over test quality and consistency
Assisted Data Entry and Data
VerificationReduce the likelihood of
human error in the areas most
prone to mistakes
Custom Data Fields
Easily adapts to existing
processes and metrics
collection standards
IBM Software Group
64
Rational Manual Tester – Key Features and Benefits Translucent Execution UI
The translucent window used to display test instructions
makes test completion faster by eliminating the need to move the test instruction
window in order to see the application under test
Supports Team Use
Supports individuals, teams, and mobile works through private and shared test data stores – ensuring
test assets remain easily accessible and reportable –
ClearCaseLT in the box
Generates Spreadsheet-Ready Results
Testers can use any reporting tool to analyze results - ensuring that Rational
Manual Tester can easily work with a team’s processes and standards for
metrics collection and reporting
IBM Software Group
65
Summarizing Key Features in Manual Tester
Advances manual testing Rich text editor for test authoring
Test step reuse palette
Test script import from Microsoft Word or Excel
Satisfies diverse needs Supports usage by distributed teams
Generates spreadsheet-ready results data
Multiple validation points
Custom data fields
Simplifies through assistance Assisted data entry and data verification
during test execution
IBM Software Group
66
ResourcesIBM Rational Manual Tester
IBM Rational Manual Tester Web page http://www-306.ibm.com/software/awdtools/tester/manual/index.html
Rational Manual Tester evaluation copy http://www14.software.ibm.com/webapp/download/preconfig.jsp?id=2005-01-
16+03%3A32%3A04.405210R&S_TACT=104CBW71&S_CMP=&s=
Rational Manual Tester evaluation guide http://www-106.ibm.com/developerworks/edu/i-dw-r-manualtest-i.html
Article A simple tool to manage manual testing
http://www-128.ibm.com/developerworks/rational/library/04/r-3232/
developerWorks testing resources http://www-128.ibm.com/developerworks/rational/products/manualtester/
Success stories http://www.ibm.com/software/success/cssdb.nsf/topstoriesFM?OpenForm&Site=rational
Training http://www-306.ibm.com/software/sw-training/
Events http://www-306.ibm.com/software/sw-events/
IBM Software Group
67
Agenda
Strategy IBM Software Development Platform e-Business on demand
Overview of IBM Software Quality products and offerings IBM Rational Functional Tester
IBM Rational Robot
IBM Rational Manual Tester
IBM Rational Performance Tester
IBM Rational PurifyPlus
IBM Rational Test RealTime
Exercises
Additional References
IBM Software Group
68
IBM Rational Performance Tester
Graphical test scheduler and user profiler
ClearCase LT
IBM Rational Performance Tester Overview
Eclipse Java Development Tools
High scalability hyper-threaded execution architecture
Visual test construction and editing
HTTP/S load testing
Visual Test Editor• Test viewer requires no coding for test
modification and execution• Automated identification and variation
of dynamic data• Insertion of Java code is supported for
advanced customization needs
New load testing technology
• New load test recorder and execution engine
• Supports HTTP/S; additional protocol support (e.g. ERP) planned for Q2 2005
Windows and Linuxload generation support
High scalability• High scalability, low
footprint due to hyper-threaded architecture
• Significant improvement over Robot technology
Test scheduler• Graphical user profiling and
transaction modeling• Eases modeling of user populations
Platform Support• Multiple platform support for
load generation Eclipse-based• Runs inside Eclipse/RSA/RAD shell• Accessible to developers from within
their IDE
Load and performance testing
ClearCaseLT in the box• Supports parallel development
of manual tests• Enables remote test access for
distributed teams
IBM Software Group
69
IBM Rational Performance Tester New Positioning
Built for Day One Productivity
Lowers Cost of Performance Testing
Provides Advanced Data Capabilities
Completely re-architected performance testing solution for testing complex web application
Designed for novice and advanced performance testers
Real-time monitoring for immediate feedback during test execution
Easy to build data driven tests
Eclipse-3 integration
What’s New in Atlantic
IBM Software Group
70
Rational Performance Tester – Key Features and Benefits Visual test editorEasy for a novice to
understand, with drill-down to detailed data
for more expert users. Simplifies test
creation and maintenance
Automatic identification of
variable data
Allows tests to automatically re-use data sent by server and to prepare for data-driven testing
Built-in datapool editor for data-driven
testing
Easily vary data for more realistic load
tests
Rich scheduling
editorNovice users
can easily assemble and schedule tests
Eclipse basedProvides a
single environment
for development
as well as testing
activities
IBM Software Group
71
Rational Performance Tester – Key Features and Benefits
Java execution engine
Tests may call custom Java
provided by the user. Provides
highly-customizable and
flexible performance
testing
Real-time reportingKnow immediately about performance
problems
High ScalabilityLow memory and
processor footprint required to generate large multi-user loads.
Allows larger tests with less
hardware
Remote system monitoringCollect and
visualization of remote server information.
Find resource constraints that
cause poor performance
IBM Software Group
72
ResourcesIBM Rational Performance Tester
IBM Rational Performance Tester Web page http://www-306.ibm.com/software/awdtools/tester/performance/index.html
Success stories http://www.ibm.com/software/success/cssdb.nsf/topstoriesFM?OpenForm&Site=rational
Training http://www-306.ibm.com/software/sw-training/
Events http://www-306.ibm.com/software/sw-events/
IBM Software Group
73
Agenda
Strategy IBM Software Development Platform e-Business on demand
Overview of IBM Software Quality products and offerings IBM Rational Functional Tester
IBM Rational Robot
IBM Rational Manual Tester
IBM Rational Performance Tester
IBM Rational PurifyPlus
IBM Rational Test RealTime
Exercises
Additional References
IBM Software Group
74
The Problem with Trying to Pinpoint Bugs
Crash
Crash
Symptoms
Errors triggered
IBM Software Group
75
What Makes Bugs Difficult to Find?
Many memory-related bugs have no immediate visible symptoms
Often the symptoms are difficult, if not impossible, to reproduce
Manually tracing symptoms back to problems in the source codecan be a daunting task
Crash
Crash
IBM Software Group
76
Why Is My Program So Slow?
Do you deliver slow code that’s “good enough?”
Is it too difficult to find performance problems?
Can you get repeatable, useful performance data?
Can you quantify the effect of performance fixes?
Does your performance profiling data help you manage your development project?
What about Predictability at runtime?
IBM Software Group
77
Code Coverage Challenge
Can you guarantee the code that you deliver is reliable?
How complete is your test suite?
Are you sure that you have tested the entire application?
Can you understand the summary of several tests?
How Reliable is Untested Code?
IBM Software Group
78
Instantly become more productive
IBM Rational PurifyPlus: Developing Fast, Reliable Code
To develop fast, reliable code, you need a tool that Automatically pinpoints hard-to-find bugs
Highlights performance bottlenecks
Keeps you from shipping untested code
You need a multi-platform and multi-language tool for Unix, Windows, Linux, Java, .NET, VB6, C/C++, and more
IBM Rational PurifyPlus combines three industry leaders into one box: IBM Rational Purify
IBM Rational Quantify
IBM Rational PureCoverageThe x-ray for software
IBM Software Group
79
Detect Memory Problems: Rational Purify
Automatically identifies the problem while the application is running!
Finds errors in third-party code, even without source Bugs in libraries that you deliver are still bugs in your application!
No recompile required Much faster and easier to use
Incorporate into your existing project quickly and easily
Test what you are delivering No need to maintain multiple source baselines
QE knows that they are testing what you are delivering
Detects memory corruption and memory leaks
IBM Software Group
80
Improve Code Performance: Rational Quantify
Leading product that provides repeatable performance data Build better quality C/C++, Java, Visual Basic 6.0, and .NET software
Get your team solving the correct problems
Fast and easy to use Provides concise, graphical views of performance data
“River of Time” – a straightforward way to view and understand performance profiling data
Easily integrates into your nightly builds
Collects performance data from code you intend to deliver No need to maintain multiple source baselines
IBM Software Group
81
Identify Untested Code: IBM Rational PureCoverage
Helps developers deliver higher quality code You know the unit testing is complete
Helps identify “dead code” or unexercised paths in legacy code
Helps improve your QA process Easily see what has and has not
been tested
Validate the quality and completeness of your test suite
Easy to learn and easy to use out of the box
With Rational PureCoverage, you know that you are covered!
Avoid shipping untested code
IBM Software Group
82
IBM Rational PurifyPlus
Key components of IBM Rational PurifyPlus Provides run-time data collection and analysis capabilities
Key for proactive debugging
Supports Unix, Windows, Java, .NET and Linux environments
LinuxLinux
RedHat
C/C++
WindowsWindows
VB6
C/C++
HP-UXHP-UX
Full 64bit
C/C++
SolarisSolaris
Java
C/C++
SGI-IRIXSGI-IRIX
Full 64bit
C/C++
Not Available Yet
Quantify
PureCoverage
Full 64bit Java
.NET Full 64bit
IBM Software Group
83
Instantly become more productive
IBM Rational PurifyPlus Summary
To develop fast, reliable code, you need IBM Rational PurifyPlus that: Automatically pinpoints hard-to-find bugs
Highlights performance bottlenecks
Keeps you from shipping untested code
Powerful tool for developers and testers Strong ROI when used as “medicine”
Even better ROI when used as “vitamin”
Used as part of the development process
IBM Software Group
84
Case Study Ensemble Systems
Challenge Ensemble Systems was contracted to develop an easy-to-maintain software
system to perform data analysis twice as fast as an existing solution, while significantly reducing analysis errors.
Solution Rational Rose, Rational Purify and Rational Quantify
able to effectively model the system, detect and fix memory leaks and enhance the overall performance of the application under development.
Benefits Reduced the time the system required to analyze defects by 85%, and
reduced the system's error rate by 90%.
Quickly pinpointed memory leaks and identified opportunities to improve performance
More Information http://www-306.ibm.com/software/success/cssdb.nsf/CS/JENS-5PFQXR?OpenDocument&Site=software
IBM Software Group
85
Case StudySAS Institute, Inc.
Challenge Improve software quality
Solution Rational Purify and Rational Quantify to help find performance bottlenecks
and memory problems in the software
Integrated Rational Purify and Rational Quantify into testing process through product APIs
Benefits Achieve higher level of confidence in the quality of software releases
More information http://www-306.ibm.com/software/success/cssdb.nsf/CS/JENS-5WVSWK?OpenDocument&Site=software
IBM Software Group
86
Competitive AdvantagesIBM Rational PurifyPlus
Part of a family of tools that comprise the IBM Software Development Platform
Integration across tools
Can form a more complete development and testing solution
Multilanguage support Java, but also Visual C++, Visual Basic, Visual Basic.NET and Visual
C#.NET in one package
Module and test level coverage
Offline analysis of data
Merging test results
IBM Software Group
87
ResourcesIBM Rational PurifyPlus
IBM Rational PurifyPlus Web page http://www-306.ibm.com/software/awdtools/purifyplus/
developerWorks: Rational http://www.ibm.com/developerworks/
Getting Started Guides
Training – Web-based or Instructor-led
Articles - whitepapers – forums
Success stories http://www.ibm.com/software/success/cssdb.nsf/topstoriesFM?OpenForm&Site=rational
Training http://www-306.ibm.com/software/sw-training/
Events http://www-306.ibm.com/software/sw-events/
IBM Software Group
88
Agenda
Strategy IBM Software Development Platform e-Business on demand
Overview of IBM Software Quality products and offerings IBM Rational Functional Tester
IBM Rational Robot
IBM Rational Manual Tester
IBM Rational Performance Tester
IBM Rational PurifyPlus
IBM Rational Test RealTime
Exercises
Additional References
IBM Software Group
89
IBM Rational Test RealTime Fix your code before it breaks
Rational Test RealTime is a cross-platform testing solution designed for those who write code for real-time and embedded software products Automates testing, analysis and
bugs solving early during development cycle
Provides a low-overhead technology for enabling target-independent tests
Extends model-driven development to include runtime analysis capabilities
Fix the defects, enhance your tests and move on!
code code code code code code code code code code code code code code code code code code code code code code
Test
AnalyzeResolve
IBM Software Group
90
Embedded and real-time software testing challengesEmbedded and real-time systems are complex by natureEmbedded and real-time software testing challengesEmbedded and real-time systems are complex by nature
Application Complexity Strong timing constraints
Low memory footprints
Concurrent/Distributed/Networked
Environment Complexity Multiple RTOS/IDE/Chips vendors
Limited host-target connectivity
Low built-in debugging capabilities
Process Complexity Requirements
Design translation errors
Difficult to maintain
Poor performance
Application Complexity Strong timing constraints
Low memory footprints
Concurrent/Distributed/Networked
Environment Complexity Multiple RTOS/IDE/Chips vendors
Limited host-target connectivity
Low built-in debugging capabilities
Process Complexity Requirements
Design translation errors
Difficult to maintain
Poor performance
IBM Software Group
91
Embedded and real-time software testing challengesIt’s hard to set up and deploy an effective testing framework
Are you frustrated by manual testing because of its tendency to be Labor-intensive?
Resistant to reuse?
Are you concerned that test creation and execution will Pull you out from your comfort zone?
Add overhead to an already crowded schedule?
Require to much efforts to ensure quality at both source code and system level?
Are you convinced that your embedded environment is too specific for a commercial testing solution because of Design constraints?
Heterogeneous build/execution tools?
Strict testing techniques and activities recommended by certification standards?
IBM Software Group
92
Embedded and real-time software testing challengesYou need a way to test on the host AND on the actual target!
If your target platform is not available, you can test on the host To simulate the operational environment and discover generic bugs
But tests must be performed in the final target environment as well Since some errors are only detected under the operational conditions
Cross-platform testing is difficult because the system conception… Is frequently based on multiple chips for different execution
machines or boards
Combines more than one programming language
Presents very constrained architectural characteristics
IBM Software Group
93
Embedded and real-time software testing challengesHow to bring runtime analysis information at the UML level?
You want to use the Unified Modeling Language (UML) to visually lay out your application's design and tests but you still don’t know how State machines and code coverage
of model-level execution are related?
If there are any memory leaks in the hand-coded parts of the application?
To measure the performance profile of the generated code?
IBM Software Group
94
How can your team overcome these challenges?Would this accelerate quality?
Automated component testing at all levels of complexity Full automation of the creation and deployment of test scripts, stubs and
drivers for the simplest functions up to distributed systems
Faster debugging thanks to extensive runtime analysis capabilities Memory and performance profiling, code coverage
and runtime tracing features
Make testing an integral part of development Dynamic links between tested code, test results and potentially
visual models
Prioritize your tests Code complexity and static metrics calculation
Fully repeatable test sessions Complete automation of regression testing
IBM Software Group
95
How can your team overcome these challenges?Would this solve the verification constraints in the real target?
An integration framework flexible enough to accommodate your selection of compiler, linker, debugger, and target architecture To generate test harnesses executable in the real operational conditions
To avoid changing test scenarios when target environment does
Automatic test download, execution and results upload on target To free developers from target management restraints
To help your development team concentrating primarily on test design
Low-overhead and minimally intrusive verification probes and drivers To cope with low memory footprints and limited CPU resources
To encourage in-situ verification of the software despite target constraints
IBM Software Group
96
How can your team overcome these challenges? Would this empower your model-centric development process?
Develop, debug and analyze at the model level
Graphically visualize reached and un-reached application states and transitions
Track memory errors and performance in the hand-coded portions of the application while staying in the modeling environment
Trace application execution flow in a UML-compliant graphical format
IBM Software Group
97
Test as you code Automatic component test template
and data generation
Black- and white-box testing
All levels of complexity: from single functions to distributed systems
Static metric calculation for
tests prioritization
complexity estimation
Full regression testing
Test, analyze and resolve during development
code code code code code code code code code code code code code code code code code code code code code code
Test
AnalyzeResolve
IBM Software Group
98
Test as you code
Analyze while you test Code coverage analysis
Memory profiling
Performance profiling
Runtime tracing
Thread profiling
Test, analyze and resolve during development
code code code code code code code code code code code code code code code code code code code code code code
Test
AnalyzeResolve
IBM Software Group
99
Test, analyze and resolve during development
Test as you code
Analyze while you test
Resolve what you have uncovered Test execution integrated
with your debugger
Consolidated, detailed to-the-point test reporting
Test data hyperlinked to runtime analysis resultsand code
code code code code code code code code code code code code code code code code code code code code code code
Test
AnalyzeResolve
Fix the defects, enhance your tests and move on!
IBM Software Group
100
Built to achieve standards compliance
DO-178B (Avionics), MISRA (Automotive), DEF STAN 00-55 (Defense)
Test, analyze and resolve during developmentOverview of IBM Rational Test RealTime features
Target Deployment PortTarget Deployment Port
Component TestingComponent Testing
C, C++, Ada, JavaC, C++, Ada, Java
CodeCoverage
CodeCoverage
C, C++Ada, Java C, C++
Ada, Java
MemoryProfilingMemoryProfiling
C, C++Java
C, C++Java
PerformanceProfiling
PerformanceProfiling
C, C++Java
C, C++Java
RuntimeTracingRuntimeTracing
C, C++Java
C, C++Java
CC
ThreadProfilingThread
Profiling
C, C++Java
C, C++Java
Unit, Integration, Validation, Regression and System TestingUnit, Integration, Validation, Regression and System Testing
System TestingSystem Testing
IBM Software Group
101
Test, analyze and resolve during developmentTest RealTime provides a mean for achieving pervasive quality
Flexible to minimally impact preexisting development processes Powerful and source-code aware test languages drive robust data-driven tests
Process agnostic, so you can stay in your comfort zone
Shortens time-to-problem-resolution, maximizes time-to-code
White-box and black-box testing for all your software modules Component testing of C/C++, Ada or Java (J2ME/J2SE) functions and classes
Message-based testing of C threads, tasks, processes and system nodes
Full set of runtime analysis features to enhance your debugging capabilities
Enables quality verification from a single and unified testing tool Handles all test enablement activities so you test early and often
Creates shared debug and test vocabulary for your team
Produces testing information required for certification processes conformance
IBM Software Group
102
Test and debug both host and targetTarget Deployment Port technology
A versatile feature which fully automates Test harness building and downloading on the target
Test execution and monitoring
Test results uploading on the host
A low-overhead feature which leverages Your choice of compiler/linker/debugger
Your host-target connectivity (serial link, Ethernet connection, JTAG probe…)
Test Harness Downloading
Test Results Uploading
Target Execution And Monitoring
Hosted Build Process
IBM Software Group
103
Ada
C++
Java (J2ME/J2SE)
C
LanguagesLanguages
Symbian Sun LynuxWorks
Cosmic NEC ARM
CAD-UL TI GreenHills
Hiware Hitachi Enea
Tasking Montavista WindRiver
Hitex Apex Windows CE
…… Microtec Lauterbach
4-Bit to 64-Bit 4-Bit to 64-Bit Cross-Development EnvironmentsCross-Development Environments
Used By Our CustomersUsed By Our Customers
AIX
HP-UX
PlatformsPlatforms
Linux
Solaris
Windows
Test and debug both host and target
IBM Software Group
104
Test and debug both host and targetTarget Deployment Port provides full target independence
Customizable to support a complete range of embedded targets Assures tool adoption
Reduces your ramp-up time when target configuration changes
Guarantees the reuse of test assets despite target constraints
Host, build and target environment agnostic Ensures portability of test and runtime analysis processes
Simplifies multiple team deployment
Optimizes ROI in comparison to home-grown test solutions
Size and speed optimized to limit target impact Enables full control to minimize instrumentation overhead
Frees your tests from having to compensate for target restraints
Avoids overtasking your system
IBM Software Group
105
Harness the power of model-driven testingIBM Rational Test RealTime - IBM Rational Rose RealTime integration
Move from code-centric to model-centric development
Perform test and runtime analysis at the model level Rose RealTime sequence diagrams for test scripting and Quality Architect
RealTime for test generation
Test RealTime plug-in for the runtime analysis of your C++ models
From within Rose RealTime for C++, activate the following runtime analysis features State-machine coverage
Memory and performance profiling
UML runtime tracing
IBM Software Group
106
Harness the power of model-driven testingFrom within IBM Rational Rose RealTime
UML SequenceUML SequenceDiagram as aDiagram as a
test casetest case
UML SequenceUML SequenceDiagram as aDiagram as a
test casetest case
Covered UML Covered UML statestate
Covered UML Covered UML statestate
Uncovered Uncovered UML transitionUML transition
Uncovered Uncovered UML transitionUML transition
IBM Software Group
107
Harness the power of model-driven testingFrom within IBM Rational Rose RealTime
Develop and debug at the model level
Seamlessly integrate Test RealTime runtime analysis capabilities
Rose RealTime application execution
Visualize covered states/transitions in your UML state machines
IBM Software Group
108
SummaryFix your code before it breaks with IBM Rational Test RealTime
A unique cross-platform solution for component testing and runtime analysis Automated functional testing at all
levels of complexity to ensure your software reliability
Memory and performance profiling, code coverage measurement and runtime tracing abilities to diagnose run-time issues
Dynamic links between code, test assets and visual models to make testing an integral part of the development cycle
Low-overhead technology for enabling target-independent tests and runtime analysis
All in one tool – for any IDE and hosted on any target!
IBM Software Group
109
Case StudyAlcatel Space
Challenge When building a communication system for a satellite project, Alcatel
needed to shorten testing time yet meet stringent testing standards and overcome significant testing challenges.
Solution Rational Test RealTime enabled them to successfully achieve these
objectives.
Benefits Increased development productivity as a result of validation testing
improvements
Heightened confidence in the overall quality of the application under test
Improved the predictability of the application's performance further ensuring customer satisfaction
More information http://www-306.ibm.com/software/success/cssdb.nsf/CS/JENS-5MHK6Z?OpenDocument&Site=software
IBM Software Group
110
Competitive Advantages IBM Rational Test RealTime
Full and flexible solution in a single tool
Integrated with lifecycle development tools IBM Rational ClearCase
IBM Rational ClearQuest
IBM Rational Test Manager
IBM Rational Rose RealTime
Rational Unified Process
Integrated with a UML model-driven development solution
Test deployment at all levels of verifications and granularity
Component testing and runtime analysis capabilities at the source code level
Test RealTime Target Deployment Port feature Deploy tests on any target from 4-bit to 64-bit architecture
IBM Software Group
111
Resources
Rational Test RealTime Web page http://www-306.ibm.com/software/awdtools/test/realtime/index.html
Real-Time and embedded solutions webinars http://www.ibm.com/software/rational/info/literature/whitepapers.jsp
Rational Developer Network http://www-136.ibm.com/developerworks/rational/products/testrealtime
Success stories http://www.ibm.com/software/success/cssdb.nsf/topstoriesFM?OpenForm&Site=rational
Training http://www-306.ibm.com/software/sw-training/
Events http://www-306.ibm.com/software/sw-events/
IBM Software Group
112
Quiz
Which roles on the software development team can benefit from IBM Software Quality products and offerings?
What are the benefits of an automated functional testing product such as IBM Rational Functional Tester?
Name three of the major features in Rational Functional Tester.
Which development languages does Rational Functional Tester support for creating test scripts?
What is the function of IBM Rational Robot?
Name three major features of Rational Manual Tester.
What does the assisted data verification feature in Rational Manual Tester do?
What does the visual test editor in Rational Performance Tester do?
What are the three areas of code analysis in IBM Rational PurifyPlus?
What are two of the competitive advantages of IBM Rational PurifyPlus?
What does Target Deployment Port technology do in Rational Test RealTime?
IBM Software Group
113
© Copyright IBM Corporation 2004. All rights reserved.
The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.
References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way.
IBM, the IBM logo, the e-business logo and other IBM products and services are trademarks or registered trademarks of the International Business Machines Corporation, in the United States, other countries or both.
Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries or both.
Microsoft, Windows, Windows NT and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries or both.
All other trademarks, company, products or service names may be trademarks, registered trademarks or service marks of others
Disclaimer: NOTICE – BUSINESS VALUE INFORMATION IS PROVIDED TO YOU 'AS IS' WITH THE UNDERSTANDING THAT THERE ARE NO REPRESENTATIONS OR WARRANTIES OF ANY KIND EITHER EXPRESS OR IMPLIED. IBM DISCLAIMS ALL WARRANTIES INCLUDING, BUT NOT LIMITED TO, IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. IBM DOES NOT WARRANT OR MAKE ANY REPRESENTATIONS REGARDING THE USE, VALIDITY, ACCURACY OR RELIABILITY OF THE BUSINESS BENEFITS SHOWN.. IN NO EVENT SHALL IBM BE LIABLE FOR ANY DAMAGES, INCLUDING THOSE ARISING AS A RESULT OF IBM'S NEGLIGENCE.WHETHER THOSE DAMAGES ARE DIRECT, CONSEQUENTIAL, INCIDENTAL, OR SPECIAL, FLOWING FROM YOUR USE OF OR INABILITY TO USE THE INFORMATION PROVIDED HEREWITH OR RESULTS EVEN IF IBM HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. THE ULTIMATE RESPONSIBILITY FOR ACHIEVING THE CALCULATED RESULTS REMAINS WITH YOU.