Upload
derrick-hart
View
215
Download
0
Embed Size (px)
Citation preview
© DMR Consulting
2Confidential Information
What Were we Testing? What’s the Product? Architecture Overall Test Strategy Team Responsibilities Test Environment Test Strategy Test Plans Summary Questions Contact Information
AgendaAgenda
© DMR Consulting
3Confidential Information
A multi-tiered architecture with multiple components Wireless Hand-held PC running Windows CE Web-Based (Dispatcher) Work Order
Management Application Work Flow Engine High Performance Middleware (because of
Wireless Packet Transfers) RiMMS (dynamic route optimization &
scheduling) Databases (SQL Server, LDAP, Oracle) NT Servers
What were we testing?What were we testing?
© DMR Consulting
4Confidential Information
What’s the Product:What’s the Product: ARROW ARROW
ARROWARROW schedules work orders for field technicians based upon customer need, company needs, location, and technician availability
Work orders are dispatched dynamically, wirelessly, to the technician in the field
Field technicians complete their work orders, keep
track of their time, record all important information, and wirelessly transfer completed work order back up to the central office
© DMR Consulting
5Confidential Information
ArchitectureArchitecture
Intranet
Dispatcher NT Server - Business & Data Services
Pen Centra 200
Radio tower
WirelessData
Network
Work Order System Architecture
Garage
FieldTechnicians
Fujitsu HandheldPC
with Windows CEversion 2.11
© DMR Consulting
6Confidential Information
Overall Test StrategyOverall Test Strategy
Unit Testing/Peer Reviews by Development PenCentra Hand-Held Field Testing plus Data
Center Operations and Procedures tested by Operations Group
BUT WHAT DID THE TEST TEAM DO? Full System Integration and Functional Testing
by Test Team in Test Environment Internal DMR Field Tests in San Diego &
Dallas/Fort Worth Customer Acceptance Testing
(End-to-End with Connectivity to Client Test Lab)
Extensive Parallel Field Tests
© DMR Consulting
7Confidential Information
Test Team ResponsibilitiesTest Team Responsibilities
Develop Overall Testing Strategy Define Test Groups, Units and Test Cases Implement Problem Tracking Tool/Procedures Create Test Plans and Schedules Establish/Build Test Environment Develop Daily Build Environment/Processes Coordinate Testing with Development Team Discover, Report and Monitor Defects & Issues Verify Requirements were Fully Tested
…TEST! And RETEST!
© DMR Consulting
8Confidential Information
Test EnvironmentTest Environment
Front EndHOOD
DEVELOPMENT
Front EndBAKER
Exchange Server
BACHELOR
DispatcherWinCE WirelessHandheld Device
RIMMSST
HELEN
Tower
FismoRAINIER
Data Servers Front-end Servers
Router to ATT
SQL 7SHASTA
ATTTest
T1
Tape StorageRAID 5Disk array
Laser printer
Internet
Front EndCRATER
LAKE
TEST Intranet
Front EndWIZARD
RIMMSGARIBALDI
Data Servers Front-end Servers
SQL 7MAZAMA
RAID 5Disk array
Laser printer
IIS Server & FirewallFUJI
© DMR Consulting
9Confidential Information
Six Parts to be TestedSix Parts to be Tested
1.
2.
5.
Scheduling
AutomaticallyCreates appointments - linked to dispatch,route optimization
Dispatch
Automatically sends the technician into thefield, handles all normaloperations, humans used for exceptions only - linked to scheduling tooland route optimizer
Hand-Held Device
Receives Wireless data andInstructions from Hosted application, workers performtasks and send completed work orders--automaticallyupdated, stored & forward -linked to all software and to support system
Enterprise Connections
Route Optimization
Linked to dispatch tool, and scheduling tool, sends the right tech. To theright place, at the righttime, doing the right things , reshuffles schedule
Hosted Facility
Hosts the scheduling, dispatching, routing, and database. Houses all servers,TI connections to Carrier - links scheduling, routing,dispatching, hand-helds, and reporting software
4.Reporting Screen
Powerful web-based reporting screen for management of entiresystem. Takes informationfrom hosting site and allowsmanagement to makecritical decisions viewing:inventory, A/R, HRwork process, dispatch,exception routing, issuemanagement, etc.
6.
3.
© DMR Consulting
10Confidential Information
How we Managed Testing the PartsHow we Managed Testing the Parts
Established High Level System Integration & Verification Test Groups and Units
Developed Testing Strategy for Each Functional Segment:
Hand-Held Wireless PenCentra Hardware Tests Dispatcher (Web) User Interface Field Technician (Hand-Held Wireless) In-House Testing Middleware (wireless communication piece) included:
– Work Flow Engine and XML Gateway Stress Testing (200 Hand-Held utilized) Routing Optimization (RiMMS) Testing included
– Associated mapping and address database Operations-Infrastructure Tests Management Reporting (about 30 reports)
© DMR Consulting
12Confidential Information
Integration of Test GroupsIntegration of Test Groups
Tracking Work Orders from the Web Interface to the Wireless Hand-held Unit in our Test Environment
Extensive Parallel Field Tests Team members sent to San Diego and
Dallas/Fort Worth to work with client dispatchers & field technicians
End-to-End Client Acceptance Test From Client databases through our systems and
back to verify accurate data transmissions utilizing client test lab
– Performed as part of system Pilot phase– Also tested our databases—SQL7 to Oracle
© DMR Consulting
13Confidential Information
Master Test Plan Table of ContentsMaster Test Plan Table of Contents
1.INTRODUCTION 1.1Purpose 1.2Document Structure 1.3Project Overview 1.4System Overview 1.5Testing Scope
2.ORGANIZATION & RESPONSIBILITIES 2.1DMR Organization 2.2Test Staffing and Assignments 2.3Additional Personnel & Assignments 2.4Test Team Responsibilities
3.TESTING APPROACH 3.1Environment and Tools
– 3.1.1Test Environment
– 3.1.2Identification of Requirements
– 3.1.3Test Data
– 3.1.4 Daily Builds
– 3.1.5 Testing Tools
– 3.1.6 Version Control
1
3.1.7 Problem Reporting & Change
Control
4.DEFINITION OF TEST COMPONENTS
5.TESTING STRATEGIES 5.1Unit Testing 5.2PenCentra Field Testing 5.3Full System Integration and
Functional Testing 5.3.1Dispatcher Testing 5.3.2 PenCentra In-House
Testing 5.3.3 Middleware & Stress
testing 5.3.4 RiMMS testing
5.4 Operations Infrastructure Test5.5 End-to-End Acceptance Testing5.6 Parallel Field Test5.7 Management Reporting
APPENDIX A - A Guide to PR-Tracker
APPENDIX B - Issues and Triage Process
APPENDIX C - P410G Integration &
Verification Test Groups
© DMR Consulting
14Confidential Information
User Interface Test PlansUser Interface Test Plans
Specific Web Interface (Dispatcher) Test Plan Written to ensure Web interface screens
mapped to functional specs
Updated as change requests came in from client and changes made to interface
Specific Hand-Held Units Test Plan One overall Test Plan to ensure full work order
lifecycle covered
Eight individual Test Plans—one for each type of work order
© DMR Consulting
15Confidential Information
Other Test PlansOther Test Plans
Middleware Test Plan Test Cases and Procedures to isolate specific
functionality requirements of this component Real World Stress from production model
handheld field computers Client side heartbeat for configurable
continuous load
RiMMS Test Plan Data verification through ARROW to RiMMS
relay utilizing SQL Server Stored Procedures Typical business scenarios Verification of RiMMS automation
© DMR Consulting
16Confidential Information
And yet More Test PlansAnd yet More Test Plans
End-to-End Testing Migration of data from client database through
work order pipeline to ARROW and back using both the ARROW test environment and the client test lab
Work Order creation, completion, cancellation, and rescheduling
Work Order Parallel Field Testing Designed to train/coach field personnel in use
of system while testing, using local SMEs Typical business scenarios run through hand-
held units and dispatcher web site while simultaneously using paper system work orders and running a comparison of data accuracy
© DMR Consulting
17Confidential Information
SummarySummary
Extensive variety of Web to Wireless and Infrastructure technical testing solutions
Took full team cooperation Managers System and Functional (Business) Architects Developers Operations Group Client Support And of course, the Test Group & extra folks as
available
30 member Team Work made it happen!!!
© DMR Consulting
18Confidential Information
QUESTIONS?QUESTIONS?
Wed Hosted ASP
Dispatcher
Solution:
• Software
• Hardware
• ARROW Application
• Mobile Devices
• Installation
• Help Desk
• Hosting
Field-Force AutomationManagement Services
ManagementInformation
Work OrderClosure
Work OrderDispatch, Routing,
Scheduling
Field Technician
© DMR Consulting
19Confidential Information
Contact InformationContact Information
Shirley DeLewis, CQA, CSTE, CPSA Director, Software Quality Assurance & Test DMR Consulting, Bellevue, Washington 425-451-3100 [email protected]