WDK Driver Test Manager

OutlineOutlineHCT and the history of driver testingProblems to solveGoals of the WDK Driver Test Manager (DTM)Automated Deployment ToolsPackagerChanges to the Windows Logo Program

The HCT TodayThe HCT TodayHardware Compatibility Test (HCT)

Can only run logo tests provided by MicrosoftUsed for DFW/logo program Content

~1600 Test Cases (400+ binaries)Test Manager (shell)Logo Docs and Test Specs

Testing for Driver qualitySome partners develop their own tests and infrastructureSome partners use only the logo tests for quality testing

What You Told UsWhat You Told UsHCT is not scalable

Adding new technologies is problematicCan’t run non-logo testsCan’t run on more than one machineCan’t run partner tests

Partners must maintain Logo-only infrastructureDedicated hardwareDedicated headcount

Goals of Driver Test Manager (DTM)Goals of Driver Test Manager (DTM)Improve the end user Windows experience

Reduce blue-screensIncrease performanceImprove driver quality

Improve the partner experience Provide MS quality testsAllow partner testsProvide infrastructure to push testing earlier in development cycleReduce submission complexity

Key ConceptsKey Concepts Test Management

StudioDevice Selection and Scheduling

ControllerJobs database

Client Packager

Collaboration toolTests and content delivery

Automated Software Installer (ASI)

AutomationAutomationDatastoreDatastore

DTM ScenarioDTM Scenario

DTM ControllerDTM Controller

Job 0

Log 1

Log 0

Log

SchedulerScheduler

DTM StudioDTM Studio

Test System Test System PoolPool

Job M

anag

emen

t

Device 0Device 0Device 0

My Job

My JobConfig Device x

The gatherers are sent to the test targets to gather information about their devices

The test engineer creates and manages jobs from the studio

The scheduler matches the jobs to the test targets with the appropriate hardware

The jobs and test configuration are sent to the test targets

The tests execute in parallel or in sequence, collecting results in logs

When the tests are complete, the results are sent to the controller where they can be reviewed

After reviewing the results, the test engineer packages all test information and results

The test targets are configured automatically, including a clean install of the OS

The package can be saved so the tests can be duplicated at a later date…

…and shared with customers, OEMs, or submitted to Microsoft

OEMsOEMs

MicrosoftMicrosoft

Driver Test Manager (DTM)Driver Test Manager (DTM)

JobsA collection of 1 or more tasks

Tasks are executables, like “LogoTest.exe”Task dependencies can be created

Setup, Regular, Cleanup

Created, edited and scheduled in StudioSharableConstrainable

DimensionsParameters

Driver Test Manager (DTM)Driver Test Manager (DTM)Scheduler

Matches constraints and test machines (clients)Manages job distribution to Machine pool

Job MonitorPresents status of machines in machine pool (clients)Presents status of jobs in schedulerPresents status of tasks in jobs

Results Explorer Results roll-up viewResults collectionLog viewer

Device SelectionProvides for “Device Based Job Selection” paradigmAdds HCT functionality to the DTMNecessary for Logo Programs

Automated Deployment Tools

Ximage and ASI

Ximage and ASIXimage and ASIXimage

A command line interface to the imaging technology used by Windows codenamed “Longhorn” setupWill create file based image and restore it

Automated Software Installer (ASI)Automate the install of any Windows OS

From disk imagesFrom Windows CDs

Optimized for testing environments

BenefitsIncreased productivityEliminate multi-boot and disk-swapping scenariosManage images and builds for the entire organization in one location

Ximage

System Imaging Tool

Ximage ArchitectureXimage Architecture

Ximage.exe

Wimgapi.dll

File DataImage MetadataMetadata

Header

Tail

Wimfltr.sys

Automated Software Installer

Windows Deployment Tool

ASI FunctionalityASI Functionality

Windows Media or images

ASI Client

ASI Tools

File Share

ASI Database

ASI Client ConfigurationASI Client Configuration

1. PXE Boot1. PXE Boot

3. Safe partition3. Safe partition

2. Bootable media2. Bootable media

Using ASI in the Driver Test ManagerUsing ASI in the Driver Test Manager

Partition 1

“Safe” OS

ASI client

DTM client

Partition 2

Test OS

DTM client

My Job

Config

Log 1

ASI Server DeploymentASI Server Deployment

ASI ClientASI Client

ASI ServerASI Server

Image Cache

Image Cache

ASI ServerASI Server

File ShareASI Database

Ximage and ASI: Which One Should I Use?Ximage and ASI: Which One Should I Use?

XimageA disk imaging tool

Use if you want to restore a test system to exactly the same state multiple times

Use if the bits don’t change regularly

ASIA software deployment solution optimized for testing environments

Use to automate Windows setup

Use if the bits change regularly; testing daily builds for example

What About Ghost?What About Ghost?The DTM will automate any tool with a command line interfaceVirtually everyone is using Ghost images in their testingKeep using your existing imagesConsider moving to Ximage and ASI over timeRealize the benefits of tools optimized for a test environmentXimage and ASI are included in the WDKSome jobs Microsoft provides may require these tools

Packager

Packager ArchitecturePackager Architecture

DTM Studio

DTM Object Model

SQL Datastore

Package A Package B

Benefits of PackagerBenefits of PackagerMove jobs or test data between controllersShare jobs with another organizationShare test results with other organizationsMake a logo submissionSimplified reproduction of failuresUpdate mechanism for the WDK

PackagePackage

DTM ControllerDTM Controller

Packager FunctionalityPackager Functionality

DTM DatastoreCopyCopy

CopyCopy

Package DB

BinariesBinaries BinariesBinaries

Packager Scenarios

ScenarioScenarioCreate Logo PackageCreate Logo Package

Driver Share

Logs, results, machine Logs, results, machine configuration dataconfiguration data

Submit to Submit to MicrosoftMicrosoft

DriversDrivers

DTM ControllerDTM Controller

ScenarioScenarioInvestigate a FailureInvestigate a Failure

Test ClientsTest Clients

Jobs, tests, results, Jobs, tests, results, system configuration data,system configuration data,

crash dumpscrash dumps

Test ClientsTest Clients

StudioStudio

View DataView Data

ImportImport

DTM ControllerDTM Controller DTM ControllerDTM Controller

ScenarioScenarioExport TestsExport Tests

Jobs and testsJobs and tests

Test ClientsTest Clients

ImportImport

DTM ControllerDTM Controller DTM ControllerDTM Controller

ScenarioScenarioPackage logs and resultsPackage logs and results

Results Results and Logsand Logs

Test ClientsTest Clients

StudioStudio

View DataView Data

ImportImport

DTM ControllerDTM Controller

DTM ControllerDTM Controller

Windows XP and Windows Server 2003 Logo Program Support

Windows XP and Windows Server 2003 Windows XP and Windows Server 2003 Logo Program SupportLogo Program Support

Program simplificationReduce the number of HCT tests to about 30One “kit” for all Windows XP and Windows Server 2003 devicesOne “kit” for all Windows XP and Windows Server 2003 systems, excluding datacenter and cluster

Windows XP and Windows Server 2003 kits will be in the DTMHCT and DCT will reach end-of-life when the DTM ships

Call To ActionCall To ActionStart preparing for the WDK nowSign up for the WDK Beta and actively participate

Visit the Windows Driver Kit Page – http://www.microsoft.com/whdc/driver/wdk/default.mspx

Engage with the WDK Team - provide feedback through Microsoft aliases

Additional ResourcesAdditional ResourcesWeb Resources:

Windows Driver and Hardware Central – http://www.microsoft.com/whdc/default.mspxWindows Driver Kit Page – http://www.microsoft.com/whdc/driver/wdk/default.mspx

Email: WDKFB @ microsoft.com for feedback and questions on the WDK

© 2005 Microsoft Corporation. All rights reserved.This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.