Improving developer tester collaboration with microsoft visual studio 2010

Improving Developer-Tester Collaboration with Microsoft® Visual Studio ® 2010Speaker Name

What are your most common defect resolutions?

Today What If…Cannot Reproduce

Not a Bug

Won’t Fix

…

Fixed

Fixed

…

Won’t Fix

Not a Bug

Cannot Reproduce

Why Can’t a Bug Be Fixed?

− Poorly documentedsteps to reproduce

− Lack of visibility into the tester’s actions

− Environment differences

Developer-Tester Ping-Pong

−Bug is batted back and forth.

−A lot of wasted effort.−Collaboration is low.

3Create actionable bugs

Quickly discover theroot cause of any bug

Automate the discovery of a regression

Create Actionable Bugs

Microsoft® Test Manager 2010

• System Info• IntelliTrace™

•Video Capture• Steps Performed• System Info• IntelliTrace™

Diagnostic Data Adapters

Developers are from Mars,Testers are from Venus.

AnACTIONABLE BUG

contains enough informationthat you are able to take

IMMEDIATE ACTION to fix the bug.

Actionable Bug

demo

Generalist SpecialistManual Testing Some scripting

Creates scripts to set up lab, create data

Strong scripting skills

Some coding skills

Strong coding

Develops fully automated testing procedures

Expert coding skills

Microsoft Approach in VSTS 2010

Black Box Testing

White Box Testing

API Testing

70% of testing happens here

majority of test tools target here

Team Foundation Server Reporting

Web Test Load Test

Coded UI Test Unit Testing

Test Case ManagementLab Management

Microsoft Test Runner

Data Collectors (Historical Debugging, Test Impact, Metrics)

Generalist SpecialistManual Testing Some scripting

Creates scripts to set up lab, create data

Strong scripting skills

Some coding skills

Strong coding

Develops fully automated testing procedures

Expert coding skills

Microsoft Test Capabilities

VSTS 2010 Test Elements

− Test Case Management− Compose test cases, plans

and suites.− Integration with TFS

Manual Test Runner− Standalone tool− Enables execution of test

cases− Collects system data and

event log− Captures still images and

video− Enables filing a new bug

Choose the Right Tests

Choose the Right Tests

− Toggle view:− Impacted Tests− Code Changes

− Run only the necessary tests.

Team Test

− Data driven tests− Validate returned data− Generate Code for the test

(C#, VB, …)

Team Test

Quickly Discover theRoot Cause of Any Bug

“…the realization came over me

with full force that a good part of

the remainder of my life was going

to be spent in finding errors in my

own programs.”

- Maurice Wilkes,

Memoirs of a Computer Pioneer, MIT

Press

IntelliTrace™

IntelliTrace enablescollaboration

between developers and testers by

creating a sharedhistorical

perspective.

Like a DVR for Developers

−Debug history with DVR-like functionality

−Examine code execution

−Identify issues that cause bugs

IntelliTrace™

demo

Automate Functional Testing

70%of all functional testing is still done manually.

Automate Testing with Coded UI Tests

−Automate functional tests.

−Record actions or import action recording from test.

−Easily repeatable.

Coded UI Test

demo

− Create richer actionable bugs.− Environment Snapshots.

− Quickly debug issues in the same environment.− Connect to the test environment

snapshot with network isolation.

− Automate end-to-end workflow− Out of the box build-deploy-test

automation workflow

Partner Solution

TMAP process template integration.

Fortify 360 Program Trace Analysis creates bugs and Work Items in Team Foundation Server.

inteGREAT requirements solution with automatic generation of test cases and test steps.

Extension for Visual Studio to unify Oracle database process within an organization's SDLC.

Extends Visual Studio 2010 Ultimate to profile and diagnose performance issues in JAVA/J2EE applications.

Test maturity process template.

Supports Microsoft Office SharePoint load testing.

Support for COBOL, cross-platform/technology, and third-party line-of-business testing for Visual Studio 2010 test tools.

Visual Studio Test Partners

What will be your most common defect resolution?

Today What If…Cannot Reproduce

Not a Bug

Won’t Fix

…

Fixed

Fixed

…

Won’t Fix

Not a Bug

Cannot Reproduce

3Create actionable bugs

Quickly discover theroot cause of any bug

Automate the discovery of a regression

Questions?

© 2009 Microsoft Corporation. All rights reserved. Microsoft, Visual Studio, the Visual Studio logo, and [list other trademarks referenced] are trademarks of the Microsoft group of companies.

 The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation.  Because Microsoft must respond

to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. 

MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED, OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Appendix

Automation Platform SupportFully supported platform

Partial solution. Further work required in future to complete

Best efforts with known issues. Users can workaround these cases in the code. No major ongoing investment.

Currently no support but on the roadmap for future releases

Currently no support and none planned for now. Opportunity for partners to add this using the Extensibility support. Docs and samples around extensibility are here.

For latest info on this, refer this post.

Platform RTM RTM+ Notes

IE7/8 – HTML/AJAX

Windows Forms 2.0+.NET Fx Controls fully supported, working on 3rd party support

WPF 3.5+.NET Fx Controls fully supported, working on 3rd party support

SharePoint 2007

Windows Win32 TBD – Known issues & Workarounds

MFC TBD – Known issues & Workarounds

FF3 – HTML/AJAX Currently in Beta

Dynamics (Ax) TBD – Release Plan

Silverlight TBD – Release Plan

Citrix/Terminal Services The client (MTLM or VS) need to be on remote machine

Office Client Apps

IE 6 Opportunity for partners to add this using the Extensibility support. Docs and samples around extensibility are here.

Chrome/Opera/Safari

Flash/Java

SAP