GSJGD. Agenda Review of what we delivered in Visual Studio 2010 + enhancements for Visual Studio 11 Paradigm Shift to Exploratory Testing Enhancements

Embed Size (px)

Citation preview

  • Slide 1
  • GSJGD
  • Slide 2
  • Agenda Review of what we delivered in Visual Studio 2010 + enhancements for Visual Studio 11 Paradigm Shift to Exploratory Testing Enhancements in Lab Management
  • Slide 3
  • Slide 4
  • Slide 5
  • Agenda Review of what we delivered in Visual Studio 2010 + enhancements for Visual Studio 11 Paradigm Shift to Exploratory Testing Enhancements in Lab Management
  • Slide 6
  • The Agile Workflow
  • Slide 7
  • Why - Exploratory testing Enables focusing customer value rather than spec compliance Free Testers from up front planning and find bugs fast and early without overhead Focuses on working software!
  • Slide 8
  • Exploratory testing myths 1.Exploratory testing is ad-hoc, random testing 2.There is no way to measure exploratory testing 3.Bugs found through exploratory testing are hard to repro
  • Slide 9
  • Using Testing Tours to put a method to the madness Guidebook tour Back alley tour Supermodel tour You can make up your own Dogfood IDC NAR
  • Slide 10
  • Sample tours how we did it The Reflex tour tests responsiveness of the IDE The Idiot tour tests F1 inline help on each element The Palatial tour tests our multi monitors experience The Footprint tour tests virtual memory usage The Budget tour tests experience on a low end machine Dogfood IDC NAR
  • Slide 11
  • Measuring exploratory testing Right metrics are like a fingerprint of your team: no silver bullet Distinguish between app quality metrics and metrics that direct exploratory testing
  • Slide 12
  • Metrics how we did it Code coverage across tours Story complexity to bugs ratio Session duration for stories Session roll up per tour
  • Slide 13
  • Heat maps how we did it
  • Slide 14
  • Finding reproducible bugs
  • Slide 15
  • Slide 16
  • Rich bugs how we did it Automatic repro steps Screenshots Desktop recording System information Intellitrace logs
  • Slide 17
  • Slide 18
  • Test documentation how we did it Test cases automatically created while doing exploratory testing Can save artifacts from exploration like expected image With each sprint, regression suites are automatically ready
  • Slide 19
  • Slide 20
  • Agenda Review of what we delivered in Visual Studio 2010 + enhancements for Visual Studio 11 Paradigm Shift to Exploratory Testing Enhancements in Lab Management
  • Slide 21
  • Use physical infrastructure Zero Configuration Support for clustered Hyper-V hosts Scale to 1000s of VMs Scale by cloning VMs via Network Isolation New Environment viewer Deploy using deployment scripts Full support SCVMM 2012
  • Slide 22
  • http://blogs.msdn.com/anutthara http://twitter.com/anutthara Q&A Please fill the feedback forms!