Transcript
Page 1: Visual studio alm 2012   reporting overview

Microsoft Visual Studio 2012

Team Foundation Server Reporting

Angela Dugan

ALM Practice Manager

Polaris Solutions

[email protected]

Page 2: Visual studio alm 2012   reporting overview

Angela Dugan

Mobile

Solutions

Project

Leadership

.NET

Solutions

Application

Lifecycle

Management

Page 3: Visual studio alm 2012   reporting overview
Page 4: Visual studio alm 2012   reporting overview

AGENDA

What reporting options are available?

Built-in

Excel

SSRS

What reports come out of the box?

Creating your own reports

Page 5: Visual studio alm 2012   reporting overview

REPORTS BY TEMPLATE

Tasks SCRUM Agile CMMI

Monitor bug activity, reactivations, and trends. Track bugs that the

team is finding and the progress that the team is making toward

fixing them.

• Bug Status Report

• Bug Trends Report

• Reactivations Report

• Bug Status Report

• Bug Trends Report

• Reactivations Report

Monitor build activity, success, and trends. You can use build reports

to track the quality and success of your team's builds over time.

• Build Success Over Time

Report

• Build Summary Report

• Build Quality Indicators Report

• Build Success Over Time

Report

• Build Summary Report

• Build Quality Indicators Report

• Build Success Over Time Report

• Build Summary Report

Track project health, team burn rate, and task completion.

Use to review the level of effort that the team has spent on each

requirement type work items that the team is implementing. By

using this report, you can quickly determine whether any work was

recently completed on each item, what work is remaining and how

far each item has been implemented and tested.

You can review this report daily or weekly to monitor the progress of

the team during an iteration.

• Release Burndown (Scrum)

• Sprint Burndown (Scrum)

• Velocity (Scrum)

• Burndown and Burn Rate

Report (Agile)

• Remaining Work Report

• Status on All Iterations Report

• Stories Overview Report

(Agile)

• Stories Progress Report

(Agile)

• Burndown and Burn Rate Report

(CMMI)

• Remaining Work Report

• Status on All Iterations Report

• Requirements Progress Report

(CMMI)

• Requirements Overview Report

(CMMI)

Determine added work. You can use the Unplanned Work report to

determine how much work the team added to an iteration after it

started.

• Unplanned Work • Unplanned Work

Monitor testing activity. You can use the test reports to track the

team's progress toward developing test cases and to determine how

well they cover the requirement type work items.

• Test Case Readiness

Report

• Test Plan Progress Report

• Test Case Readiness Report

• Test Plan Progress Report

• Test Case Readiness Report

• Test Plan Progress Report

Page 6: Visual studio alm 2012   reporting overview

SCRUM - RELEASE BURNDOWN

U n d e r s t a n d h o w q u i c k l y y o u r t e a m h a s

d e l i v e r e d b a c k l o g i t e m s a n d t r a c k h o w m u c h

w o r k t h e t e a m m u s t s t i l l p e r f o r m t o c o m p l e t e

a p r o d u c t r e l e a s e .

R e v i e w t h e r e p o r t t o d e t e r m i n e t h e p r o g r e s s

t h a t y o u r t e a m h a s m a d e i n a r e l e a s e a n d t o

a n s w e r t h e f o l l o w i n g q u e s t i o n s :

H o w m u c h w o r k r e m a i n s i n t h e r e l e a s e ?

H o w q u i c k l y i s y o u r t e a m w o r k i n g t h r o u g h

t h e p r o d u c t b a c k l o g ?

Page 7: Visual studio alm 2012   reporting overview

SCRUM - SPRINT BURNDOWN

D i s p l a y s t h e f o l l o w i n g p i e c e s o f d a t a :

T h e I d e a l T r e n d l i n e i n d i c a t e s a n i d e a l s i t u a t i o n i n

w h i c h t h e t e a m b u r n s d o w n a l l o f t h e e f f o r t t h a t

r e m a i n s a t a c o n s t a n t r a t e b y t h e e n d o f t h e

s p r i n t .

T h e I n P r o g r e s s s e r i e s s h o w s h o w m a n y h o u r s

r e m a i n f o r t a s k s t h a t a r e m a r k e d a s I n P r o g r e s s i n

a s p r i n t .

T h e T o D o s e r i e s s h o w s h o w m a n y h o u r s r e m a i n

f o r t a s k s t h a t a r e m a r k e d a s T o D o i n a s p r i n t .

R e v i e w t h e r e p o r t t o d e t e r m i n e t h e p r o g r e s s t h a t

y o u r t e a m h a s m a d e i n a r e l e a s e a n d a n s w e r t h e

f o l l o w i n g q u e s t i o n s :

H o w m u c h w o r k r e m a i n s i n t h e s p r i n t ?

I s y o u r t e a m o n t r a c k t o f i n i s h a l l w o r k f o r t h e

s p r i n t ?

W h e n w i l l y o u r t e a m f i n i s h a l l w o r k f o r t h e s p r i n t ?

H o w m u c h w o r k f o r t h e s p r i n t i s i n p r o g r e s s ?

Page 8: Visual studio alm 2012   reporting overview

SCRUM - VELOCITY

B a s e d o n t h e v e l o c i t y o f p r e v i o u s s p r i n t s t h a t

t h e r e p o r t i l l u s t r a t e s , y o u c a n :

T r a c k h o w m u c h e f f o r t y o u r t e a m h a s

r e p o r t e d a s c o m p l e t e f o r e a c h s p r i n t .

E s t i m a t e h o w m u c h b a c k l o g e f f o r t y o u r t e a m

c a n h a n d l e i n f u t u r e s p r i n t s i f y o u r t e a m

c o m p o s i t i o n a n d s p r i n t d u r a t i o n s t a y

c o n s t a n t .

R e v i e w t h e r e p o r t t o d e t e r m i n e h o w m u c h

p r o g r e s s y o u r t e a m h a s m a d e a n d t o a n s w e r t h e

f o l l o w i n g q u e s t i o n s :

H o w m u c h e f f o r t h a s y o u r t e a m c o m p l e t e d i n

e a c h s p r i n t ?

W h a t i s t h e m a x i m u m v e l o c i t y o f y o u r t e a m ?

W h a t i s t h e m i n i m u m v e l o c i t y o f y o u r t e a m ?

W h a t i s t h e a v e r a g e v e l o c i t y o f y o u r t e a m ?

Page 9: Visual studio alm 2012   reporting overview

AGILE - BURNDOWN

Y o u c a n u s e t h i s r e p o r t t o a n s w e r t h e f o l l o w i n g

q u e s t i o n s :

I s t h e t e a m l i k e l y t o f i n i s h t h e i t e r a t i o n o n

t i m e ?

W i l l t h e t e a m c o m p l e t e t h e r e q u i r e d w o r k ,

b a s e d o n t h e c u r r e n t b u r n r a t e ?

W h e n c a n t h e t e a m f i n i s h t h e c u r r e n t i t e r a t i o n ?

H o w m u c h w o r k c a n t h e t e a m c o m p l e t e i n t h e

a v a i l a b l e t i m e ?

H o w m u c h w o r k d o e s e a c h t e a m m e m b e r h a v e ?

H o w f a s t i s t h e t e a m c o m p l e t i n g r e m a i n i n g

w o r k ?

I s t h e t e a m a d d i n g w o r k d u r i n g t h e i t e r a t i o n ?

I s t h e r e s c o p e c r e e p ?

H o w i s t h e w o r k d i s t r i b u te d a c r o s s t h e t e a m ?

Page 10: Visual studio alm 2012   reporting overview

AGILE – REMAINING WORK

N u m b e r o f H o u r s v s . N u m b e r o f W o r k I t e m s

R e v i e w t h e r e p o r t t o d e t e r m i n e t h e p r o g r e s s

w i t h i n a n i t e r a t i o n o r o v e r t i m e . S p e c i f i c a l l y , y o u

c a n f i n d a n s w e r s t o t h e s e q u e s t i o n s :

H o w f a s t i s t h e t e a m b u r n i n g d o w n r e m a i n i n g

w o r k ?

I s w o r k b e i n g a d d e d d u r i n g t h e i t e r a t i o n ? I s t h e

t e a m e x p a n d i n g t h e s c o p e o f t h e w o r k ?

H o w m u c h p r o g r e s s c a n t h e t e a m m a k e i n t h e

a v a i l a b l e t i m e ?

A p p r o x i m a t e l y w h e n c a n t h e t e a m f i n i s h t h e

w o r k ?

I s t o o m u c h w o r k i n p r o g r e s s ?

I s t h e f l o w o f w o r k b e i n g i m p e d e d o r b l o c k e d ?

W h e n w i l l t h e t e a m f i n i s h t h e c u r r e n t i t e r a t i o n ?

Page 11: Visual studio alm 2012   reporting overview

AGILE – ITERATIONS STATUS

T h i s r e p o r t d i s p l a y s t h e f o l l o w i n g i n f o r m a t i o n :

S t o r i e s C l o s e d : n u m b e r o f u s e r s t o r i e s t h a t h a v e

b e e n c l o s e d ; d e r i v e d f r o m t h e c u r r e n t v a l u e s

s p e c i f i e d f o r t h e i t e r a t i o n a n d t h e s t a t e o f e a c h

u s e r s t o r y .

P r o g r e s s ( H o u r s ) : r e p r e s e n t s t h e v a l u e s f o r O r i g i n a l

E s t i m a t e ( g r e y ) , C o m p l e t e d ( g r e e n ) a n d R e m a i n i n g

( l i g h t b l u e ) b a s e d o n t h e r o l l u p o f h o u r s t h a t a r e

d e f i n e d f o r a l l t a s k s ; d e r i v e d f r o m t h e c u r r e n t

v a l u e s t h a t a r e s p e c i f i e d f o r t h e i t e r a t i o n a n d t h e

h o u r s f o r e a c h t a s k .

B u g s : r e p r e s e n t a t i o n f o r a l l b u g s , g r o u p e d b y t h e i r

c u r r e n t s t a t e s o f A c t i v e ( b l u e ) , R e s o l v e d ( g o l d ) a n d

C l o s e d ( g r e e n ) ; d e r i v e d f r o m t h e c u r r e n t v a l u e s t h a t

a r e s p e c i f i e d f o r t h e i t e r a t i o n a n d t h e s t a t e o f e a c h

b u g .

Page 12: Visual studio alm 2012   reporting overview

AGILE– ITERATIONS STATUS

R e v i e w t h e r e p o r t t o d e t e r m i n e h o w m a n y s t o r i e s a r e

r e a d y t o r e l e a s e a n d t o b e t t e r u n d e r s t a n d t h e r a t e o f

t h e t e a m ' s p r o g r e s s . F o r e x a m p l e , y o u c a n f i n d

a n s w e r s t o t h e f o l l o w i n g q u e s t i o n s :

D i d t h e s c o p e o f w o r k f o r e a c h i t e r a t i o n c l o s e l y

m a t c h t h e t e a m c a p a c i t y ?

D o e s t h e n u m b e r o f s t o r i e s c l o s e d i n e a c h i t e r a t i o n

c o r r e s p o n d t o y o u r e x p e c t a t i o n s ?

I s t h e t e a m r e s o l v i n g a n d c l o s i n g m o r e b u g s w i t h

s u c c e s s i v e i t e r a t i o n s ?

H o w m a n y s t o r i e s c a n t h e t e a m s h i p t o d a y ?

T h i s i s B A D ! ! !

Page 13: Visual studio alm 2012   reporting overview

CMMI– BURNDOWN AND BURN RATE

B u r n d o w n s h o w s t h e t r e n d o f c o m p l e t e d a n d

r e m a i n i n g w o r k o v e r a s p e c i f i e d t i m e p e r i o d .

B u r n d o w n

H o w f a s t i s t h e t e a m c o m p l e t i n g r e m a i n i n g

w o r k ?

I s t h e t e a m a d d i n g w o r k d u r i n g t h e i t e r a t i o n ? I s

t h e r e s c o p e c r e e p ?

H o w m u c h w o r k c a n t h e t e a m c o m p l e t e i n t h e

a v a i l a b l e t i m e ?

W h e n c a n t h e t e a m f i n i s h t h e w o r k ?

W h e n c a n t h e t e a m f i n i s h t h e c u r r e n t i t e r a t i o n ?

Page 14: Visual studio alm 2012   reporting overview

CMMI– BURNDOWN AND BURN RATE

B u r n r a t e p r o v i d e s c a l c u l a t i o n s o f t h e c o m p l e t e d

a n d r e q u i r e d r a t e o f w o r k b a s e d o n t h e s p e c i f i e d

t i m e p e r i o d .

B u r n R a t e

I s t h e t e a m w o r k i n g q u i c k l y e n o u g h t o f i n i s h t h e

r e m a i n i n g w o r k o n t i m e ?

W o r k A s s i g n m e n t

H o w i s t h e w o r k d i s t r i b u t e d a c r o s s t h e t e a m ?

S h o u l d t h e t e a m b a l a n c e t h e r e m a i n i n g w o r k

l o a d ?

Page 15: Visual studio alm 2012   reporting overview

CMMI– REMAINING WORK

N u m b e r o f H o u r s v s . N u m b e r o f W o r k I t e m s

Q u e s t i o n s T h a t t h e R e p o r t A n s w e r s

R e v i e w t h e r e p o r t t o d e t e r m i n e t h e p r o g r e s s

w i t h i n a n i t e r a t i o n o r o v e r t i m e . S p e c i f i c a l l y ,

y o u c a n f i n d a n s w e r s t o t h e s e q u e s t i o n s :

H o w f a s t i s t h e t e a m b u r n i n g d o w n r e m a i n i n g

w o r k ?

I s w o r k b e i n g a d d e d d u r i n g t h e i t e r a t i o n ? I s t h e

t e a m e x p a n d i n g t h e s c o p e o f t h e w o r k ?

H o w m u c h p r o g r e s s c a n t h e t e a m m a k e i n t h e

a v a i l a b l e t i m e ?

A p p r o x i m a t e l y w h e n c a n t h e t e a m f i n i s h t h e

w o r k ?

I s t o o m u c h w o r k i n p r o g r e s s ?

I s t h e f l o w o f w o r k b e i n g i m p e d e d o r b l o c k e d ?

W h e n w i l l t h e t e a m f i n i s h t h e c u r r e n t i t e r a t i o n ?

Page 16: Visual studio alm 2012   reporting overview

AD-HOC REPORTS IN MICROSOFT EXCEL

Page 17: Visual studio alm 2012   reporting overview

AD-HOC REPORTS IN MICROSOFT EXCEL

Page 18: Visual studio alm 2012   reporting overview

“REQUIREMENT” PROGRESS - ALL TEMPLATES

Page 19: Visual studio alm 2012   reporting overview

Test % passing…

Code % covered…

Code % changed…

Page 20: Visual studio alm 2012   reporting overview

SHAREPOINT DASHBOARDS

Page 21: Visual studio alm 2012   reporting overview

Bugs are resolved steadily…

Bugs count by person…

Page 22: Visual studio alm 2012   reporting overview

Lines of code tested…

Lines of code changed…

Page 23: Visual studio alm 2012   reporting overview

Task hours getting completed…

Tasks are getting closed…

Page 24: Visual studio alm 2012   reporting overview

Test are passing…

Are the builds healthy?

Bugs reactivations are low…

Page 25: Visual studio alm 2012   reporting overview

RESOURCES

Process Templates Overview: http://msdn.microsoft.com/en-us/library/vstudio/ms400752.aspx

Reports and Artifacts:

Scrum: http://msdn.microsoft.com/en-us/library/vstudio/ff731587.aspx#monitoring

Agile: http://msdn.microsoft.com/en-us/library/vstudio/dd997580.aspx

CMMI: http://msdn.microsoft.com/en-us/library/vstudio/ee332487.aspx

Page 26: Visual studio alm 2012   reporting overview

Process area Visual Studio Scrum 2.0 MSF for Agile v6.0 MSF for CMMI v6.0

Workflow states

• New

• Approved

• Committed

• Done

• Removed

• New

• Active

• Resolved

• Closed

• Removed

• Proposed

• Active

• Resolved

• Closed

Product planning

To customize the backlog pages,

see Customize the Backlog

Pages.

• Bug (Scrum)

• Product Backlog Item (Scrum)

• Agile backlogs

• User Story (Agile)

• Agile backlogs

• Requirement (CMMI)

• Agile backlogs

Task and iteration planning

To customize the task board, see

Customize the Task Board Page.

• Task (Scrum)

• Agile task board

• Task (Agile)

• Agile task board

• Task (CMMI)

• Agile task board

COMPARE & CONTRAST

Page 27: Visual studio alm 2012   reporting overview

Process area Visual Studio Scrum 2.0 MSF for Agile v6.0 MSF for CMMI v6.0

Bug backlog management Bug (Scrum) • Bug (Agile)

• Triage Workbook

• Bug (CMMI)

• Triage Workbook

Project management Impediment (Scrum)• Issue (Agile)

• Issues Workbook

• Issue (CMMI)

• Risk (CMMI)

• Review (CMMI)

• Issues Workbook

Test management• Test Case

• Shared Steps

• Test Case

• Shared Steps

• Test Case

• Shared Steps

Code review and feedback

• Code Review Request

• Code Review Response

• Feedback Request

• Feedback Response

• Code Review Request

• Code Review Response

• Feedback Request

• Feedback Response

• Code Review Request

• Code Review Response

• Feedback Request

• Feedback Response

Audit trail Not supported Minimal Supported

COMPARE & CONTRAST


Recommended