Keith Rowe's WebLog

Project Management and Visual Studio Team System

Reporting

On the long list of exciting new features in Visual Studio Team System is our very rich reporting system.

We are building a single data warehouse with SQL Server that is hosted on the Team Foundation Server.  All the tools are aware of this warehouse and can submit results to it.  We are gathering data from

  • the source code control system
  • the work item tracking system
  • the build engine
  • the test suite manager
  • the code coverage tool
  • the performance monitoring tools

We will expose this interface and schema so third parties can splice their own tools' data into the same warehouse.

Then, we use SQL Reporting Services to assemble reports.  Since we have so much data about the project, the range of reports you can build is pretty rich.  Here's some sample reports we can generate with the alpha code:

  • bug find and fix rates
  • test pass/fail reports
  • code churn
  • code coverage
  • requirements and scenario stability - how much have requirements changed per time period
  • schedule progress - tasks completed and outstanding, mapping plan vs actual

Most of the above can be re-organized by build, by project team, by date as needed.  As we roll out to our own internal dogfooding (using the pre-alpha VSTS on our own team), I expect we'll create a bunch of new reports.  My test manager is salivating at the opportunity to slice and dice this data a dozen new ways.

Since all the projects on one Team Foundation Server feed into the same data warehouse, we can also devise cross-project reports to compare trend lines among projects.  This work is still in development and we haven't come up with good demos of this feature yet.

All of these reports can be surfaced on the SharePoint project site that we create for you, so you can publish your reports broadly to the team and to the stake holders.

We're still crafting the final set of reports that will be in the box.  People are coming to us with great new ideas every day.  What reports would you like to see?

 

Published Friday, June 11, 2004 9:15 AM by KeithRowe

Comments

 

RobCaron's Blog said:

June 11, 2004 3:42 PM
 

SBC said:

June 11, 2004 1:36 PM
 

Keith Rowe said:

We will provide an eventing and notification mechanism. This will allow various tools to raise events about interesting things that are happening and users will be able to subscribe that those they care about.

We will include email notifications in the box, but the extensibility will allow someone to add their own webservice to direct notifications to other delivery systems - including building an RSS feed. That be an interesting "power toy" to include after we ship.
June 14, 2004 4:54 PM
 

Jeroen Bos said:

Requirements - how many additional requirements have been requested per time period.

Budget report - how much money has been spend
(is the project still within his tolerance)


June 16, 2004 11:47 PM
 

Keith Rowe said:


Jeroen,

Good suggestions. We can measure requirement churn with the existing data in the warehouse. In fact, we use that in some of our demos to show how system stability is more than just watching bug counts.

Budgeting is more challenging. How do you track budget data today? Many teams have separate time tracking or accounting systems. Integrating that data in will be more challenging, and for some shops, undesirable.

I hear time tracking requests a lot, though. I may do a separate post on that soon to get more input.
June 17, 2004 7:27 AM
 

Jeroen Bos said:

I currently use Excel as a mean of tracking what the budget is and how many has been spend.

The numbers are coming from our systems which we use to send invoices.


Will the report have the same look at feel as the Scorecard Accelator for SharePoint?

June 17, 2004 11:23 PM
 

Allen Clark said:

There will be a set of reports that you get in the box, and we're looking at some that are score-card-ish. Others provide more, deeper data. If you don't like what you get, though, you'll be able to customize them, and you'll be able to add your own reports.
July 27, 2004 3:07 PM
 

music said:

August 5, 2004 4:36 AM
 

Keith Rowe s WebLog Reporting | Wood TV Stand said:

May 31, 2009 7:34 PM
 

Keith Rowe s WebLog Reporting | work from home said:

June 16, 2009 9:22 AM
 

Keith Rowe s WebLog Reporting | debt solutions said:

June 19, 2009 1:43 PM
Anonymous comments are disabled

© 2009 Microsoft Corporation. All rights reserved. Terms of Use  |  Trademarks  |  Privacy Statement
Microsoft
Page view tracker