Welcome to MSDN Blogs Sign in | Join | Help

December '07 DevDiv Dogfood Statistics

The massive spike that I've been foreboding for a long while now has started.  In the last month the momentum towards moving the entire division over to TFS has really picked up.  A significant fraction of the branches for the development of the next version of Visual Studio/.NET Framework have been created.  Overall, I expect this ramp up phase will last another 2-3 months - right now a lot of planning is happening; development is slowly ramping up.

Demonstrating this change, you can see an increase of over 32 million in the number of files and 154 million in number of local copies.

Just this week, we are doing training for all of the people in the division who have not yet started using TFS.  I expect the number of recent users will grow every month for the next few months.

Other preparations continue as well.  One of our biggest challenges has been getting the central build lab moved over - both due to the number of tools/scripts and due to the load they put on the system.  Right now we're working on getting their nightly sync times down so that builds complete in a reasonable amount of time.

We've also been struggling with some out of memory problems on the server.  I don't think we thoroughly understand the problem yet.  However, we've learned a few things.  The version control file cache on the server has gotten to 5 million files and the algorithm to manage it has gotten to be slow and very memory intensive.  I think we are going to need to move to an algorithm does not require scanning the file system for age to manage the cache size.

Overall, it still seems to be going reasonably well.  Here are the chart and detailed statistics...

image

image

image

 

Users

  • Recent users: 1,160 (up 63)
  • Users with assigned work items: 3,252 (up 65)
  • Version control users: 2,991 (up 87)

Work Items

  • Work Items: 305,958 (up 7,348)
  • Areas & Iterations: 7,921 (up 115)
  • Work item versions: 2,606,046 (up 62,686)
  • Attached files: 120,835 (up 4,300)
  • Queries: 21,026 (up 484)

Version control

  • Files/Folders: 148,258,991/34,914,899 (up 32,180,349/up 6,996,437)
  • Total compressed file size: 1,639,701 MB (up 139,400 MB)
  • Checkins: 320,961 (up 15,718)
  • Shelvesets: 18,165 (up 1,620)
  • Merge history: 364,731,019 (up 90,041,592)
  • Pending changes: 5,393,525 (down 3,689,144)
  • Workspaces: 5,275 (up 463)
  • Local copies: 862,271,941 (up 154,381,520)

Commands (last 7 days)

  • Work Item queries: 126,851 (down 59,525)
  • Work Item updates: 18,102 (up 3,348)
  • Work Item opens: 41,178 (up 3,244)
  • Gets: 550,374 (up 345,131)
  • Downloads: 67,865,017 (up 25,596,147)
  • Checkins: 11,305 (up 6,156)
  • Uploads: 953,711 (up 149,148)
  • Shelves: 1,544 (up 46)

Brian

Published Thursday, December 06, 2007 9:40 AM by bharry

Comment Notification

If you would like to receive an email when updates are made to this post, please register here

Subscribe to this post's comments using RSS

Comments

# re: December '07 DevDiv Dogfood Statistics

Thursday, December 06, 2007 12:31 PM by Jon

32 million new files? I take it that's a lot of importing existing projects :)

# re: December '07 DevDiv Dogfood Statistics

Thursday, December 06, 2007 1:17 PM by bharry

It's a lot of creation of new branches of the existing source base.

Brian

# December '07 DevDiv Dogfood Statistics

Thursday, December 06, 2007 4:28 PM by { The Smoking Code }

December '07 DevDiv Dogfood Statistics

# December '07 DevDiv Dogfood Statistics

Thursday, December 06, 2007 5:17 PM by Mighell's Mobile Blog

Ne ha parlato ieri Lorenzo all'Application Platform di Milano. Vedere certi numeri è davvero impressionante

# re: December '07 DevDiv Dogfood Statistics

Friday, December 07, 2007 2:39 AM by GertGregers

Just curious, what Tfs version are you currently using?

# re: December '07 DevDiv Dogfood Statistics

Friday, December 07, 2007 9:36 AM by bharry

TFS 2008 with a few additional patches as we uncover issues that need to be address to support the continued server growth.  Those patches will all go in TFS 2008 SP1.

Brian

# re: December '07 DevDiv Dogfood Statistics

Monday, December 10, 2007 4:10 AM by Ray Lin

Are those reports generated by TFS??

What's the HW configuration to support over 2000 developers?

Do you have any load balancing or HA structure to support this?

# VSTS Links - 12/10/2007

Monday, December 10, 2007 7:14 AM by Team System News

The NWCandence blog on Branching Strategies. MRod on tfs workspaces and reinstalling the OS or Team Explorer....

# re: December '07 DevDiv Dogfood Statistics

Monday, December 10, 2007 8:38 AM by bharry

Are those reports generated by TFS??

>> They are generated by a tool we have that runs against TFS.  We are finally close to being ready to release that tool.  Keep your eyes on my blog for further info about it.

What's the HW configuration to support over 2000 developers?

>> It's a 4P dual core (8 cores total) data tier with 32 GB of RAM and a SAN with about 50 spindles.  The AT is a 4P single core with 4 GB of RAM.

Do you have any load balancing or HA structure to support this?

>> No load balancing.  We do have proxies for our remote sites (for performance) and clustering on the data tier (for reliability).

Brian

# TFS dog fooding and memory issue admissions

Friday, December 14, 2007 11:57 PM by Craig Bailey Link Blog

It's always good to see a company use their own product, and when it comes to TFS Microsoft has really

Leave a Comment

(required) 
required 
(required) 
 
Page view tracker