Welcome to MSDN Blogs Sign in | Join | Help

October DevDiv TFS Dogfood Statistics

A lot has been happening this last month.  We've pretty much locked down TFS2005 SP1 and have been making good progress on the Orcas release.  A couple of weeks ago I posted about the performance improvements coming in Orcas - the picture there only continues to get better as we continue to find small things to tune.  In the next few weeks (whenever I can get around to finalizing the write up) I plan to post a roadmap for Orcas and the release that follows it, including a pretty comprehensive list of features for Orcas.

We're working to get SP1 deployed on our dogfood server this week.  Most of the fixes have already been deployed as patches but we want to deploy the "official SP" before we ship it to make sure all is well.  We're also working on a plan for when we are going to deploy an Orcas build to the dogfood server and that's looking like it's going to be Dec or Jan.

In the meantime, dogfood server usage continues to grow at a surprisingly fast clip.  Among the notable milestones this month...

  • Frequent users grew by more than 100 to 872
  • The number of work item versions passed the 1,000,000 mark
  • Total activity in the last 7 days hit an all time high of over 31 million requests

Here's a few graphs charting some top line stats...

 

and here's the full list of stats...

 

Users

  • Recent users: 872 (up 130)
  • Users with assigned work items: 2,312 (up 90)
  • Version control users: 1,681 (up 90)

Work items

  • Work items: 131,857 (up 10,000)
  • Areas & Iterations: 6,668 (up 150)
  • Work item versions: 1,051,352 (up 90,000)
  • Attached files: 42,362 (up 4,000)
  • Queries: 12,132 (up 700)

Version control

  • Files/Folders: 62,124,650/12,423,257 (up 7M/1.3M)
  • LocalVersion: 244M (up 43M)
  • Total compressed file sizes: 328.1G (up 33G)
  • Workspaces: 3,039 (up 350)
  • Shelvesets: 4,883 (up 850)
  • Checkins: 133,662 (up 9,000)
  • Pending changes: 984,060 (up 300,000)

Commands (last 7 days)

  • Work Item queries: 575,817 (down 170,000)
  • Work Item updates: 146,113 (up 64,000)
  • Work Item opens: 336,538 (up 61,000)
  • Gets: 159,084 (up 125,000)
  • Downloads: 27.1M (up 13M)
  • Checkins: 2,570 (down 550)
  • Uploads: 109,318 (up 3,500)
  • Shelves: 748 (up 200)

Brian

Published Friday, October 27, 2006 8:55 AM by bharry

Comment Notification

If you would like to receive an email when updates are made to this post, please register here

Subscribe to this post's comments using RSS

Comments

# re: October DevDiv TFS Dogfood Statistics

Friday, October 27, 2006 2:22 PM by Anders Edström

Hi Brian!

What hardware are you using on the DevDiv for your TFS servers?

Rgds,

/Anders

# re: October DevDiv TFS Dogfood Statistics

Saturday, October 28, 2006 10:28 AM by bharry

I'd have sworn that I'd written more about this before but I can't find it.  Here's a post that talks about the disk configuration we are now using: http://blogs.msdn.com/bharry/archive/2006/07/24/676594.aspx

I can't find the precise details of our installation at the moment, but I know the basic stats.  We use a "3" server configuration roughly as follows:

application tier - 2 proc, dual core with 4GB of RAM running 32 Windows 2003

data tier - 4 proc, dual core with 32GB of RAM running 64-bit Windows 2003

analysis server - I don't remember the stats on it but I think it's a modest database server much smaller than the data tier.

Brian

# VSTS Links - 10/30/2006

Monday, October 30, 2006 6:38 AM by Mickey Gousset

Clark Sell on Stop, the build is broken! Noah Coad on VSTS Desktop Wallpaper. Mattias Lindberg...

# VSTS Links - 10/30/2006

Monday, October 30, 2006 6:39 AM by Team System News

Clark Sell on Stop, the build is broken! Noah Coad on VSTS Desktop Wallpaper. Mattias Lindberg...

# re: October DevDiv TFS Dogfood Statistics

Thursday, January 18, 2007 2:48 PM by teedilo

What's the main reason for having 32 GB of RAM for your Data Tier server?  I realize that more memory is better, but Microsoft's own recommendation for the Data Tier box for the largest possible configuration (800 to 2000 users) is only 4 GB.

Any guidelines for determining whether it's important to have a separate Analysis Server would also be appreciated.  Thanks.

# re: October DevDiv TFS Dogfood Statistics

Saturday, January 20, 2007 11:12 AM by bharry

The reason for so much memory has to do with the size of the file set.  Any recommendations for size are inherently flawed because to make them, you have to make a lot of assumptions.  When we put out guidelines, we make the best assumptions we can about what is "typical" and base the guidelines on that.

Our installation isn't typical at all.  For one thing, we sized the hardware for 2,500 people - because that's what we expect to use it eventually.  Secondly, our projects are MUCH larger than is typical.  A single branch is now over 2,000,000 files and the average developer uses 100,000 or more of them at a time.  Further, we do large branches, merges, checkins, etc that frequently involve hundreds of thousands or millions of files.

Lastly, I just wanted to be safe when we speced out the machine.  I wanted a margin of error so that we knew memory would not be a problem.  In truth, based on what I know now, if I were publishing the recommendations today, I'd probably change the 800-2000 config to be 8GB on the data tier.  I think it would be a safer bet.

You can read a post I made a month or so ago about the version control performance improvements we've made for Orcas.  One of the big effects of these improvements is that it should reduce memory pressure of large operations both on the AppTier and DataTier.  I suspect once we get that rolled onto our dogfood server, we could drop our memory to 16GB with no problem but we probably won't since the memory is already in there.

Brian

# re: October DevDiv TFS Dogfood Statistics

Saturday, January 20, 2007 11:16 AM by bharry

Sorry, missed the question about Analysis Server.

I'd start with it on the same server and observe utilization.  We moved it because we have so much data in our warehouse (see my dogfood stats) that AS would run for 20 or 30 minutes rebuilding the cube every hour and we didn't want that much load on the server.

Like I say, I think the best thing to do is observe the behavior and adjust based on what you see.

Brian

Leave a Comment

(required) 
required 
(required) 
 
Page view tracker