Welcome to MSDN Blogs Sign in | Join | Help

Feb '08 DevDiv TFS Dogfood Statistics

If you follow my dogfood statistics, you’ll notice that some of the numbers at the bottom are up quite a bit.  The +200 recent user bump represents the increase in usage as we approach the completion of the roll out of TFS to the entire division.  At this point I'm expecting the roll out to be done within 4 - 6 weeks.  There’s been a corresponding increase in Local copies.  We’ve also seen significant jumps in merge history as we do more and more of our large tree merges in TFS.  The biggest jump is in downloads (almost 2X).  This is due to the build lab ramping up.  Yesterday, they rolled out config changes to download all files from a TFS Proxy and we should see that number fall substantially in next month’s report.

We continue to refine the perf and scale of TFS.  I think not a week goes by these days when we don't push some update (or several) onto the production server to address our latest perf and scale issues.  Most of the time it runs quite well but every so often just the right combination of huge (~million file) operations hit a problem and cause the overall server responsiveness to suffer.  We're making good progress but it's no consolation when you are staring at the screen waiting for your one file to checkin just because someone else is checking in 400,000 deletes or some such.  All of the fixes we make continue to flow into our TFS 2008 SP1 work so you should be able to get them later this year.

Unlike TFS 2005 SP1 and TFS 2008 RTM, I don't think the average user out there will see significant improvements from the additional performance work we're doing in TFS 2008 SP1.  Perhaps some small improvements but, at this point, most of the fixes we make are primarily address contention and/or I/O issues in really large scale operations.  I know some of our customers do this but the majority do not.

Here's the statistics for this month...

image

image

image

Users

  • Recent users: 1,442 (up 200)
  • Users with assigned work items: 3,434 (up 64)
  • Version control users: 3,289 (up 174)

Work Items

  • Work Items: 357,964 (up 12,459)
  • Areas & Iterations: 9,006 (up 722)
  • Work item versions: 3,013,626 (up 104,498)
  • Attached files: 216,046 (up 7,082)
  • Queries: 22,080 (up 660)

Version control

  • Files/Folders: 189,532,166/44,405,661 (up 21,960,278/up 5,009,562)
  • Total compressed file size: 1,850,092 MB (up 127,273 MB)
  • Checkins: 359,635 (up 20,577)
  • Shelvesets: 20,471 (up 645)
  • Merge history: 460,256,443 (up 49,113,668)
  • Pending changes: 10,989,165 (up 4,017,996)
  • Workspaces: 6,169 (up 153)
  • Local copies: 1,268,350,414 (up 233,085,191)

Commands (last 7 days)

  • Work Item queries: 201,039 (up 77,416)
  • Work Item updates: 24,648 (up 8,949)
  • Work Item opens: 57,411 (up 13,488)
  • Gets: 501,590 (up 12,165)
  • Downloads: 145,120,659 (up 70,546,272)
  • Checkins: 4,417 (up 201)
  • Uploads: 204,064 (up 106,420)
  • Shelves: 2,152 (up 796)

Brian

Published Saturday, February 09, 2008 6:07 PM by bharry

Comments

# MSDN Blog Postings » Feb '08 DevDiv TFS Dogfood Statistics

Saturday, February 09, 2008 6:37 PM by MSDN Blog Postings » Feb '08 DevDiv TFS Dogfood Statistics

# re: Feb '08 DevDiv TFS Dogfood Statistics

Monday, February 11, 2008 8:25 AM by Ryan D

I apologize if you have answered this before in a previous dogfood stats post - but how many Team Projects are there across Microsoft?

# re: Feb '08 DevDiv TFS Dogfood Statistics

Monday, February 11, 2008 8:55 AM by bharry

As of the last report I got (within the last month), there were 1,414 and growing at a rate of about 200 per month.

Brian

# VSTS Links - 02/15/2008

Friday, February 15, 2008 8:34 AM by Team System News

Brian Harry on Feb '08 DevDiv TFS Dogfood Statistics. Ajoyk on Tell us how you use Visual Studio Team...

# re: Feb '08 DevDiv TFS Dogfood Statistics

Friday, February 15, 2008 9:36 AM by Knut

How many servers are used?  Do you recommend one server per product group?

# re: Feb '08 DevDiv TFS Dogfood Statistics

Friday, February 15, 2008 9:46 AM by bharry

These statistics are for one server.  However, we have about 25 installed in total here.  How many servers depends on many things.  I would generally recommend different servers for sure when your operations requirements or ownership are different.  Also if you have large projects that have nothing to do with each other, separate servers makes sense.  For example, we use one server for Visual Studio and a different server for Microsoft Office and yet a different one for the Windows team.

Brian

# re: Feb '08 DevDiv TFS Dogfood Statistics

Tuesday, March 04, 2008 6:08 PM by PaulB

Just to add to your peformance data, we have a situation where we have one folder (buried deep) that has over 900 folders in it, and each of those folders has between half a dozen and a dozen files in it.

Dealing with anything within this tree is seriously dog-slow (using 2005/SP1 now).  Endless screen and window refreshes.

Resolves are very slow in this tree as well.  Here's a great example I just ran into.  This is stupid, yes, but it happens:  I manually copied over this tree to a new branch I was working on (in just the file system), as a test for some work I was doing.    At some later point, I did the TFS merge of those files over.  Every single one flagged a conflict of a type "Writable file exists".  Well, yeah.  Oops.  My bad.  So I did the multi-select thing to resolve over 5000 files at once (just doing that took minutes), and told it to "overwrite local file" since I wanted to just pretend like those files hadn't been there (they shoudln't have been, I know).

Well, the resolve process was taking 3-5 seconds PER FILE.  Ridiculously slow.  I tried to cancel it, went to the command line to just ATTRIB /S +R *.* to add the flag, but I couldn't get TFS to notice there were no conflicts any more.  Doing the intial merge took over an hour for it to finish.  The undo took half an hour.  All these times are insane.

I discovered much of the 'resolve' time was spent updating the Pending Changes window one file at a time, rather than batching it up at the end.  I think all that repainting is 90% of the processing time.

Anyway, I've wasted an entire afternoon on this, due to one mess up on my part, and the end result is I still haven't finished the task I started.

# re: Feb '08 DevDiv TFS Dogfood Statistics

Wednesday, March 05, 2008 7:36 AM by bharry

I'm sorry to hear it.  I don't know the specifics of the issue you are hitting but I can make some guesses.  If at all possible, I recommend updating to TFS 2008.  It contained a huge number of perf improvements with a few pervasive schema improvements.

TFS 2008 SP1 is also in the works and it contains yet more improvements.  I believe that by the next major version we will be pretty much done with perf and scale tuning.

Brian

# TFS Dog Food Statistics ... yes it is a scalable solution!

Sunday, March 09, 2008 8:34 AM by Willy-Peter Schaub's Cave of Chamomile Simplicity

If you have wondered whether TFS can scale, whether is it suitable for more than just one project ..

# re: Feb '08 DevDiv TFS Dogfood Statistics

Friday, March 21, 2008 12:51 PM by Bebo

Thank you for providing these statistics. They are very imformative.

I'd like to see some statistics on what project templates used across all the projects. Which ones are used most? How many projects actually use one of the project templates that comes with TFS out-of-the-box.

# re: Feb '08 DevDiv TFS Dogfood Statistics

Sunday, April 20, 2008 11:09 PM by bharry

Most of the divisions in Microsoft have customized the process template they use to match exactly what they need.  I suspect some of the smaller teams use something close to out of the box but what the big teams use has been changed substantially.

In fact, there is a central group in Microsoft for developing and sharing development process best practices and part of that includes providing/consulting on TFS process templates.

We are incorporating some of that into our next version of the process templates.  However, we generally expect any sufficiently sophisticated/large organizations to customize their process template.

Brian

Leave a Comment

(required) 
required 
(required) 
 
Page view tracker