bharry's WebLog : TFS Dogfood statistics

Dogfooding TFS 2010 in DevDiv

bharry — Fri, 04 Sep 2009 15:47:03 GMT

As you probably know from my blog that dogfooding (using the product ourselves) is a very important part of our development cycle. We like to use the product early and often and make sure we understand what it's going to be like for our customers.

This have been a pretty big undertaking for TFS. If you've watched my blog over the years, you've seen the journey from just a couple of dozen people up to well over 3,000 people. Along the way we've made a lot of product improvements from what we've learned - particularly with respect to performance and scale.

Mid last year we expanded TFS usage to all of DevDiv on the TFS 2008 SP1 product. It was a pretty painful process and caused some significant disturbances. We did not anticipate the effect of the number of merges of hundreds of thousands of changes every day. That's a whole 'nother subject so I'll just leave it at that. We spent the second half of last year working hard to get TFS performing well under the load of the entire division and by Jan/Feb we were finally successful.

However, the experience made the division a bit skiddish about taking risks with the dogfood server. If it goes down or slows down, it affects over 3,000 people. Around that time, we were also starting to plan for our dogfooding efforts for TFS 2010 and it became clear to me that asking the division (that needs 24x7 reliability) to make multiple upgrades to early pre-release bits just wasn't going to work. We needed a server that we could update about once a month with the latest TFS build that we could use and learn from without affecting the entire division.

Hence was born the "VSTS Pioneer Server". We decided to set up a new server for early dogfooding and to restrict the usage to a much smaller number of people (and people who are really motivated to trying the latest and mostly greatest TFS bits). Because we needed to still participate in the broader DevDiv workflow, we need a bidirectional mirroring system to connect the Pioneer server with the Main DevDiv server. The clear choice was to build this on top of the TFS Migration & Synchronization Toolkit.

Early this year we started that effort and along the way made some pretty substantial improvements to the toolkit. In July the effort finally completed and we rolled out the new VSTS Pioneer server. We've now got about 500 people using it (most of them from the VSTS teams).

Grant Holliday, former Team System MVP turned Team System team member runs the server, manages feedback, deploys new builds, etc. He's started a blog series to talk about his experiences. You can read some great stories here:

http://blogs.msdn.com/granth/archive/2009/08/27/vsts-pioneer-tfs2010-dogfood-server.aspx

Over time we'll increase usage of TFS 2010 and eventually roll it out to the entire division. It's already been a great experience and helped us identify some hard to find issues. Check out Grant's blog to learn more.

Brian

A dogfooding milestone

bharry — Fri, 17 Jul 2009 18:50:18 GMT

This week we hit a notable milestone on the DevDiv TFS dogfood server – 1,000,000 checkins. One of the people on our team put together this graph to demonstrate the trend:

We’re going to be having a little celebration on Monday to commemorate it.

Brian

July ‘09 DevDiv Dogfood Statistics

bharry — Mon, 13 Jul 2009 18:17:46 GMT

It’s been about 6 months since I last posted detailed statistics on the DevDiv TFS dogfood server. Overall it’s been a good 6 months. Early this year we got the bulk of our TFS 2010 branching/merging/scaling changes deployed to the server and they’ve made a a big difference in the scalability challenges we were having last fall. The server’s running pretty well these days.

Later this month we’ll be setting up a second DevDiv dogfood server that will mirror chunks of the “main” server and will be used by the Visual Studio Team System team. This new separate server will exist because we need a way that we can use pretty recent builds without disrupting the work environment for the broader division with frequent updates. I’ll write some more about this in the next few weeks as the rollout progresses.

Here are some things that stand out to me when I look at the numbers:

1) Checkins are way up. My guess is that’s due to the fact that we are in an intense bug fixing period right now and we are probably seeing a whole lot of very small checkins.

2) File downloads are way down. Every since we put in the 3 node proxy to handle the download volume, the download numbers just haven’t been relevant any more. I don’t have any good way to collect statistics from the proxies (they aren’t instrumented as well as the main server is). I think this may be the last report that I include download numbers in because they just aren’t very relevant.

3) Files and Work item versions continue their astonishingly steady climb.

4) Workspaces are way up. In the fall and early this year we were aggressively deleting old unused workspaces in preparation for a series of server upgrades we were doing. We’ve pretty much let them go the last several months so they’ve been piling up.

5) I’ve stopped counting files & folders separately. For one thing the number has gotten huge. Secondly the TFS 2010 schema is less optimized to counting the difference. It basically involves a > 600 million row table scan on our data base and that’s way too long.

Users

Recent users: 3,177 (up 12)
Users with assigned work items: 4,989 (up 227)
Version control users: 7,911 (up 2,353)

Work Items

Work Items: 710,680 (up 148,412)
Areas & Iterations: 12,383 (up 575)
Work item versions: 6,358,545 (up 1,478,148)
Attached files: 382,464 (up 54,459)
Queries: 52,060 (up 12,947)

Version control

Files/Folders: 686,121,239 (up 170,909,714)
Total compressed file size: 5,290,319 MB (up 1,366,710 MB)
Checkins: 992,015 (up 290,114)
Shelvesets: 149,293 (up 62,974)
Merge history: 1,640,660,707 (up 433,097,493)
Pending changes: 49,692,927 (up 11,520,012)
Workspaces: 28,678 (up 10,924)
Local copies: 4,255,597,662 (was 4,040,396,778)

Commands (last 7 days)

Work Item queries: 1,562,228 (up 606,998)
Work Item updates: 59,412 (up 10,168)
Work Item opens: 1,311,384 (up 759,119)
Gets: 687,643 (up 112,917)
Downloads: 23,370,988 (down 6,977,693)
Checkins: 17,576 (up 9,061)
Uploads: 341,514 (up 174,148)
Shelves: 8,634 (up 996)

Brian

DevDiv TFS Database Sizes

bharry — Sun, 31 May 2009 23:18:35 GMT

Someone asked me the other day how big to expect the relative sizes of TFS databases to be. At the time all I had time to say was “Over time TfsVersionControl will dwarf everything else”. This weekend, I finally had a few minutes to sit down and do some analysis. As with all such things, your mileage will vary. DevDiv is a VERY heavy version control user and this may be a bit disproportionate from what you’ll see but as a system grows, I expect it will start to look more and more like this.

Here’s a pie chart that shows you relative sizes:

And here’s the actual numbers:

It’s worth looking at how TfsVersionControl breaks down. Note this won’t match your schema exactly because it is a hybrid TFS 2008/TFS 2010 schema but what I show you will be close.

Brian

Microsoft TFS Adoption Update

bharry — Fri, 16 Jan 2009 23:54:35 GMT

It’s been a while now since I have an overall look at the adoption of TFS at Microsoft. I decided to go ahead and do it this month even though some of the numbers (particularly active users) are a bit skewed by the recent holidays. Regardless, there’s some good data here. One big milestone that we passed recently is more than 50,000,000 distinct source files being managed across the deployment. We have 27 TFS instances in production.

Here’s some charts to show how things are going…

Brian

Jan '09 DevDiv Dogfood Statistics

bharry — Tue, 13 Jan 2009 18:46:27 GMT

It has been a long time since I updated you on DevDiv TFS dogfood usage statistics. Sorry about that - it was a very busy fall. The last update was in September so the deltas in the numbers below reflect changes since then. As you can see usage in most respects continues to grow at a pretty substantial rate. We've added 141 million files in the past 4 months, increasing the count by about 25% - pretty amazing. Work items passed the half a million mark. You'll notice that local copies are down because we've been doing a bunch of work to reduce the size of that table by deleting older workspaces and trimming out unneeded files from others. Remember file download data is now largely meaningless because we use TFS proxies for most of our downloads. At some point I may just remove it from the reporting.

Users

Recent Users: 3,168 (up 367)
Users with assigned work items: 4,760 (up 279)
Version control users: 5,558 (up 591)

Work Items

Work Items: 562,239 (up 71,242)
Areas & Iterations: 11,808 (up 583)
Work item versions: 4,879,999 (up 723,382)
Attached files: 327,996 (up 40,083)
Queries: 39,105 (up 6,425)

Version Control

Files/Folders: 515,211,525/115,956,884 (up 141,882,539/28,271,180)
Total compressed file size: 3,922GB (up 765GB)
Checkins: 701,848 (up 139,688)
Shelvesets: 86,296 (up 28,478)
Merge history: 1,207,563,186 (up 308,379,082)
Pending changes: 38,052,704 (up 2,195,227)
Workspaces: 17,753 (up 2,545)
Local copies: 4,039,557,507 (down 234,560,178)

Builds

Builds: 10,749 (up 3,722)

Commands

Work Item queries: 951,875 (up 197,606)
Work Item updates: 49,217 (down 1,726)
Work Item opens: 551,544 (up 329,167)
Gets: 575,501 (up 137,741)
Downloads: 30,215,899 (down 3,664,958)
Checkins: 8,505 (up 586)
Uploads: 166,997 (down 61,883)
Shelves: 7,611 (up 2,334)

Brian

September '08 DevDiv TFS Dogfood Statistics

bharry — Mon, 15 Sep 2008 17:41:16 GMT

Well, I let it happen again :(. It's been over two months since my last report on this and my blog has gone sadly quiet in general. As I'd mentioned before, it's been an unbelievably busy summer but I think I'm finally coming out of it. With luck you'll see quite a few posts this week and then my stream of 3 or 4 a week resume.

It has also been a very busy period for dogfooding. Pretty much the entire division is on TFS now and it's been an exciting time. One of the things that we've learned over the past several months is that having almost 3,000 people with almost 400,000,000 files in hundreds of branches and dozens of muli-hundred thousand file merges each day puts an inordinate strain on TFS. For the past couple of months we have been working on a fairly significant rework of the way TFS handles renames, deletes and the subsequent merging of those actions. These changes will ship in our Rosario release. Most people will not notice any differences but if you are deep into configuration management, you will. In a few months, I'll explain exactly what those changes are and how you will identify them. We believe, however, that these changes will make a significant performance and experience difference for customers with the largest and most complex configuration management challenges.

In addition to that, we have embarked upon several features that have become bit issues internally, including:

Public workspaces - The ability to mark a workspace as "public" so that multiple people can use it. This has proved to be very important for build lab scenarios where many people need to investigate issues on the same machine and don't want to share login credentials.
Large checkin support - TFS has memory issues on the client and the server and performance issues on the client when trying to check in more than a few hundred thousand files. We are adding support for paging of pending changes and making the client UI lists "virtual" so not all data has to be loaded. A recent test succeeded in checking in over 1,032,000 changed files in a single checkin operation with reasonable load on both the client and server.
tfpt unshelve /undo - We use shelvesets a great deal for code reviews here. People complain that after they have unshelved changes and reviewed them, there is no good way to remove the changes from their local workspace (they may have their own commingled changes they want to keep). tfpt unshelve /undo will show up in the next Power Tools release and will do what it sounds like. It will undo the pending changes from your local workspace that are associated with a specified shelveset.
Larger shelveset comment - Some time ago the checkin comment was expanded from 2K to "unlimited" but the shelveset comment was not. This difference has angered quite a few people when they lost long comments due to shelving truncation. Shelveset comments will also now be "unlimited".

There's more in the hopper but that's what we have tackled for now.

As has been the pattern all summer, usage continues to be up a great deal. In fact, every single metric is up except downloads. The only reason they are down is due to progress in pushing more and more usage of the internal TFS Proxies that we have set up. Perhaps the thing that stands out to me the most is the 4.27 billion rows in the local version table. By anyone's math that is a lot of rows and is a testament to what SQLServer can do. That's more rows than there are values in an unsigned 32-bit number. Yikes!

Users

Recent users: 2,797 (up 839)
Users with assigned work items: 4,481 (up 755)
Version control users: 4,967 (up 1,147)

Work Items

Work Items: 490,997 (up 78,066)
Areas & Iterations: 11,225 (up 1,141)
Work item versions: 4,156,617 (up 700,913)
Attached files: 287,913 (up 43,787)
Queries: 32,680 (up 7,027)

Version control

Files/Folders: 373,328,986/87,685,704 (up 103,546,739/up 23,450,091)
Total compressed file size: 3,157 GB (up 939 GB)
Checkins: 562,160 (up 126,227)
Shelvesets: 57,818 (up 26,401)
Merge history: 899,184,104 (up 247,380,907)
Pending changes: 35,857,477 (up 11,638,442)
Workspaces: 15,208 (up 6,287)
Local copies: 4,274,117,685 (was 2,214,366,807)

Builds

Builds: 7,971 (up 1,816)

Commands (last 7 days)

Work Item queries: 754,269 (up 295,736)
Work Item updates: 50,943 (up 12,515)
Work Item opens: 222,377 (up 9,334)
Gets: 437,760 (up 115,445)
Downloads: 33,880,857 (down 63,177,174)
Checkins: 7,919 (up 1,187)
Uploads: 228,880 (up 118,178)
Shelves: 5,277 (up 2,173)

Brian

July '08 DevDiv TFS Dogfood Statistics

bharry — Thu, 03 Jul 2008 17:02:56 GMT

I missed the June Dogfood statistics - sorry about that. This report represents the change since my last dogfood report in May. The big thing that you will observe is that downloads have dropped dramatically (from a peak around ~150,000,000 to ~50,000,000). The reason for this is that we installed a TFS proxy on our corp net and had the majority of users configure their clients to use it. The proxy is 2 machines configured behind an NLB load balancer. The reason we had to make this configuration change was that during peak hours, downloads were reaching over 1,000 downloads per second. The server simply couldn't service that many requests and the request queue would fill up and start returning "server unavailable" errors to the clients. Adding a proxy allowed us to offload the download volume and keep the request queue from overflowing. We used an NLB proxy "cluster" to avoid having the same request queue overflow problem on the proxy.

The other "big event" in the past month was a move of our server from our data center in Tukwila to our new data center in Quincy, WA. I wish I could say that went smoothly. Transferring over 8 terrabytes of data several hundred miles and building out new server infrastructure for a mission critical server is a daunting task. We hit quite a few bumps along the way and my back side is still sore from the beatings (admittedly deservedly) I took over it. Fortunately, we shouldn't have to do such a thing again soon. One of my big learnings from the process though was that we need a better way to simulate our production environment in a non-production test environment. We really needed to test all of the configuration changes we were making on a reasonably accurate simulation before trying it on the live environment. The problem is that, to clone the hardware, it would cost close to $250K - mostly in the cost of the SAN. Anyway, we've embarked on a process of creating such a test environment (even if it doesn't match the hardware exactly). Hopefully this will smooth any further large scale deployment changes we make down the road. Preventing almost 2,500 people from getting their work done is not a recipe for a long and healthy career :)

Users

Recent users: 2,409 (up 451)
Users with assigned work items: 4,293 (up 567)
Version control users: 4,345 (up 525)

Work Items

Work Items: 446,048 (up 33,117)
Areas & Iterations: 10,536 (up 452)
Work item versions: 3,713,236 (up 257,532)
Attached files: 258,580 (up 14,454)
Queries: 27,944 (up 2,291)

Version control

Files/Folders: 312,965,192/75,535,960 (up 43,182,945/up 11,300,347)
Total compressed file size: 2,607,236 MB (up 389,270 MB)
Checkins: 484,546 (up 48,613)
Shelvesets: 40,028 (up 8,611)
Merge history: 756,402,342 (up 104,599,145)
Pending changes: 39,586,207 (up 15,367,172)
Workspaces: 11,415 (up 2,494)
Local copies: 2,948,671,753 (was 2,214,366,807)

Builds

Builds: 6,524 (up 369)

Commands (last 7 days)

Work Item queries: 564,970 (up 106,437)
Work Item updates: 29,854 (down 8,574)
Work Item opens: 156,578 (down 56,465)
Gets: 792,700 (up 470,385)
Downloads: 52,063,240 (down 44,994,791)
Checkins: 7,247 (up 515)
Uploads: 159,837 (up 49,135)
Shelves: 4,238 (up 1,134)

Brian

May '08 DevDiv TFS Dogfood Statistics

bharry — Mon, 12 May 2008 17:29:47 GMT

Today seems to be blogging day. Here's post #3 of 4 or 5 that are coming today. Sorry for the deluge but it's been a couple of weeks since I blogged.

I think we are finally nearing the end of the full scale roll out of TFS to the Developer Division. Almost everyone working on the next version of VS/.NET are now on TFS. There's some other projects that have not switched yet but I expect most will before too long. The biggest sign of this continued growth is in # of Recent users (up 145). That's 145 more regular users this month than last month.

The other number that staggering (at least to me) is the # of local copies. There are over 2.2 BILLION rows in that table. Wow! That's a lot of data. Last I checked, the DevDev TFS database had gotten to around 8 terra-bytes.

I've started including a new section in this report for Builds. Lots of teams are now using TFS for continuous integration and other buddy build systems, making the numbers start to seem significant.

Here's the graphs to show trends. A big part of why downloads are not continuing to grow is increased usage of proxies. We have found that too many downloads can overwhelm the application tier and block other operations. We started to hit those problems at around 100,000,000 downloads a week (but only during peak hours). Soon we will be deploying a change that allows us to "force" clients to use a proxy. This is a server setting that causes the client to use it Active Directory location to select the appropriate proxy. At that point, the downloads will drop dramatically.

Users

Recent users: 1,958 (up 145)
Users with assigned work items: 3,726 (up 91)
Version control users: 3,820 (up 140)

Work Items

Work Items: 412,931 (up 24,819)
Areas & Iterations: 10,084 (up 379)
Work item versions: 3,455,704 (up 173,764)
Attached files: 244,126 (up 11,853)
Queries: 25,653 (up 1,733)

Version control

Files: 269,782,247 (up 32,956,473)
Folders: 64,235,613 (up 7,849,640)
Total compressed file size: 2,217,966 MB (up 127,435 MB)
Checkins: 435,933 (up 24,762)
Shelvesets: 31,417 (up 3,424)
Merge history: 651,803,197 (up 78,266,752)
Pending changes: 24,219,035 (up 7,381,865)
Workspaces: 8,921 (up 346)
Local copies: 2,214,366,807 (was 2,004,549,728)

Builds

Builds: 6,155 (up 532)

Commands (last 7 days)

Work Item queries: 458,533 (up 81,627)
Work Item updates: 38,428 (up 19,384)
Work Item opens: 213,043 (up 104,217)
Gets: 322,315 (up 73,578)
Downloads: 97,058,031 (down 21,524,757)
Checkins: 6,732 (up 1,014)
Uploads: 110,702 (down 1,614)
Shelves: 3,104 (down 3)

Brian

April '08 DevDiv TFS Dogfood Statistics

bharry — Tue, 15 Apr 2008 20:53:08 GMT

Due to my sabbatical, I missed the March Dogfood statistics. In my absence, adoption has continued apace. The team has been very busy making sure the server is behaving well and applying fixes when it is not.

Looking at the graphs below, you can see that several of the statistics have really started to grow at dramatically higher rates in recent months - File downloads, Files, Workspaces. In fact, the only reason you see file downloads decreasing is that we continue to move more high load users (like the build lab, checkin validation, etc) to use proxies for downloads rather than the main server.

We continue to drive improvements to handle the additional load. Unfortunately, we've had to cut off their incorporation into TFS 2008 SP1. Many many of the improvements made it, but at some point we had to draw a line and we did that a month or two ago. The additional improvements will, of course, make it into the following TFS release. However, I believe you'll find (if you also have a very large server) that the improvements that we've included in SP1 will result in some very nice performance improvements for you.

Here are the detailed numbers. If you look at them closely, you will find that they don't match the difference between what I reported last time and this time. That's because (although I didn't report it), I actually did take a snapshot a month or so ago and these differences are against that snapshot.

Users

Recent users: 1,813 (up 116)
Users with assigned work items: 3,635 (up 123)
Version control users: 3,680 (up 226)

Work Items

Work Items: 388,112 (up 20,245)
Areas & Iterations: 9,705 (up 216)
Work item versions: 3,281,940 (up 185,805)
Attached files: 232,273 (up 10,325)
Queries: 23,920 (up 1,287)

Version control

Files: 236,825,774 (up 30,000,636)
Folders: 56,385,973 (up 6,807,315)
Total compressed file size: 2,090,531 MB (up 163,906 MB)
Checkins: 411,171 (up 36,479)
Shelvesets: 27,993 (up 5,320)
Merge history: 573,536,445 (up 73,745,308)
Pending changes: 16,837,170 (up 6,244,260)
Workspaces: 8,575 (up 1,595)
Local copies: 2,004,549,728 (up 539,146,465)

Commands (last 7 days)

Work Item queries: 376,906 (up 133,484)
Work Item updates: 19,044 (down 8,035)
Work Item opens: 108,826 (up 46,398)
Gets: 248,737 (down 412,995)
Downloads: 118,582,788 (up 16,758,498)
Checkins: 5,718 (up 489)
Uploads: 112,316 (down 54,245)
Shelves: 3,107 (up 962)

Thanks,

Brian

Feb '08 DevDiv TFS Dogfood Statistics

bharry — Sun, 10 Feb 2008 02:07:21 GMT

If you follow my dogfood statistics, you’ll notice that some of the numbers at the bottom are up quite a bit. The +200 recent user bump represents the increase in usage as we approach the completion of the roll out of TFS to the entire division. At this point I'm expecting the roll out to be done within 4 - 6 weeks. There’s been a corresponding increase in Local copies. We’ve also seen significant jumps in merge history as we do more and more of our large tree merges in TFS. The biggest jump is in downloads (almost 2X). This is due to the build lab ramping up. Yesterday, they rolled out config changes to download all files from a TFS Proxy and we should see that number fall substantially in next month’s report.

We continue to refine the perf and scale of TFS. I think not a week goes by these days when we don't push some update (or several) onto the production server to address our latest perf and scale issues. Most of the time it runs quite well but every so often just the right combination of huge (~million file) operations hit a problem and cause the overall server responsiveness to suffer. We're making good progress but it's no consolation when you are staring at the screen waiting for your one file to checkin just because someone else is checking in 400,000 deletes or some such. All of the fixes we make continue to flow into our TFS 2008 SP1 work so you should be able to get them later this year.

Unlike TFS 2005 SP1 and TFS 2008 RTM, I don't think the average user out there will see significant improvements from the additional performance work we're doing in TFS 2008 SP1. Perhaps some small improvements but, at this point, most of the fixes we make are primarily address contention and/or I/O issues in really large scale operations. I know some of our customers do this but the majority do not.

Here's the statistics for this month...

Users

Recent users: 1,442 (up 200)
Users with assigned work items: 3,434 (up 64)
Version control users: 3,289 (up 174)

Work Items

Work Items: 357,964 (up 12,459)
Areas & Iterations: 9,006 (up 722)
Work item versions: 3,013,626 (up 104,498)
Attached files: 216,046 (up 7,082)
Queries: 22,080 (up 660)

Version control

Files/Folders: 189,532,166/44,405,661 (up 21,960,278/up 5,009,562)
Total compressed file size: 1,850,092 MB (up 127,273 MB)
Checkins: 359,635 (up 20,577)
Shelvesets: 20,471 (up 645)
Merge history: 460,256,443 (up 49,113,668)
Pending changes: 10,989,165 (up 4,017,996)
Workspaces: 6,169 (up 153)
Local copies: 1,268,350,414 (up 233,085,191)

Commands (last 7 days)

Work Item queries: 201,039 (up 77,416)
Work Item updates: 24,648 (up 8,949)
Work Item opens: 57,411 (up 13,488)
Gets: 501,590 (up 12,165)
Downloads: 145,120,659 (up 70,546,272)
Checkins: 4,417 (up 201)
Uploads: 204,064 (up 106,420)
Shelves: 2,152 (up 796)

Brian

December '07 DevDiv Dogfood Statistics

bharry — Thu, 06 Dec 2007 17:40:35 GMT

The massive spike that I've been foreboding for a long while now has started. In the last month the momentum towards moving the entire division over to TFS has really picked up. A significant fraction of the branches for the development of the next version of Visual Studio/.NET Framework have been created. Overall, I expect this ramp up phase will last another 2-3 months - right now a lot of planning is happening; development is slowly ramping up.

Demonstrating this change, you can see an increase of over 32 million in the number of files and 154 million in number of local copies.

Just this week, we are doing training for all of the people in the division who have not yet started using TFS. I expect the number of recent users will grow every month for the next few months.

Other preparations continue as well. One of our biggest challenges has been getting the central build lab moved over - both due to the number of tools/scripts and due to the load they put on the system. Right now we're working on getting their nightly sync times down so that builds complete in a reasonable amount of time.

We've also been struggling with some out of memory problems on the server. I don't think we thoroughly understand the problem yet. However, we've learned a few things. The version control file cache on the server has gotten to 5 million files and the algorithm to manage it has gotten to be slow and very memory intensive. I think we are going to need to move to an algorithm does not require scanning the file system for age to manage the cache size.

Overall, it still seems to be going reasonably well. Here are the chart and detailed statistics...

Users

Recent users: 1,160 (up 63)
Users with assigned work items: 3,252 (up 65)
Version control users: 2,991 (up 87)

Work Items

Work Items: 305,958 (up 7,348)
Areas & Iterations: 7,921 (up 115)
Work item versions: 2,606,046 (up 62,686)
Attached files: 120,835 (up 4,300)
Queries: 21,026 (up 484)

Version control

Files/Folders: 148,258,991/34,914,899 (up 32,180,349/up 6,996,437)
Total compressed file size: 1,639,701 MB (up 139,400 MB)
Checkins: 320,961 (up 15,718)
Shelvesets: 18,165 (up 1,620)
Merge history: 364,731,019 (up 90,041,592)
Pending changes: 5,393,525 (down 3,689,144)
Workspaces: 5,275 (up 463)
Local copies: 862,271,941 (up 154,381,520)

Commands (last 7 days)

Work Item queries: 126,851 (down 59,525)
Work Item updates: 18,102 (up 3,348)
Work Item opens: 41,178 (up 3,244)
Gets: 550,374 (up 345,131)
Downloads: 67,865,017 (up 25,596,147)
Checkins: 11,305 (up 6,156)
Uploads: 953,711 (up 149,148)
Shelves: 1,544 (up 46)

Brian

November '07 DevDiv Dogfood Statistics

bharry — Tue, 06 Nov 2007 16:04:52 GMT

It's been a while since I wrote about the DevDiv TFS statistics. Sorry about that, I guess it's just been a really busy summer. Usage continues to climb steadily and we are just now beginning the rollout to the rest of DevDiv. The next version of VS/.NET will be built entirely using TFS - no more usage of the older internal tools. It's been exciting and challenging getting ready for that.

The numbers you'll see below (while much larger than what I published in Aug) are actually quite a bit smaller than what they might have been. We have been doing quite a lot of server clean up in preparation for the broader rollout - deleting old workspaces, destroying unused source branches, deleting old shelvesets, etc. You'll see the effects in some of the graphs below.

We continue to make product improvements based on dogfooding. The vast majority of them over the past 2 years have gone into TFS 2008. We just recently stopped putting them in (because TFS 2008 is almost done) and have started queuing them for TFS 2008 SP1. Just in the last week we've made a few nice improvements for working with really large trees. As an example... I've mentioned before that the build lab gets all of the source (about 3 million files) onto about 75 different machines every night. We found that the initial part of the get operation was taking about 230 seconds to compute what files were needed. After profiling, we found a inefficiency in permission checking that enabled us to reduce that time to about 100 seconds - a nice improvement. This particular one won't make a big difference to most people, most of the time but it's good to keep finding the bottle necks and removing them.

I expect many of the graphs to take big jumps in the next couple of months.

The deltas in these numbers are actually changes from about 1 month ago.

Users

Recent users: 1,097 (up 39)
Users with assigned work items: 3,187 (up 160)
Version control users: 2,904 (up 136)

Work Items

Work Items: 298,610 (up 15,401)
Areas & Iterations: 7,806 (up 105)
Work item versions: 2,543,360 (up 146,757)
Attached files: 116,535 (up 8,964)
Queries: 20,542 (up 840)

Version control

Files/ Folders: 116,078,642/27,918,462 (up 8,278,542/up 3,724,381)
Total compressed file size: 1,500 GB (up 163 GB)
Checkins: 305,243 (up 32,182)
Shelvesets: 16,545 (up 2,317)
Merge history: 274,689,427 (up 23,355,241)
Pending changes: 9,082,669 (up 2,766,941)
Workspaces: 4,812 (down 1,938)
Local copies: 707,890,421 (down 85,555,293)

Commands (last 7 days)

Work Item queries: 186,376 (down 29,118)
Work Item updates: 14,754 (down 8,414)
Work Item opens: 37,934 (down 18,617)
Gets: 205,243 (down 140,891)
Downloads: 42,268,870 (down 1,638,417)
Checkins: 5,149 (up 1,333)
Uploads: 804,563 (up 674,032)
Shelves: 1,498 (up 147)

Brian

Update on Microsoft TFS adoption

bharry — Sat, 15 Sep 2007 18:47:14 GMT

Here's an update on overall TFS adoption at Microsoft. In a bit I expect to blog the latest DevDiv server stats.

Overall adoption continues to grow rapidly. We passed some notable milestones this month:

We have 1,160 Team Projects in production, passing the 1,000 mark
We topped 1 million work items (across all TFS instances) with 1,023,088

Adoption in Office continues strong. Windows adoption is growing but we have hit some pain along the way. They are adopting the same preliminary Rosario build that Office is using and have run into quite a number of installation issues with the Team Explorer client. We've been working through those with them. DevDiv continues preparations for a final and complete switch over to TFS - I'm expecting sometime by around the end of the year.

We now have 24 TFS servers in production. 3 are running a preliminary Rosario build. 17 are running TFS 2008 Beta 2 (see when we say "Go-live" we mean it :)). And 4 are still running TFS 2005 SP1 but will be upgraded to Beta 2 soon.

Here are some interesting graphs to see overall trends...

Brian

August DevDiv Dogfood Statistics

bharry — Tue, 07 Aug 2007 18:43:50 GMT

I think I missed posting dogfood stats last month - sorry about that. It's just been so busy with all of the recent releases going on, it's been difficult to find time to do it.

The “big change” in the past couple of months is that the Visual Studio central build lab is really making progress in enabling support for TFS (rather than using the mirrored legacy system). Some of the substantial increases in activity are due to the load they put on the system. For example, 5.7 million of the 36 million downloads are from the build lab. They’ve also been pushing the system in some ways that it had not previously been pushed. This has led to a handful of bug fixes and performance improvements that have been patched on the dogfood server recently - of course, all of these improvements are being incorporated into TFS 2008. I'm expecting the work to move the build lab over to be done within about a month or so.

Other than the build lab load, normal user load continues to stay moderately flat. I’m expecting that will ramp up over the next few months as we prepare for the next version of Visual Studio, when we will shutdown the legacy system and everyone in the division will be using TFS.

Notable values…

We’ve finally reached 100 million files (actually over 120 million if you count folders too).
The LocalVersion table is at about 700 million rows. The 1 billion mark isn’t too far away.
We passed 250,000 work items.
We recently passed 40 million requests per week for the first time.

And the detailed stats...

Users

Recent users: 1,015 (down 15)
Users with assigned work items: 3,073 (up 157)
Version control users: 2,649 (up 231)

Work Items

Work Items: 268,635 (up 23,239)
Areas & Iterations: 7,575 (up 72)
Work item versions: 2,249,745 (up 205,077)
Attached files: 98,989 (up 11,251)
Queries: 18,936 (up 1,065)

Version control

Files/Folders: 99,559,163/21,692,272 (up 15,613,488/up 3,850,160)
Total compressed file size: 1,170 GB (up 181 GB)
Checkins: 253,993 (up 22,629)
Shelvesets: 12,844 (up 1,745)
Merge history: 232,689,548 (up 38,096,682)
Pending changes: 3,934,204 (up 1,533,477)
Workspaces: 6,224 (up 719)
Local copies: 695,274,358 (up 90,790,224)

Commands (last 7 days)

Work Item queries: 318,036 (down 18,800)
Work Item updates: 31,651 (up 3,495)
Work Item opens: 225,279 (down 115,081)
Gets: 586,788 (up 521,611)
Downloads: 35,919,563 (up 16,712,610)
Checkins: 5,275 (up 3,011)
Uploads: 134,830 (down 225,997)
Shelves: 1,313 (up 381)

Brian