Each month, my team gives me an update on our online performance. I will be sharing these reports on my blog. This post covers the January report.
The team uses KeyNote (http://www.keynote.com/) to measure response time and availability of 25+ agents (cities) across the globe. The report focuses on four cities, chosen because they have traditionally represented a distribution from best to worst performance. The cities are: Delhi, Guangzhou, Paris and Seattle.
For the MSDN Library, we measure a single topic across three experiences. The topic is System.Xml and the experiences are:
· Classic – the current default library experience with the deep-tree navigation. Viewable here: http://msdn.microsoft.com/en-us/library/system.xml(classic).aspx
· Scriptfree – an opt-in view that is optimized for performance, no features, just the content. Viewable here: http://msdn.microsoft.com/en-us/library/system.xml(loband).aspx
· Lightweight – a new view that balances features and performance. It will be the default view for Visual Studio 2010 RTM. Viewable here: http://msdn.microsoft.com/en-us/library/system.xml(lightweight).aspx
The table below shows response time and availability for October, November and January. The team has set targets, by city, for red, yellow and green. If any number pops red in a report, the team treats that as an incident and immediately begins working on mitigating the issue. Yellow items result in an investigation and changes to our roadmap.
October-09 (0909)
December-09 (0911)
January-10 (1001)
Target
Response Time (s)
Availability (%)
MSDN Library Classic
Paris
2.92
99.83
2.75
99.79
2.82
99.69
0-2.50<2.51-5.00<5.01
99.9>99.8-99.0>98.9
Guangzhou
3.12
99.77
99.59
3.7
99.52
Delhi
4.37
99.48
Seattle
1.41
99.92
1.24
99.86
1.16
99.91
0-1.50<1.51-3.00<3.01
MSDN Library ScriptFree
1.5
99.9
1.32
99.93
1.37
99.96
1.56
99.87
1.51
1.47
2.29
100
0.6
0.59
0.57
0-0.60<0.61-1.00<1.01
MSDN Library Lightweight
2.63
2.02
1.99
0-2.00<2.01-4.00<4.01
1.94
99.7
1.9
99.76
1.36
1.05
99.62
1.06
0-1.00<1.01-2.00<2.01
To assist in investigating any response time or availability issues, the team also measures a set of key characteristics of the page. The Release numbers (0909, 0910, 0912, etc.) reflect our monthly releases. The MTPS Platform and the Library sites have major releases once a month and small out-of-band releases biweekly.
Release
0909
0910
0912
1001
HTTP Requests (#)
38
44
40
Uncompressed Size (KB)
681
704
763
708
HTTP Requests – CDN (#)
22
28
24
Size - CDN (KB)
420
451
453
445
JavaScript Requests (#)
11
JavaScript Size (KB)
382
395
387
12
13
131
133
137
134
9
10
14
15
1
0
30
31
513
517
491
490
23
17
291
301
298
6
5
277
254