Each month, my team gives me an update on our online performance.  I will be sharing these reports on my blog.   This post covers the January report.

 

The team uses KeyNote (http://www.keynote.com/) to measure response time and availability of 25+ agents (cities) across the globe.  The report focuses on four cities, chosen because they have traditionally represented a distribution from best to worst performance.   The cities are: Delhi, Guangzhou, Paris and Seattle.

 

For the MSDN Library, we measure a single topic across three experiences.  The topic is System.Xml and the experiences are:

 

·         Classic – the current default library experience with the deep-tree navigation.  Viewable here: http://msdn.microsoft.com/en-us/library/system.xml(classic).aspx

·         Scriptfree – an opt-in view that is optimized for performance, no features, just the content.  Viewable here: http://msdn.microsoft.com/en-us/library/system.xml(loband).aspx

·         Lightweight – a new view that balances features and performance.  It will be the default view for Visual Studio 2010 RTM.  Viewable here: http://msdn.microsoft.com/en-us/library/system.xml(lightweight).aspx

 

The table below shows response time and availability for October, November and January.  The team has set targets, by city, for red, yellow and green.  If any number pops red in a report, the team treats that as an incident and immediately begins working on mitigating the issue.   Yellow items result in an investigation and changes to our roadmap.

 

 

 

October-09 (0909)

December-09 (0911)

January-10 (1001)

Target

 

 

Response Time (s)

Availability (%)

Response Time (s)

Availability (%)

Response Time (s)

Availability (%)

Response Time (s)

Availability (%)

MSDN Library Classic

Paris

2.92

99.83

2.75

99.79

2.82

99.69

0-2.50<2.51-5.00<5.01

99.9>99.8-99.0>98.9

Guangzhou

3.12

99.77

2.92

99.59

3.7

99.52

0-2.50<2.51-5.00<5.01

99.9>99.8-99.0>98.9

Delhi

 

 

 

 

4.37

99.48

0-2.50<2.51-5.00<5.01

99.9>99.8-99.0>98.9

Seattle

1.41

99.92

1.24

99.86

1.16

99.91

0-1.50<1.51-3.00<3.01

99.9>99.8-99.0>98.9

MSDN Library ScriptFree

Paris

1.5

99.9

1.32

99.93

1.37

99.96

0-1.50<1.51-3.00<3.01

99.9>99.8-99.0>98.9

Guangzhou

1.56

99.87

1.51

99.86

1.47

99.9

0-1.50<1.51-3.00<3.01

99.9>99.8-99.0>98.9

Delhi

 

 

 

 

2.29

100

0-1.50<1.51-3.00<3.01

99.9>99.8-99.0>98.9

Seattle

0.6

99.96

0.59

99.79

0.57

100

0-0.60<0.61-1.00<1.01

99.9>99.8-99.0>98.9

MSDN Library Lightweight

Paris

2.63

99.86

2.02

99.93

1.99

99.9

0-2.00<2.01-4.00<4.01

99.9>99.8-99.0>98.9

Guangzhou

2.63

99.9

1.94

99.7

1.9

99.76

0-2.00<2.01-4.00<4.01

99.9>99.8-99.0>98.9

Seattle

1.36

99.9

1.05

99.62

1.06

100

0-1.00<1.01-2.00<2.01

99.9>99.8-99.0>98.9

 

 

To assist in investigating any response time or availability issues, the team also measures a set of key characteristics of the page.  The Release numbers (0909, 0910, 0912, etc.) reflect our monthly releases.  The MTPS Platform and the Library sites have major releases once a month and small out-of-band releases biweekly.

 

 

 Release

0909

0910

0912

1001

MSDN Library Classic

HTTP Requests (#)

38

44

40

40

Uncompressed Size (KB)

681

704

763

708

HTTP Requests – CDN (#)

22

28

24

24

Size - CDN (KB)

420

451

453

445

JavaScript Requests (#)

11

11

11

11

JavaScript Size (KB)

382

382

395

387

MSDN Library ScriptFree

HTTP Requests (#)

12

13

13

13

Uncompressed Size (KB)

131

133

137

134

HTTP Requests – CDN (#)

9

10

10

10

Size - CDN (KB)

14

15

15

15

JavaScript Requests (#)

1

1

1

1

JavaScript Size (KB)

0

0

0

0

MSDN Library Lightweight

HTTP Requests (#)

30

31

22

22

Uncompressed Size (KB)

513

517

491

490

HTTP Requests – CDN (#)

23

24

17

17

Size - CDN (KB)

291

301

298

298

JavaScript Requests (#)

6

6

5

5

JavaScript Size (KB)

277

277

254

254