Bill Barnett's blog

Visual Studio Team System - Web and Load Testing

New Load Test and Web Test features in the Orcas release

Here is a summary of just a few of the enhancements to Web testing and load testing coming in the Orcas release of Visual Studio Team System (other team members will be blogging about other enhancements): 

 The Web Test recorder now records AJAX requests and other requests missed by the VSTS 2005 Web Test recorder.   This should mean that you no longer need to use Fiddler to record Web test requests, though Fiddler is still very useful for diagnosing problems recording or replaying Web tests.     Note that dependent requests that will be parsed and automatically submitted when the Web test is run are still not recorded since that would be redundant.

Load Test enhancements

New load model based on user pacing

With this load model, rather than specifying a percentage for each of the tests in one of the load test's scenario, you specify the rate at which each virtual user runs tests.  For example:

    TestA: 4 tests per user/hr
    TestB: 2 tests per user/hr
    TestC: 0.125 tests per user/hr

Virtual users may be idle between running test depending on the pacing and the duration of the individual tests.    With the example above, if each test runs for 1 minute, then each virtual users will be running tests for just 6.125 minutes of every hour.   This more closely simulates the real-world where users of an application come and go while doing other things.

Here is a screen shot of the dialog to specify the pacing:

Load test duration based on test iteration count rather than time

The Orcas release supports the option of running the load test for a fixed number of test iterations rather than a fixed length of time.   This is a load test run setting rather than a scenario setting, so the load test completes onces the total number of tests run in all of the scenarios reaches the specified number of test iterations.

Performance improvements for load tests containing unit tests

The overhead of running unit tests in a load test has been dramatically reduced.   The rate of Tests / Sec that a single load test agent machine can drive has increased by a factor of about 10 when running empty unit tests.     The percentage improvement will be significantly smaller when using unit tests that actually do something.   For a Web service unit test, we measuread an improvement in throughput driven from one load test agent of approximately 25%.

 

 

Published Thursday, June 14, 2007 4:31 PM by billbar@microsoft.com

Comments

 

Team System News said:

Brian Harry on Updated Quescing patch released. Sean Lumley on Orcas Feature: Managing Load Test Results....

June 15, 2007 9:48 AM
 

briankel said:

It's great to see the native support for AJAX! Nice job. :-)

June 15, 2007 3:33 PM
 

Ed Glas's blog on VSTS load testing said:

Lot's of new stuff for web, load, and unit tests in Orcas. Follow the links for more info. Web test ·

June 28, 2007 4:24 PM
 

Testa's Paradise said:

Orcas - Visual Studio Team System 2008 - new features coming for Web and Load testing and a feature of

August 17, 2007 12:49 PM
 

Ravings of a Developer TS said:

Online Help Working with Web Tests Working with Load Tests Working with Controllers, Agents, and Rigs

October 23, 2007 10:44 AM
 

Ed Glas's blog on VSTS load testing said:

Visual Studio Team System for Testers Content Index for Web Tests and Load Tests Getting Started Online

December 17, 2007 12:35 PM
 

洛客 said:

虽然是E文的,但我相信大家的能力,在学习过程中也把英语练了,蛮好的。

July 8, 2008 3:02 AM
Anonymous comments are disabled

© 2008 Microsoft Corporation. All rights reserved. Terms of Use  |  Trademarks  |  Privacy Statement
Microsoft
Page view tracker