Advanced Load Testing Features of Visual Studio Team System

re: Advanced Load Testing Features of Visual Studio Team System

cwach — Wed, 10 May 2006 21:48:31 GMT

The additional detail on these features is a big help!

re: Advanced Load Testing Features of Visual Studio Team System

wsiebler — Wed, 13 Sep 2006 10:20:22 GMT

Thank you so much for this article. Your advice saved my company thousands of dollars and saved many development hours.

Team Test « PsiSpace by Simon Middlemiss

Team Test « PsiSpace by Simon Middlemiss — Thu, 07 Dec 2006 18:36:11 GMT

PingBack from http://psiman.wordpress.com/2006/12/07/team-test/

re: Advanced Load Testing Features of Visual Studio Team System

jeanvo — Wed, 20 Dec 2006 20:29:20 GMT

Thank you Bill! Got great information here. I am presently evaluating Visual Team Studio for Testers.

Also, I have a couple of question regarding the completion of a load test. Could you help me on that important point?

It seems that when a load test ends all connections stop at the same time. Is there any way to stop a load test properly, when all test iterations are complete? I guess it will be very useful to setup the duration of a load test by the number of test iterations or a combination of number of test iteration and time?

Also, regarding the reporting, it does not seem that I get all counters data during the warm up and due the Hard end of a load test (my previous question) I can't get data of the servers after the test. In other term, I would like to report the status (CPU, RAM etc...) of my servers (WEB, Services and SQL) BEFORE, during and AFTER the load test. it will be certainly easier to identify LEAKS.

Thank you a lot in advance for your precious expertise

Jeanvo

A few Load Testing Resources

Nam, Seungho's Blog — Sat, 27 Jan 2007 11:43:46 GMT

http://msdn.microsoft.com/msdnmag/issues/03/01/LoadTesting/ http://blogs.msdn.com/billbar/pages/517081.asp

re: Advanced Load Testing Features of Visual Studio Team System

suneelp — Fri, 26 Oct 2007 00:54:34 GMT

HI: I am new to VSTS. am trying to understand differences between Users Load in Load test and no.of concurrent users to servers.

Recently, I have to do a load test on web application which has 2 blade servers as backend. My configuration:

Load Test:

=======

Initial User Count = 50

Maximum User Count = 3000

Step Duration = 30 Secs

Step Ramp = 0 secs

Step User Count = 50

SQL Tracing:

==========

Minimum Duration of Traced SQL Operations = 500

SQL Tracing Connect String = <empty>

SQL Tracing Directory = <empty>

SQL Tracing Enabled = False

Timing:

======

Run Duration = 1 Hour

Sample Rate = 5 Secs

Warmup Duration = 30 Secs

WebTest Connections:

WebTest Connection Model = ConnectionPool

WebTest Connection Pool Size = 250

When I ran load test with above configuration, VSTS shows that around 29 minute, it is able to reach the 3000 users BUT Network engineer was saying that they have only 300 user licence. How can 3000 users able to connect to server????

My question is :

1. Is Maximum User Count equal to No.of concurrent users to server? If not. PLEASE PLEASE explain to me.

Thanks in advance

Suneel

re: Advanced Load Testing Features of Visual Studio Team System

billbar@microsoft.com — Mon, 17 Mar 2008 22:57:59 GMT

Sorry for the very delayed response. I'm afraid I don't really look for comments on my blog very often. For questions on Web and load testing, it is best to submit them to the VSTS Web and Load Testing forum at http://forums.microsoft.com/MSDN/ShowForum.aspx?ForumID=1408&SiteID=1.

But to answer your question:

First of all, if the Web tests that your load test contains include think times, and the load test does not turn off think time simulation, then even though there are 3000 load test users, only some portion of the users will be submitting requests to the server at a particular time, because most of the others are thinking (think times are often higher than response times so users spend more time thinking, or viewing the page, filling in a form, which are considered "think time", than they do waiting for a response.

Secondly, because your Connection Model in Connection Pool with a size of 250, the load test will never have more than 250 connections (or send more than 250 concurrent requests) to your server. If you change the connection model to Connection per User, I think you will see that you do run out of licenses if you are really limited to 300 connections.

re: Advanced Load Testing Features of Visual Studio Team System

jason123 — Thu, 05 Jun 2008 02:14:31 GMT

Hi Bill:

I am runing the Visual Studio 2008 web load test. In the load test editor, I enabled the SQL tracing, set the SQL tracing connection string and the SQL tracing directory. I run the load test on my local machine. The SQL database is running on another machine within the same domain. When I run the load test, it popups a window showing: "Could not start SQL tracing: could not create a trace file". Do you know what might be wrong.

FYI, I log in as the domain administrator, who can access the remote database, and the sql trace diretory. The SQL trace directory is mapped as a network drive on my local machine where the load test runs.

Thank you for any help in advance.

re: Advanced Load Testing Features of Visual Studio Team System

jason123 — Thu, 05 Jun 2008 06:12:37 GMT

I found the problem. After I set the proper directory access permission, the web load test can create a SQL trace file.

Thanks anyway.

re: Advanced Load Testing Features of Visual Studio Team System

hcmehta — Sat, 14 Jun 2008 16:16:46 GMT

Hi Bill,

Pls. let me know, how to do SQL Tracing for Load Testing using Microsoft Team System

re: Advanced Load Testing Features of Visual Studio Team System

Gotomeeting Promo Code — Thu, 16 Jul 2009 19:50:54 GMT

Right on the money - my problem has been solved from reading this, my thanks.