How to run tests in a build without test metadata files and test lists (.vsmdi files)

如何在沒有套用 Test Manager(.vsmdi 檔)下仍可採用 Team Build 與整合 Testing

Refines.Info["Polo Lee"] — Sun, 05 Nov 2006 18:06:01 GMT

在執行 Team Build 時，如果要配套 Team Testing, 有個缺點，你必須要先採用 Test Manager 來歸類整理暨有的 Test Case. 這是個美意卻也造成一點缺點，因為如果你安裝的版本

Bye Bye VSMDI

Clark Sell — Mon, 06 Nov 2006 17:39:05 GMT

That blasted VSMDI file. Well Buck, Tom and crew did it. They have finally given us the ability to run

Exactly what I've been waiting for!

Tim Dallmann — Mon, 06 Nov 2006 18:19:51 GMT

Just wanted to pass on a big THANK YOU for putting this together. While we do have team suite in house, I find it much simpler to just include all unit tests within a set of dll's and have them automagically added to the build. I've only just added it to a few of our team builds, but so far it's working flawlessly!

Buck Hodges : How to run tests without test metadata files and test lists (.vsmdi files)

adamga's WebLog — Tue, 07 Nov 2006 03:24:03 GMT

This has always been an issue for my customers! Link to Buck Hodges : How to run tests without test metadata

re: How to run tests without test metadata files and test lists (.vsmdi files)

anutthara — Tue, 07 Nov 2006 08:52:40 GMT

Awesome stuff! Must come in really handy...so, the "all tests" test list need is really obliviated now, ain't it?

Improvements for Continuous Integration using TFS

bharry's WebLog — Tue, 07 Nov 2006 16:27:36 GMT

One of the big complaints we've gotten from customers trying to build a Continuous Integration or similar

Go Ahead Run your Tests in the Build

Dave Lloyd's 2 Cents — Tue, 07 Nov 2006 17:51:43 GMT

Improvements for Continuous Integration using TFS

It's Way Too Early For This — Tue, 07 Nov 2006 18:18:07 GMT

Another project that sounds promising. Like the last, I've heard a lot of noise about this, as well as

Running VSTS Tests without a test list

Ahmed Salijee — Wed, 08 Nov 2006 12:22:24 GMT

I have received this question a couple of times recently. When setting up a Team Build you have the option

re: How to run tests without test metadata files and test lists (.vsmdi files)

bob53050 — Thu, 09 Nov 2006 00:51:55 GMT

YES, this has been a thorn in our side for running tests in our nightly build.

Thanks for your efforts :)

Bob Hanson

re: How to run tests without test metadata files and test lists (.vsmdi files)

David Boss — Thu, 09 Nov 2006 00:58:02 GMT

This is just what we needed. I've been updating those damn test lists on a daily basis just to keep up with our CI.

How many ways can I say thank you!

re: How to run tests without test metadata files and test lists (.vsmdi files)

Thomas — Thu, 09 Nov 2006 15:29:12 GMT

First of all thank you for the task. I have one question:

Using the task i am observing a slightly different behavior in Team Builds build status. Bevor using TestToolsTaskEx (using test lists) Team build sets the build status on a build with some failing tests to "FAILED". With TestToolsTaskEx Team build sets the build status of a build with some tests failung to "Successfully completed".

Is this intended or did i miss something in configuration?

re: How to run tests without test metadata files and test lists (.vsmdi files)

buckh — Fri, 10 Nov 2006 06:42:38 GMT

Thanks for the great feedback, everyone.

Thomas, you are correct. Sorry, I missed that. The difference seems to be a build step that's inserted by the original that's not there when using test containers. I'll look into it and report back.

Buck

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

buckh — Fri, 10 Nov 2006 07:46:55 GMT

Thomas, that was a bug in the original release. I've updated the post and the attachment with the fix.

Thanks for reporting the problem!

Buck

Updated version of new TestToolsTask

Buck Hodges — Fri, 10 Nov 2006 07:59:34 GMT

I've updated the TestToolsTask that supports using test containers, in addition to the test metadata

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

Ralf — Fri, 10 Nov 2006 19:02:55 GMT

Just one Question: What will happen to the Coverage when your Task is used. afik the assemblies for the coverage are namen within the vsmdi file?

Want to run tests in Team Build without vsmdi files or test lists?

Anutthara's WebLog — Fri, 10 Nov 2006 19:26:15 GMT

Buck has an update on his blog that explains how to run unit tests on Team Build without using vsmdi

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

Joe — Fri, 10 Nov 2006 21:09:24 GMT

I know I must be missing something..

But anywyas, I love your add-on, it will be so helpful. But I seem to have lost code coverage when I use it. When I ran the TFS server the old way I had code coverage (same project), so I’m lead to believe that I have set something up wrong. But before I go down the “What did I mess up path “, I want to make sure that your add-on supports code coverage. So is code coverage suppose to work?

Buck Hodges : Running Tests in a Build without Using .VSMDI Files

Rob Caron — Fri, 10 Nov 2006 23:28:22 GMT

If you run tests as an MSBuild task in Team Foundation Build, you will probably be interested in a post

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

buckh — Sat, 11 Nov 2006 06:04:00 GMT

Joe, Dominic Hopton states the following in the forums.

"You need to specify a .testrunconfig file (which has coverage turned on) to get code coverage with team build."

http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=609672&SiteID=1

Buck

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

Jay — Mon, 13 Nov 2006 04:42:18 GMT

Buck, Pardon me but I am new to all of this. Just where am I supposed to specify the .testrunconfig file to use? Is it part of the <TestContainerInOutput> tag?

Jay

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

buckh — Mon, 13 Nov 2006 06:56:41 GMT

Jay, you would need to set the RunConfigFile property to specify the .testrunconfig file (see http://msdn2.microsoft.com/en-us/library/aa721750(VS.80).aspx for a list of all of the TestToolsTask properties).

The TestContainer and TestContainerInOutput tags are used to specify tests without having to use the MetaDataFile and TestLists properties (the VSTS for Testers SKU is required to generate test metadata files and test lists in VS2005).

Buck

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

Joe — Tue, 14 Nov 2006 02:20:04 GMT

Buck,

I had Code Coverage before, so I believe the Config file is correct. But I believe I have figured out the error. The project that does not work, is one of many projects in one Team Project. The problem I believe is that that the system looks for the localtestrun.testrunconfig at the solution root, which is actually a folder above the project folder. This might be something I have done ( to mess this up that is). But I was able to overcome this be specifying the Config location in the vsmdi and then reading it in the build.target. So for every vsmdi that does not work for CC I just point it to the correct file. If this isn’t necessary or I did something totally wrong, please let me know. And once again great add-on.

Thanks,

Joe

Example

Vsmdi

<ConfigLocation>E:\TeamBuilds\MainProj\Build Foo App\Sources\testFoo\localtestrun.testrunconfig</ConfigLocation>

Program Files\MSBuild\Microsoft\VisualStudio\v8.0\TeamBuild\Microsoft.TeamFoundation.Build.targets

<TestToolsTask

Condition=" '$(IsDesktopBuild)'!='true' and '%(TestContainer.Identity)' != '' "

BuildFlavor="$(Flavor)"

Platform="$(Platform)"

PublishServer="$(TeamFoundationServerUrl)"

PublishBuild="$(BuildNumber)"

SearchPathRoot="$(SearchPathRoot)"

PathToResultsFilesRoot="$(TestResultsRoot)"

TestContainers="%(TestContainer.Identity)"

RunConfigFile="$(ConfigLocation)"

TeamProject="$(TeamProject)"

ContinueOnError="true" />

<TestToolsTask

Condition=" '$(IsDesktopBuild)'=='true' and '%(TestContainer.Identity)' != '' "

SearchPathRoot="$(SearchPathRoot)"

PathToResultsFilesRoot="$(TestResultsRoot)"

RunConfigFile="$(ConfigLocation)"

TestContainers="%(TestContainer.Identity)"

ContinueOnError="true" />

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

buckh — Tue, 14 Nov 2006 05:13:11 GMT

Okay, so the .vsmdi file allows the config file location to be specified. Now it makes sense that the behavior would change when you switched away from the .vsmdi file.

So, did you actually modify the .targets file to use the ConfigLocation property, or did you somehow import the setting from the .vsmdi file? Normally, that's the RunConfigFile property (has the same name as the TaskProperty).

Buck

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

Joe — Tue, 14 Nov 2006 18:36:15 GMT

I created a new property in the vsmdi called ConfigLocation and then had the target read that location. I'm not sure where the system was getting the org config location, but once I switched to your add-on it was not looking in the correct spot. So I just over-ridded the location and had it look at the vsmdi's property that I created.

Change in vmsdi (I added this)

<ConfigLocation>E:\TeamBuilds\MainProj\Build Foo App\Sources\testFoo\localtestrun.testrunconfig</ConfigLocation>

Change I did to the target:

RunConfigFile="$(ConfigLocation)"

Hope that makes sense.

Thanks,

Joe

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

buckh — Tue, 14 Nov 2006 19:04:07 GMT

Thanks for the clarification. If the new property were called RunConfigFile rather than ConfigLocation, it would work without changing the .targets file. Alternatively, you could put that setting in the TfsBuild.proj file.

Buck

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

Joe — Wed, 15 Nov 2006 21:46:46 GMT

Woops I said vmsdi. I meant the project file. But anyways, your suggestion works great. Thanks for all your help.

Joe

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

Dylan Smith — Wed, 22 Nov 2006 18:53:25 GMT

How can we specify the location of the testrunconfig file in the TfsBuild.proj file? Can you provide an example?

Thanks,

Dylan

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

buckh — Thu, 23 Nov 2006 07:40:16 GMT

Dylan, you would need to set the RunConfigFile property in your TfsBuild.proj for the build type (via the standard msbuild <PropertyGroup> tag). Team Build will pass that to the TestToolsTask. You can find the documentation on the TestToolsTask's RunConfigFile property at http://msdn2.microsoft.com/en-gb/library/aa721750(VS.80).aspx.

Buck

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

Paul — Wed, 29 Nov 2006 10:56:58 GMT

thank you. I haven't tried it yet, but this was a LARGE annoyance for us since most people here just have Team Editon for developers

More on the Orcas features for Team Build

Buck Hodges — Sat, 02 Dec 2006 08:33:31 GMT

Brian Harry posted a TFS roadmap . I'd like to expand on the portion that describes the features specific

Go Ahead Run your Tests in the Build

Dave Lloyd's 2 Cents — Thu, 04 Jan 2007 01:42:07 GMT

Do you want to be able to run tests in Team Build without having to use a .vsmdi file. Well now you can.

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

volt — Fri, 05 Jan 2007 13:42:43 GMT

this 'hack' is a great thing!

To those who can't make it running properly - make sure you have in your TFSBuild.proj, tag <RunTest>true</RunTest>

On my installation it was false by default :)

TFS: Automating unit tests as part of the Team Build

John Rayner's Blog — Tue, 13 Feb 2007 19:24:01 GMT

In my new project, we're using Team Foundation Server (TFS) as our source code repository and probably

Team Foundation Power Tools version 1.2 (aka TFS Power Toys)

Buck Hodges — Wed, 21 Feb 2007 08:26:58 GMT

We are happy to announce the release of version 1.2 of Team Foundation Power Tools (formerly known as

Run tests from your TFS Team Build without a test list (.vsmdi) with code coverage

Benjamin Day Consulting, Inc.: The Blog — Mon, 19 Mar 2007 21:44:35 GMT

Update to "How to run tests in a build without test metadata files and test lists (.vsmdi files)": Test Categories

Buck Hodges — Sat, 28 Apr 2007 05:04:48 GMT

Pierre Greborio , a developer over in MSTV, has contributed a great new feature to the power tool task

VSTS unit testing and the .VSMDI

Dave Lloyd's 2 Cents — Tue, 19 Jun 2007 20:43:41 GMT

If you have done any serious unit testing with Visual Studio Team System and tried to include these tests

Run Non-

Benjamin Day Consulting, Inc.: The Blog — Thu, 05 Jul 2007 22:17:48 GMT

Run Non-

How to enable code coverage without a test list

Buck Hodges — Fri, 06 Jul 2007 04:14:10 GMT

Aaron pointed out this post by Ben Day that talks about using the RunConfigFile property with a build

How to enable code coverage without a test list

Noticias externas — Fri, 06 Jul 2007 05:08:13 GMT

Aaron pointed out this post by Ben Day that talks about using the RunConfigFile property with a build

Visual Studio Team System Tip of the Week- Build lists not showing up in the build menu #1

Ozzie Rules Blogging — Wed, 26 Mar 2008 01:55:41 GMT

Long ago i learned you really don't get to know your peers/peeps/coworkers until you spend an evening

Team Foundation Build, Part 3: Creating a Build

Fri, 28 Mar 2008 01:51:31 GMT

This post was originally published here . In part 1 and 2 of this series, I gave an overview of Team

【日本語版】（最新版）「テストメタデータファイルやテストリスト (.vsmdi files) を使用せずにビルドでテストを実行する方法」：テストカテゴリ

Microsoft Japan Forum Operators Blog — Tue, 16 Dec 2008 04:27:20 GMT

こんにちは！フォーラムオペレーターの服部清次です。昨日に続きまして、 MSDN フォーラムの Team Foundation Server 関連 FAQ コンテンツで紹介しました英語スレッドの日本語訳をもう

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

ScTest — Tue, 03 Nov 2009 20:02:11 GMT

What part of this is still valid with TFS/Visual Studio 2008?

Thanks.

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

buckh — Wed, 04 Nov 2009 17:22:15 GMT

ScTest, this functionality is built into the 2008 release. In a tfsbuild.proj file generated by 2008, you will find a section with comments about how to use the feature. You can also turn it on during the process of creating a new build definition in 2008.

Buck

How to run tests in a build without test metadata files and test lists (.vsmdi files)

如何在沒有套用 Test Manager(.vsmdi 檔)下仍可採用 Team Build 與 整合 Testing

Bye Bye VSMDI

Exactly what I've been waiting for!

Buck Hodges : How to run tests without test metadata files and test lists (.vsmdi files)

re: How to run tests without test metadata files and test lists (.vsmdi files)

Improvements for Continuous Integration using TFS

Go Ahead Run your Tests in the Build

Improvements for Continuous Integration using TFS

Running VSTS Tests without a test list

re: How to run tests without test metadata files and test lists (.vsmdi files)

re: How to run tests without test metadata files and test lists (.vsmdi files)

re: How to run tests without test metadata files and test lists (.vsmdi files)

re: How to run tests without test metadata files and test lists (.vsmdi files)

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

Updated version of new TestToolsTask

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

Want to run tests in Team Build without vsmdi files or test lists?

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

Buck Hodges : Running Tests in a Build without Using .VSMDI Files

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

More on the Orcas features for Team Build

Go Ahead Run your Tests in the Build

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

TFS: Automating unit tests as part of the Team Build

Team Foundation Power Tools version 1.2 (aka TFS Power Toys)

Run tests from your TFS Team Build without a test list (.vsmdi) with code coverage

Update to "How to run tests in a build without test metadata files and test lists (.vsmdi files)": Test Categories

VSTS unit testing and the .VSMDI

Run Non-

How to enable code coverage without a test list

How to enable code coverage without a test list

Visual Studio Team System Tip of the Week- Build lists not showing up in the build menu #1

Team Foundation Build, Part 3: Creating a Build

【日本語版】 （最新版） 「テスト メタデータ ファイルやテスト リスト (.vsmdi files) を使用せずにビルドでテストを実行する方法」： テスト カテゴリ

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

re: How to run tests in a build without test metadata files and test lists (.vsmdi files)

如何在沒有套用 Test Manager(.vsmdi 檔)下仍可採用 Team Build 與整合 Testing

【日本語版】（最新版）「テストメタデータファイルやテストリスト (.vsmdi files) を使用せずにビルドでテストを実行する方法」：テストカテゴリ