Configuration matrix testing using Visual Studio Lab Management

re: Configuration matrix testing using Visual Studio Lab Management

_Betty_ — Fri, 15 Feb 2013 10:10:48 GMT

I found a potential solution using a simple Test Controller plugin - bzbetty.blogspot.co.nz/.../tfs-extensibility-filtering-lab.html

re: Configuration matrix testing using Visual Studio Lab Management

_Betty_ — Wed, 13 Feb 2013 07:08:39 GMT

Thanks for the reply. Yes I was referring to multi-browser testing, unfortunately the CUIT approach doesn't work for multiple versions of IE (without multiple environments) which is really what I want to test. I was hoping to be able to use your work around, but with auto config it would appear not.

Currently investigating disabling agents via code to force the next test run to run in a particular machine, but i might just be stuck making 4+ lab environments.

re: Configuration matrix testing using Visual Studio Lab Management

Ankit — Wed, 13 Feb 2013 02:16:50 GMT

With TFS 2012, you have to manually login on the 2nd role to run the test agent as process after environment creation. But if you are using snapshot/restore functionality, this does not work as auto-configuration of agent will restore it back.

If multiple-browser testing support is what you are looking, have you checked:msdn.microsoft.com/.../jj835758.aspx

and skydrive.live.com/redir

re: Configuration matrix testing using Visual Studio Lab Management

Betty — Tue, 12 Feb 2013 20:15:29 GMT

Have you got an updated version for TFS 2012? The automated configuration of test agents seems to intefere with a setup like this.