I’ve written about the Microsoft Dynamics AX unit testing framework, SysTest, in this blog in the past. The most notable was a post dedicated to reference materials for the framework here. I closed that post, dated February 2008, with “More on SysTest later…”. I doubt that I had over three years later in mind when I wrote that… nevertheless, here we are in 2011.
I’ve had a lot more opportunity to talk directly with members of the AX ecosystem about testing in the past year. While much of that time is spent discussing the coolness that is Visual Studio 2010 testing tools, the testing framework that will be part of its third AX release when Microsoft Dynamics AX 2012 arrives shortly is improving with each release and is still worth discussing. More often than not, it is me who is bringing it up because it’s a very important part of the overall AX testing story.
A recent e-mail discussion with a partner triggered this post. The partner is new to AX testing and was asking for some more resources, particularly about SysTest. After sending him the list of resources from my 2008 post and having him experiment with the framework, he sent me an e-mail that could be summarized as “why should I bother?” He understood the framework, but didn’t see the value proposition of applying the framework after working through the MDSN examples and other examples.
His response demonstrates a gap in what we’re proving to the ecosystem. We do explain the SysTest framework reasonably effectively (in my opinion, certainly open to other feedback). But in order to focus on the framework, our examples are trivial and don’t simulate typical usage. The gap to fill is providing more information on application of the framework to problems that AX ISVs, implementation partners, and customers are solving.
This post if the first step towards filling that gap. Coming back to the question in this post’s title… why bother? I’m going to answer this at a high level for this post and save details for the future.
Notice that I’ve bucketed automated regression tests into two very broad categories – UI and headless. How you go about effective authoring of headless tests using SysTest in AX is coming… and I won’t wait for another 3 years to deliver on that!