VSTS Tip: threshold violations
Walking my daily gauntlet for you, I was stymied by some seemingly conflicting icons in the load test results viewer:
(experimental image hosting on
imageshack.us - we'll see how it goes)
I expected warning thresholds to be less severe than critical thresholds. In other words, I expect the warning icons to all be lower on the graph than the critical icons. However this did not appear to be the case when I first saw the screenshot. Yet there is an explanation that can justify the seeming contradiction. In the words of a dev on the load testing team:
"The failed request/sec threshold violation is defined as a perctage of the total req/sec. So, it is possible to get the results seen in the screen shot. Notice the green line (total req/sec) drops at 00:30 seconds into the run and generates a critical warning threshold violation because the number failed requests/sec is greater 10% of the total requests per second on that sampling interval."
Clear as water, or clear as mud? :)
