Testing Against Non-Determinism
Although computers tend to be rather deterministic in nature, you will sometimes have to deal with concepts that are de-facto non-deterministic. These include, but are not limited to:
- Random numbers. These are typically generated by a random number generator (such as System.Random).
- Guids. These are generated by a complex algorithm that utilizes the current system time, system properties, etc. Although not a pseudo-random number in itself (it's not designed to follow any particular stochastic distribution), it's virtually impossible to predict the value of a new Guid before its creation.
- Current system time. You never know exactly when your code executes.
When testing code, non-determinism is undesirable, since one of the main principles of automated testing is that test results are reproducable; if you run a unit test suite a number of times without changing the code, the outcomes should all be identical. If your test target contains non-deterministic logic, you may find this principle difficult to uphold. In a small series of postings, I'll provide a few pointers on how to deal with this challenge.
Each post will cover a particular type of non-determinism, and provide examples on how to handle it in unit tests:
- Testing Against Randomness
- Testing Against Guids
- Testing Against The Current Time
- Testing Against The Passage of Time
