Friday, January 14, 2011

Unit Testing with JUnit in DrJava

Summary: Unit testing is a fundamental testing process in the development of object-oriented systems. The module is a primer on using the JUnit unit testing framework that is integrated into DrJava.









Object oriented systems derive great complexity through the interactions between the objects in the system. It is often impossible to test the entire range of the total complex behavior that a system is designed to exhibit. What one can say however is that if any given part of the system does not perform as desired, then one can make no assurances whatsoever about the integrity of the system as a whole. Thus the testing of these smaller parts, or "units" is a crucial element of developing any large-scale OO system. A unit test is a complete test of a small, atomic sub-system. Note that this is not the same from a partial test of some aspect of the whole system!
Unit tests are often performed at the individual class level, meaning that a test class that runs all the complete battery of tests on the tested class, is written for each class to be tested. In some cases however, certain systems of classes are not divisible into isolated, atomic units and in such must be tested as a whole. The key is to test as small a piece of the system as possible and to test it as thoroughly as possible.

Using JUnit in DrJava

Suppose we have a class such as the following that we wish to test. Note that class is public and that the method we wish to test is also public.
Figure 1: Some example code to be tested.
Sample Code To Be Tested
Sample Code To Be Tested (test_class1.png)
In DrJava, select "File/New JUnit Test Case...". Enter a name that is descriptive of the test(s) you wish to make. A recommendation is to use the class name being tested prepended with "Test_", such as "Test_MyClass". This enables all your test classes to be easily identified, DrJava will then automatically create a valid JUnit test class, such as below. (Note that DrJava does not initially name the new class file, but the default name suggested by DrJava when you attempt to save it will be correct.)
Figure 2: Test class autogenerated by DrJava.
Autogenerated Unit Test Class
Autogenerated Unit Test Class (unit_test1.png)
Rename the auto-generated "testX()" method to something more descriptive of the particular test you'd like to perform. The new name must start with "test" and must return voidand take no input parameters. You can create as many test methods as you wish to test your code. JUnit will automatically run all methods that begin with "test" as test methods. Typically, a single test method will test a single method on the class under test. There are situations however where a single method under test may require several test methods to properly test its full range of operation. In the code that follows, the testX() method has been renamed to "test_myMethod1()".

assertEquals(...)

There are a number of ways in which one can test that the proper result is produced. The simplest method is to compare a single output value to an expected value. For instance, suppose you are testing a method that returns a result. One can compare the actual returned value to the value one expects for the given inputs. There are two methods supplied by the junit.framework.TestCase class, which is the superclass of the test class generated by DrJava. The first is void assertEquals(String failResponse, Object actual, Object expected). The actual input parameter is the actual result of the method under test. The expected parameter is the expected result. failResponse is a String that JUnit/DrJava will display if the actual value does not "equal" the expected value. The assertEquals(...) method is overridden such that actual and expected values can be either Objects or primitives. assertEquals(...) uses the equals(...) method of Object to makes it determination. For primitives, the usual == is used. For instance, we could write the test case below. If the actual value does not equal the expected value, assertEquals throws a exception that is caught by the JUnit framework and an error message will result. To test the code, first compile all the code then select the test class. Right-click the test class and select "Test Current Document "or click on "Tools/Test Current Document." The following result will be displayed, given the test code we wrote to purposely fail:
Figure 3: assertEquals(...) displays the error string as well as comparative information if the actual and expected values are not equal.
Using assertEquals(...) in a test case
Using assertEquals(...) in a test case (unit_test2.png)
As shown on the screen shot, DrJava clearly indicates in red the test method that failed and the difference between the expected and actual values. It also highlights the line of code in the test method where the failure occured.
There is one exception to the syntax of assertEquals, and that is when the values being compared are doublesThis is because round-off errors in calculating floating point values means that it is almost always impossible to generate the same value from two different calculations, even if mathematically they are the same. For instance, compate 2.3*2.3 and5.29. Mathematically identical, but on a PC running Windows, Java calculates them to be different by approximately 0.00000000000000089 (or 8.9e-16 in Java syntax). Thus, if the expected and actual values are to be of type double, then a 4'th input parameter is required. This last parameter is a tolerance value, a plus-or-minus amount within which one considers the expected and actual values to be equal. For instance:
assertEquals("Testing doubles: 5.29 vs. 2.3*2.3", 5.29, 2.3*2.3, 9e-16);
should pass, but
assertEquals("Testing doubles: 5.29 vs. 2.3*2.3", 5.29, 2.3*2.3, 8e-16);
should fail. Note that the tolerance value should always be a positive value.

assertTrue(...)

Another method provided by TestCase is void assertTrue(String failResponse, boolean result). This is a simplified version of assertEquals(...) used when the result can be expressed as a boolean true or false. Note that any test using assertTrue can also be written as assertEquals(failResponse, result, true). For instance we could write another test method to test the myMethod2() method of MyClass. The test class now has two test methods and JUnit will run both ot them when we click on "Test Current Document." Here, the second test method passes as shown in green below. The first method still fails and its error messages are still shown. Clicking on the error message will highlight the line where the error occured. Correcting the code in myMethod1(...) would result in all the test methods being listed in green with no error messages.
Figure 4: assertTrue(...) is used in test_myMethod2(...) above and does not generate an error because it is executed with a boolean truevalue.
Using assertTrue(...) in a test method
Using assertTrue(...) in a test method (unit_test3.png)

fail(...)

For more complex testing, TestCase provides the void fail(String failResponse) method. Calling this method will immediately cause the test method to fail and thefailResponse string will be displayed. Since this method does not know the actual or expected results, the failResponse string should contain more detailed information about what exactly failed and how it failed. In the next screen shot is an example of using fail(...) where the test code was written such that it would fail:
Figure 5: The fail(...) method immediately throws an error exception when it is executed.
Using fail(...) in a test method
Using fail(...) in a test method (unit_test4.png)

Additional Capabilities

Note that any test method can call other methods if needed . This is useful when the testing procedure is complex and needs to be broken down into smaller pieces. Do not name these helper methods starting with "test" or they will be run separately as test cases! Using helper methods is also useful when certain types of tests are performed only under certain conditions. assertEquals(...)assertTrue(...) and fail(...) can be called from anywhere, but the DrJava will only highlight the line in the main test method that generated the error, i.e. the line that called the helper method. It will not highlight the line in the helper method where the actual call to assertEquals(...),assertTrue(...) or fail(...)was made.
Sometimes in complex testing scenarios, there is a significant amount of initialization work required to set up the system to be tested. This is often the case when testing a system of interdependent objects where the entire system must be set up before any single object can be tested. If the initialization code is the same for all the tests being conducted, the method protected void setup() can be declared and be used to execute the necessary initializations. To insure "clean" test runs, JUnit/DrJava re-instantiates the test class before running each test method. The setup() method, if it exists, is called before any test method is executed. This means that the test class cannot utilize any internal field values that one test method modifies and another test method expects to use as modified.
Likewise, in the event that after a test is run that significant amounts of common "clean-up" code is required, one can declare the method protected void tearDown(). This method runs after each test method and is useful for insuring, for instance, that files and network connections are properly closed and thus keep them from interfering with other tests.
The help system in DrJava has more detailed information on testing with JUnit, including how to create a test suite of multiple tests.

No comments:

Post a Comment

Related Posts Plugin for WordPress, Blogger...

java

Popular java Topics