HomeHome

Unit Test Virtualization with VMVM

Jonathan Schaffer Bell; Gail E. Kaiser

Title:
Unit Test Virtualization with VMVM
Author(s):
Bell, Jonathan Schaffer
Kaiser, Gail E.
Date:
Type:
Reports
Department(s):
Computer Science
Persistent URL:
Series:
Columbia University Computer Science Technical Reports
Part Number:
CUCS-021-13
Publisher:
Department of Computer Science, Columbia University
Publisher Location:
New York
Abstract:
Testing large software packages can become very time intensive. To address this problem, researchers have investigated techniques such as Test Suite Minimization. Test Suite Minimization reduces the number of tests in a suite by removing tests that appear redundant, at the risk of reducing fault-finding ability since it can be difficult to identify which tests are truly redundant. We take a completely different approach to solving the same problem of long running test suites by instead reducing the time needed to execute each test, an approach that we call Unit Test Virtualization. We describe the empirical analysis that we performed to ground our approach and provide an implementation of Unit Test Virtualization targeting Java applications. We evaluated our implementation, VMVM, using 20 real-world Java applications and found that it reduces test suite execution time by up to 97 percent (on average, 62 percent) when compared to traditional unit test execution. We also compared VMVM to a well known Test Suite Minimization technique, finding the reduction provided by VMVM to be four times greater, while still executing every test with no loss of fault-finding ability.
Subject(s):
Computer science
Item views
786
Metadata:
text | xml
Suggested Citation:
Jonathan Schaffer Bell, Gail E. Kaiser, , Unit Test Virtualization with VMVM, Columbia University Academic Commons, .

Columbia University Libraries | Policies | FAQ