Distributed In Vivo Testing of Software Applications

Matt Chu; Christian Murphy; Gail E. Kaiser

Distributed In Vivo Testing of Software Applications
Chu, Matt
Murphy, Christian
Kaiser, Gail E.
Computer Science
Persistent URL:
Columbia University Computer Science Technical Reports
Part Number:
Department of Computer Science, Columbia University
Publisher Location:
New York
The in vivo software testing approach focuses on testing live applications by executing unit tests throughout the lifecycle, including after deployment. The motivation is that the "known state" approach of traditional unit testing is unrealistic; deployed applications rarely operate under such conditions, and it may be more informative to perform the testing in live environments. One of the limitations of this approach is the high performance cost it incurs, as the unit tests are executed in parallel with the application. Here we present distributed in vivo testing, which focuses on easing the burden by sharing the load across multiple instances of the application of interest. That is, we elevate the scope of in vivo testing from a single instance to a community of instances, all participating in the testing process. Our approach is different from prior work in that we are actively testing during execution, as opposed to passively monitoring the application or conducting tests in the user environment prior to execution. We discuss new extensions to the existing in vivo testing framework (called Invite) and present empirical results that show the performance overhead improves linearly with the number of clients.
Computer science
Item views
text | xml
Suggested Citation:
Matt Chu, Christian Murphy, Gail E. Kaiser, , Distributed In Vivo Testing of Software Applications, Columbia University Academic Commons, .

Columbia University Libraries | Policies | FAQ