Deriving Utility from a Self-Healing Benchmark Report

Ritika Virmani; Rean Griffith; Gail E. Kaiser

Deriving Utility from a Self-Healing Benchmark Report
Virmani, Ritika
Griffith, Rean
Kaiser, Gail E.
Technical reports
Computer Science
Persistent URL:
Columbia University Computer Science Technical Reports
Part Number:
Department of Computer Science, Columbia University
Publisher Location:
New York
Autonomic systems, specifically self-healing systems, currently lack an objective and relevant methodology for their evaluation. Due to their focus on problem detection, diagnosis and remediation any evaluation methodology should facilitate an objective evaluation and/or comparison of these activities. Measures of "raw" performance are easily quantified and hence facilitate measurement and comparison on the basis of numbers. However, classifying a system better at problem detection, diagnosis and remediation purely on the basis of performance measures is not useful. The proposed evaluation methodology devised will differ from traditional benchmarks, which are primarily concerned with measures of performance. In order to develop this methodology we rely on a set of experiments which will enable us to compare the self-healing capabilities of one system versus another. As currently we do not have available "real" self-healing systems, we will simulate the behavior of some target self-healing systems, system faults and the operational and repair activities of target systems. Further, we will use the results derived from the simulation experiments to answer questions relevant to the utility of a benchmark report.
Computer science
Item views
text | xml
Suggested Citation:
Ritika Virmani, Rean Griffith, Gail E. Kaiser, , Deriving Utility from a Self-Healing Benchmark Report, Columbia University Academic Commons, .

Columbia University Libraries | Policies | FAQ