Academic Commons

Presentations (Communicative Events)

V-Measure: A conditional entropy-based external cluster evaluation

Hirschberg, Julia Bell; Rosenberg, Andrew

We present V-measure, an external entropy-based cluster evaluation measure. Vmeasure provides an elegant solution to many problems that affect previously defined cluster evaluation measures including 1) dependence on clustering algorithm or data set, 2) the “problem of matching”, where the clustering of only a portion of data points are evaluated and 3) accurate evaluation and combination of two desirable aspects of clustering, homogeneity and completeness. We compare V-measure to a number of popular cluster evaluation measures and demonstrate that it satisfies several desirable properties of clustering solutions, using simulated clustering results. Finally, we use V-measure to evaluate two clustering tasks: document clustering and pitch accent type clustering.

Files

  • thumnail for rosenberg_hirschberg_07b.pdf rosenberg_hirschberg_07b.pdf application/pdf 205 KB Download File

More About This Work

Academic Units
Computer Science
Publisher
Proceedings of EMNLP
Published Here
July 22, 2013
Academic Commons provides global access to research and scholarship produced at Columbia University, Barnard College, Teachers College, Union Theological Seminary and Jewish Theological Seminary. Academic Commons is managed by the Columbia University Libraries.