Academic Commons

Presentations (Communicative Events)

Evaluating the Content and Usability of an Experimental Text Summarization System and Three Web-Based Search Engines

Kan, Min-yen; McKeown, Kathleen; Klavans, Judith L.; Kushniruk, Andre W.; Patel, Vimla L.

This paper describes the evaluation of a new automated text summarization system, Centrifuser. This system provides information to patients and families relevant to their specific health questions. Centrifuser accepts queries about health conditions, and produces a summary of information from articles retrieved by a standard search engine that is tailored to the user's question. The evaluation involved audio- and video-recording of all subject interactions with the interfaces in situ at a hospital. Subjects, consisting of friends or family of hospitalized patients, were asked to “think aloud” as they interacted with Centrifuser and three commonly used search engines: Google, Yahoo, and About.com. Results of the evaluation show that subjects found Centrifuser's summarization capability useful and easy to understand. In comparing Centrifuser to the three search engines, subjects' ratings varied; however, specific interface features were deemed useful across interfaces. We conclude with a discussion of the implications for engineering Web-based retrieval systems.

Files

More About This Work

Academic Units
Computer Science
Publisher
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Published Here
May 10, 2013
Academic Commons provides global access to research and scholarship produced at Columbia University, Barnard College, Teachers College, Union Theological Seminary and Jewish Theological Seminary. Academic Commons is managed by the Columbia University Libraries.