Under-specification as the source of ambiguity and vagueness in narrative phenotype algorithm definitions

Yu, Jingzhi; Pacheco, Jennifer A.; Ghosh, Anika S.; Luo, Yuan; Weng, Chunhua; Shang, Ning; Benoit, Barbara; Carrell, David S.; Carroll, Robert J.; Dikilitas, Ozan; Freimuth, Robert R.; Gainer, Vivian S.; Hakonarson, Hakon; Hripcsak, George; Kullo, Iftikhar J.; Mentch, Frank; Peissig, Peggy L.; Ramirez, Andrea H.; Walton, Nephi; Wei, Wei-Qi; Rasmussen, Luke V.

Currently, one of the commonly used methods for disseminating electronic health record (EHR)-based phenotype algorithms is providing a narrative description of the algorithm logic, often accompanied by flowcharts. A challenge with this mode of dissemination is the potential for under-specification in the algorithm definition, which leads to ambiguity and vagueness.

This study examines incidents of under-specification that occurred during the implementation of 34 narrative phenotyping algorithms in the electronic Medical Record and Genomics (eMERGE) network. We reviewed the online communication history between algorithm developers and implementers within the Phenotype Knowledge Base (PheKB) platform, where questions could be raised and answered regarding the intended implementation of a phenotype algorithm.

We developed a taxonomy of under-specification categories via an iterative review process between two groups of annotators. Under-specifications that lead to ambiguity and vagueness were consistently found across narrative phenotype algorithms developed by all involved eMERGE sites.

Discussion and conclusion
Our findings highlight that under-specification is an impediment to the accuracy and efficiency of the implementation of current narrative phenotyping algorithms, and we propose approaches for mitigating these issues and improved methods for disseminating EHR phenotyping algorithms.


  • thumnail for 12911_2022_Article_1759.pdf 12911_2022_Article_1759.pdf application/pdf 272 KB Download File

Also Published In

BMC Medical Informatics and Decision Making

More About This Work

Published Here
August 10, 2022


Electronic Health Records (EHR), Phenotyping, Ambiguity, Vagueness, Under-Specification, Algorithm: Natural Language