We present our efforts towards extending a taxonomy of uncertainty for suspected pneumonia case review. We manually annotated a random sample of 200 cases of suspected pneumonia at the case level, classifying cases as suspected, unlikely or cannot be determined. Within each document, evidence snippets were annotated that support, refute or are uncertain for suspected pneumonia. Finally we conducted a thematic analysis to classify mentions marked as uncertain applying a taxonomy of uncertainty. We observed substantial variability in human agreement at the evidence snippet level but high agreement for classification of evidence snippets to a taxonomy of uncertainty.
Authors own copyright of their articles appearing in the Online Journal of Public Health Informatics. Readers may copy articles without permission of the copyright owner(s), as long as the author and OJPHI are acknowledged in the copy and the copy is used for educational, not-for-profit purposes. Share-alike: when posting copies or adaptations of the work, release the work under the same license as the original. For any other use of articles, please contact the copyright owner. The journal/publisher is not responsible for subsequent uses of the work, including uses infringing the above license. It is the author's responsibility to bring an infringement action if so desired by the author.