Structural Informatics Group (SIG) logo
Home | Projects | Demos | Downloads | Publications | Local Info | About Us
Publications

Processes and Problems in the Formative Evaluation of an Interface to the Foundational Model of Anatomy Knowledge Base

Shapiro, Linda G and Chung, Emily and Detwiler, Landon T and Mejino, Jose L V and Agoncillo, Augusto V and Brinkley, James F and Rosse, Cornelius (2005) Processes and Problems in the Formative Evaluation of an Interface to the Foundational Model of Anatomy Knowledge Base. Journal of the American Medical Informatics Association 12(1):pp. 35-46.

Full text available as:
PDF

Abstract

The Digital Anatomist Foundational Model of Anatomy (FMA) is a large semantic network of more than 100,000 terms that refer to the anatomical entities, which together with 1.6 million structural relationships symbolically represent the physical organization of the human body. Evaluation of such a large knowledge base by domain experts is challenging because of the sheer size of the resource and the need to evaluate not just classes but also relationships. To meet this challenge, the authors have developed a relation-centric query interface, called Emily, that is able to query the entire range of classes and relationships in the FMA, yet is simple to use by a domain expert. Formative evaluation of this interface considered the ability of Emily to formulate queries based on standard anatomy examination questions, as well as the processing speed of the query engine. Results show that Emily is able to express 90% of the examination questions submitted to it and that processing time is generally 1 second or less, but can be much longer for complex queries. These results suggest that Emily will be a very useful tool, not only for evaluating the FMA, but also for querying and evaluating other large semantic networks.

Item Type:Journal (Paginated)
Keywords:medical ontology controlled terminology query engine
Projects:Foundational Model of Anatomy
Subjects:SIG Publications
ID Code:168
Deposited By:Martin, Richard F
Deposited On:08 March 2005