J Biomed Inform - A study of terminology auditors' performance for UMLS semantic type assignments.

Tópicos

{ concept(1167) ontolog(924) domain(897) }
{ take(945) account(800) differ(722) }
{ studi(1119) effect(1106) posit(819) }
{ perform(1367) use(1326) method(1137) }
{ high(1669) rate(1365) level(1280) }
{ measur(2081) correl(1212) valu(896) }
{ imag(1057) registr(996) error(939) }
{ structur(1116) can(940) graph(676) }
{ design(1359) user(1324) use(1319) }
{ age(1611) year(1155) adult(843) }
{ survey(1388) particip(1329) question(1065) }
{ imag(2830) propos(1344) filter(1198) }
{ extract(1171) text(1153) clinic(932) }
{ blood(1257) pressur(1144) flow(957) }
{ data(2317) use(1299) case(1017) }
{ group(2977) signific(1463) compar(1072) }
{ activ(1138) subject(705) human(624) }
{ cancer(2502) breast(956) screen(824) }
{ can(774) often(719) complex(702) }
{ system(1976) rule(880) can(841) }
{ surgeri(1148) surgic(1085) robot(1054) }
{ method(1557) propos(1049) approach(1037) }
{ studi(1410) differ(1259) use(1210) }
{ perform(999) metric(946) measur(919) }
{ visual(1396) interact(850) tool(830) }
{ record(1888) medic(1808) patient(1693) }
{ ehr(2073) health(1662) electron(1139) }
{ patient(2837) hospit(1953) medic(668) }
{ first(2504) two(1366) second(1323) }
{ use(2086) technolog(871) perceiv(783) }
{ can(981) present(881) function(850) }
{ estim(2440) model(1874) function(577) }
{ process(1125) use(805) approach(778) }
{ model(3404) distribut(989) bayesian(671) }
{ imag(1947) propos(1133) code(1026) }
{ data(1737) use(1416) pattern(1282) }
{ inform(2794) health(2639) internet(1427) }
{ bind(1733) structur(1185) ligand(1036) }
{ sequenc(1873) structur(1644) protein(1328) }
{ method(1219) similar(1157) match(930) }
{ featur(3375) classif(2383) classifi(1994) }
{ network(2748) neural(1063) input(814) }
{ imag(2675) segment(2577) method(1081) }
{ patient(2315) diseas(1263) diabet(1191) }
{ studi(2440) review(1878) systemat(933) }
{ motion(1329) object(1292) video(1091) }
{ assess(1506) score(1403) qualiti(1306) }
{ treatment(1704) effect(941) patient(846) }
{ framework(1458) process(801) describ(734) }
{ problem(2511) optim(1539) algorithm(950) }
{ error(1145) method(1030) estim(1020) }
{ chang(1828) time(1643) increas(1301) }
{ learn(2355) train(1041) set(1003) }
{ clinic(1479) use(1117) guidelin(835) }
{ algorithm(1844) comput(1787) effici(935) }
{ data(1714) softwar(1251) tool(1186) }
{ control(1307) perform(991) simul(935) }
{ model(2220) cell(1177) simul(1124) }
{ care(1570) inform(1187) nurs(1089) }
{ general(901) number(790) one(736) }
{ method(984) reconstruct(947) comput(926) }
{ search(2224) databas(1162) retriev(909) }
{ featur(1941) imag(1645) propos(1176) }
{ case(1353) use(1143) diagnosi(1136) }
{ howev(809) still(633) remain(590) }
{ data(3963) clinic(1234) research(1004) }
{ risk(3053) factor(974) diseas(938) }
{ research(1085) discuss(1038) issu(1018) }
{ system(1050) medic(1026) inform(1018) }
{ import(1318) role(1303) understand(862) }
{ model(2341) predict(2261) use(1141) }
{ compound(1573) activ(1297) structur(1058) }
{ spatial(1525) area(1432) region(1030) }
{ health(3367) inform(1360) care(1135) }
{ model(3480) simul(1196) paramet(876) }
{ monitor(1329) mobil(1314) devic(1160) }
{ state(1844) use(1261) util(961) }
{ research(1218) medic(880) student(794) }
{ model(2656) set(1616) predict(1553) }
{ medic(1828) order(1363) alert(1069) }
{ signal(2180) analysi(812) frequenc(800) }
{ cost(1906) reduc(1198) effect(832) }
{ sampl(1606) size(1419) use(1276) }
{ gene(2352) biolog(1181) express(1162) }
{ data(3008) multipl(1320) sourc(1022) }
{ intervent(3218) particip(2042) group(1664) }
{ time(1939) patient(1703) rate(768) }
{ patient(1821) servic(1111) care(1106) }
{ analysi(2126) use(1163) compon(1037) }
{ health(1844) social(1437) communiti(874) }
{ use(976) code(926) identifi(902) }
{ use(1733) differ(960) four(931) }
{ drug(1928) target(777) effect(648) }
{ result(1111) use(1088) new(759) }
{ implement(1333) system(1263) develop(1122) }
{ decis(3086) make(1611) patient(1517) }
{ activ(1452) weight(1219) physic(1104) }
{ method(1969) cluster(1462) data(1082) }
{ method(2212) result(1239) propos(1039) }
{ detect(2391) sensit(1101) algorithm(908) }

Resumo

Auditing healthcare terminologies for errors requires human experts. In this paper, we present a study of the performance of auditors looking for errors in the semantic type assignments of complex UMLS concepts. In this study, concepts are considered complex whenever they are assigned combinations of semantic types. Past research has shown that complex concepts have a higher likelihood of errors. The results of this study indicate that individual auditors are not reliable when auditing such concepts and their performance is low, according to various metrics. These results confirm the outcomes of an earlier pilot study. They imply that to achieve an acceptable level of reliability and performance, when auditing such concepts of the UMLS, several auditors need to be assigned the same task. A mechanism is then needed to combine the possibly differing opinions of the different auditors into a final determination. In the current study, in contrast to our previous work, we used a majority mechanism for this purpose. For a sample of 232 complex UMLS concepts, the majority opinion was found reliable and its performance for accuracy, recall, precision and the F-measure was found statistically significantly higher than the average performance of individual auditors.

Resumo Limpo

audit healthcar terminolog error requir human expert paper present studi perform auditor look error semant type assign complex uml concept studi concept consid complex whenev assign combin semant type past research shown complex concept higher likelihood error result studi indic individu auditor reliabl audit concept perform low accord various metric result confirm outcom earlier pilot studi impli achiev accept level reliabl perform audit concept uml sever auditor need assign task mechan need combin possibl differ opinion differ auditor final determin current studi contrast previous work use major mechan purpos sampl complex uml concept major opinion found reliabl perform accuraci recal precis fmeasur found statist signific higher averag perform individu auditor

Resumos Similares

Comput. Biol. Med. - An ontology of cancer therapies supporting interoperability and data consistency in EPRs. ( 0,60052158843968 )
BMC Med Inform Decis Mak - Translating the Foundational Model of Anatomy into French using knowledge-based and lexical methods. ( 0,595674893846414 )
Artif Intell Med - Cue-based assertion classification for Swedish clinical text--developing a lexicon for pyConTextSwe. ( 0,56980522138568 )
Int J Med Inform - Semantic similarity-based alignment between clinical archetypes and SNOMED CT: an application to observations. ( 0,565093989616899 )
J Biomed Inform - BOAT: automatic alignment of biomedical ontologies using term informativeness and candidate selection. ( 0,561273078557517 )
J Am Med Inform Assoc - Approaching semantic interoperability in Health Level Seven. ( 0,561167141613734 )
Artif Intell Med - The readiness of SNOMED problem list concepts for meaningful use of electronic health records. ( 0,557876499574242 )
Artif Intell Med - Factors affecting the effectiveness of biomedical document indexing and retrieval based on terminologies. ( 0,55749467333806 )
Artif Intell Med - The Foundational Model of Anatomy in OWL 2 and its use. ( 0,55540979808312 )
AMIA Annu Symp Proc - Auditing SNOMED Integration into the UMLS for Duplicate Concepts. ( 0,553491365336186 )
J. Med. Internet Res. - Development of an obesity management ontology based on the nursing process for the mobile-device domain. ( 0,55259016114734 )
J Biomed Inform - Abstraction of complex concepts with a refined partial-area taxonomy of SNOMED. ( 0,551699517969593 )
J Biomed Inform - Assertion modeling and its role in clinical phenotype identification. ( 0,550856232747597 )
Comput Math Methods Med - Biomedical relation extraction: from binary to complex. ( 0,55049360364335 )
J Biomed Inform - Enabling semantic similarity estimation across multiple ontologies: an evaluation in the biomedical domain. ( 0,548945652424687 )
J Biomed Inform - OWL-based reasoning methods for validating archetypes. ( 0,547481305557993 )
J Biomed Inform - Semantic similarity estimation in the biomedical domain: an ontology-based information-theoretic perspective. ( 0,546447856877427 )
AMIA Annu Symp Proc - U-path: An undirected path-based measure of semantic similarity. ( 0,535518947319493 )
AMIA Annu Symp Proc - Quality assurance in LOINC using Description Logic. ( 0,534677775041413 )
AMIA Annu Symp Proc - Evaluation of RxNorm for Representing Ambulatory Prescriptions. ( 0,53239713749995 )
J Biomed Inform - Acquisition and evaluation of verb subcategorization resources for biomedicine. ( 0,530146039351004 )
J Biomed Inform - Ontological labels for automated location of anatomical shape differences. ( 0,529578377381827 )
Comput. Biol. Med. - How to standardize the pulse-taking method of traditional Chinese medicine pulse diagnosis. ( 0,527800103541999 )
J Clin Monit Comput - Do waking salivary cortisol levels correlate with anesthesiologist's job involvement? ( 0,526655002493289 )
Comput Methods Programs Biomed - Ontology-driven execution of clinical guidelines. ( 0,517177964205666 )
J Integr Bioinform - A semi-automated approach for anatomical ontology mapping. ( 0,517114071347042 )
AMIA Annu Symp Proc - Assessing the performance of LOINC? and RadLex for coverage of CT scans across three sites in a health information exchange. ( 0,513001969797831 )
J Biomed Inform - An ontology-based measure to compute semantic similarity in biomedicine. ( 0,512553221084749 )
AMIA Annu Symp Proc - Reasoning based quality assurance of medical ontologies: a case study. ( 0,51152144111192 )
J Biomed Inform - Quality evaluation of cancer study Common Data Elements using the UMLS Semantic Network. ( 0,510178350718251 )
J Biomed Inform - Enabling international adoption of LOINC through translation. ( 0,508048247433381 )
Methods Inf Med - Construction of an interface terminology on SNOMED CT. Generic approach and its application in intensive care. ( 0,506698274444663 )
J Am Med Inform Assoc - Scalable quality assurance for large SNOMED CT hierarchies using subject-based subtaxonomies. ( 0,506259866031693 )
J Biomed Inform - Reuse of termino-ontological resources and text corpora for building a multilingual domain ontology: an application to Alzheimer's disease. ( 0,502957322869464 )
Artif Intell Med - A semantic graph-based approach to biomedical summarisation. ( 0,501041090237935 )
IEEE J Biomed Health Inform - On the seamless, harmonized use of ISO/IEEE11073 and openEHR. ( 0,500217012411905 )
AMIA Annu Symp Proc - An empirically derived taxonomy of errors in SNOMED CT. ( 0,500144738749594 )
J Biomed Inform - Integrating reasoning and clinical archetypes using OWL ontologies and SWRL rules. ( 0,499109044432151 )
J Am Med Inform Assoc - A semantic-web oriented representation of the clinical element model for secondary use of electronic health records data. ( 0,498861386865082 )
AMIA Annu Symp Proc - Deriving an abstraction network to support quality assurance in OCRe. ( 0,49750407843124 )
J Biomed Inform - Combining PubMed knowledge and EHR data to develop a weighted bayesian network for pancreatic cancer prediction. ( 0,496462938882658 )
Methods Inf Med - Putting biomedical ontologies to work. ( 0,494594364777707 )
BMC Med Inform Decis Mak - Determining correspondences between high-frequency MedDRA concepts and SNOMED: a case study. ( 0,494222069536783 )
J Biomed Inform - Validating the semantics of a medical iconic language using ontological reasoning. ( 0,493836772424083 )
Methods Inf Med - An evolutionary approach to realism-based adverse event representations. ( 0,493272511370417 )
Artif Intell Med - Intra-axiom redundancies in SNOMED CT. ( 0,492795984546978 )
Med Decis Making - Health numeracy: the importance of domain in assessing numeracy. ( 0,492531140122761 )
J Biomed Inform - A query integrator and manager for the query web. ( 0,49210998991307 )
BMC Med Inform Decis Mak - Retrospective checking of compliance with practice guidelines for acute stroke care: a novel experiment using openEHR's Guideline Definition Language. ( 0,491601985597019 )
J Am Med Inform Assoc - Life sciences domain analysis model. ( 0,491572213107765 )
J Biomed Inform - Comparing different knowledge sources for the automatic summarization of biomedical literature. ( 0,489930971524694 )
J Clin Monit Comput - Partitioning standard base excess: a new approach. ( 0,488916308106397 )
Appl Clin Inform - An empiric analysis of omaha system targets. ( 0,488761347006254 )
J Biomed Inform - Using LOINC to link 10 terminology standards to one unified standard in a specialized domain. ( 0,487660652222378 )
IEEE Trans Neural Netw Learn Syst - Memristor-based cellular nonlinear/neural network: design, analysis, and applications. ( 0,48675447038034 )
J Chem Inf Model - Setting the record straight: the origin of the pharmacophore concept. ( 0,485563432725755 )
J Biomed Inform - A network-theoretic approach for decompositional translation across Open Biological Ontologies. ( 0,484575873406662 )
J Biomed Inform - A federated semantic metadata registry framework for enabling interoperability across clinical research and care domains. ( 0,48455537810814 )
Neural Comput - A causal perspective on the analysis of signal and noise correlations and their role in population coding. ( 0,483403086041382 )
J Biomed Inform - Mapping Partners Master Drug Dictionary to RxNorm using an NLP-based approach. ( 0,482982729049613 )
J Biomed Inform - A methodology for extending domain coverage in SemRep. ( 0,482972426187769 )
Perspect Health Inf Manag - Personal health records: is rapid adoption hindering interoperability? ( 0,482533511770371 )
J Biomed Inform - OntoVIP: an ontology for the annotation of object models used for medical image simulation. ( 0,482521703000139 )
J Biomed Inform - A comparison of two methods for retrieving ICD-9-CM data: the effect of using an ontology-based method for handling terminology changes. ( 0,48205635133975 )
J Am Med Inform Assoc - Auditing the multiply-related concepts within the UMLS. ( 0,481858179158268 )
AMIA Annu Symp Proc - An analysis of multi-type relational interactions in FMA using graph motifs with disjointness constraints. ( 0,480743129400795 )
AMIA Annu Symp Proc - Using Medical Text Extraction, Reasoning and Mapping System (MTERMS) to process medication information in outpatient clinical notes. ( 0,478749097911493 )
Methods Inf Med - Biomedical ontologies: toward scientific debate. ( 0,477290696283502 )
AMIA Annu Symp Proc - Fostering Multilinguality in the UMLS: A Computational Approach to Terminology Expansion for Multiple Languages. ( 0,47642754735104 )
J Biomed Inform - Cross-product extensions of the Gene Ontology. ( 0,476370740002586 )
J Med Syst - Automated mapping of clinical terms into SNOMED-CT. An application to codify procedures in pathology. ( 0,476146320218819 )
J Biomed Inform - Source authenticity in the UMLS--a case study of the Minimal Standard Terminology. ( 0,475718324907185 )
J Am Med Inform Assoc - Applying active learning to high-throughput phenotyping algorithms for electronic health records data. ( 0,475379795301504 )
J Biomed Inform - vSPARQL: a view definition language for the semantic web. ( 0,474598652066585 )
Int J Med Inform - A modified Delphi translation strategy and challenges of International Classification for Nursing Practice (ICNP?). ( 0,474510610507375 )
Comput. Biol. Med. - Improved explanation of human intelligence using cortical features with second order moments and regression. ( 0,474351530482971 )
J Biomed Inform - Cross-domain targeted ontology subsets for annotation: the case of SNOMED CORE and RxNorm. ( 0,472352818123972 )
AMIA Annu Symp Proc - Modeling and executing electronic health records driven phenotyping algorithms using the NQF Quality Data Model and JBoss? Drools Engine. ( 0,472100009437622 )
J Biomed Inform - Semantic mappings and locality of nursing diagnostic concepts in UMLS. ( 0,471523808418876 )
AMIA Annu Symp Proc - A family-based framework for supporting quality assurance of biomedical ontologies in BioPortal. ( 0,470295478333976 )
J Biomed Inform - Formalizing MedDRA to support semantic reasoning on adverse drug reaction terms. ( 0,469653357511811 )
J Med Syst - SeDeLo: using semantics and description logics to support aided clinical diagnosis. ( 0,468934055567067 )
IEEE Trans Image Process - Structure-preserving sparse decomposition for facial expression analysis. ( 0,468710016314472 )
Methods Inf Med - An eligibility criteria query language for heterogeneous data warehouses. ( 0,466365910550225 )
Int J Med Inform - A comparison between the VIPS model and the ICF for expressing nursing content in the health care record. ( 0,465441288734648 )
J Am Med Inform Assoc - Application of statistical machine translation to public health information: a feasibility study. ( 0,465378920995517 )
J Biomed Inform - A graph-based recovery and decomposition of Swanson's hypothesis using semantic predications. ( 0,464974031362401 )
Appl Clin Inform - Ontology content patterns as bridge for the semantic representation of clinical information. ( 0,464360440489759 )
AMIA Annu Symp Proc - A semantic and syntactic text simplification tool for health content. ( 0,46416888092047 )
BMC Med Inform Decis Mak - Querying phenotype-genotype relationships on patient datasets using semantic web technology: the example of Cerebrotendinous xanthomatosis. ( 0,463817220682937 )
AMIA Annu Symp Proc - Looking for Anemia (and Other Disorders) in SNOMED CT: Comparison of Three Approaches and Practical Implications. ( 0,462944899698106 )
Artif Intell Med - Recognizing lexical and semantic change patterns in evolving life science ontologies to inform mapping adaptation. ( 0,462694105471599 )
Comput Biol Chem - On the evolution rate in mammalian mitochondrial genomes. ( 0,461843030595396 )
Spat Spatiotemporal Epidemiol - Using geospatial technologies to explore activity-based retail food environments. ( 0,461445969864801 )
AMIA Annu Symp Proc - Characterizing semantic mappings adaptation via biomedical KOS evolution: a case study investigating SNOMED CT and ICD. ( 0,461016618057704 )
J Am Med Inform Assoc - Evaluating standard terminologies for encoding allergy information. ( 0,46047026515736 )
Neural Comput - A multifactor winner-take-all dynamics. ( 0,460378612163351 )
J Biomed Inform - Hematopoietic cell types: prototype for a revised cell ontology. ( 0,459567106620611 )
AMIA Annu Symp Proc - A twofold strategy for translating a medical terminology into French. ( 0,459459663661299 )
AMIA Annu Symp Proc - Evaluating de novo locus-disease discoveries in GWAS using the signal-to-noise ratio. ( 0,459328432438519 )