J Am Med Inform Assoc - Assisted annotation of medical free text using RapTAT.

Tópicos

{ extract(1171) text(1153) clinic(932) }
{ control(1307) perform(991) simul(935) }
{ studi(2440) review(1878) systemat(933) }
{ high(1669) rate(1365) level(1280) }
{ chang(1828) time(1643) increas(1301) }
{ blood(1257) pressur(1144) flow(957) }
{ treatment(1704) effect(941) patient(846) }
{ can(981) present(881) function(850) }
{ analysi(2126) use(1163) compon(1037) }
{ data(1737) use(1416) pattern(1282) }
{ sequenc(1873) structur(1644) protein(1328) }
{ drug(1928) target(777) effect(648) }
{ system(1976) rule(880) can(841) }
{ clinic(1479) use(1117) guidelin(835) }
{ method(984) reconstruct(947) comput(926) }
{ system(1050) medic(1026) inform(1018) }
{ visual(1396) interact(850) tool(830) }
{ record(1888) medic(1808) patient(1693) }
{ state(1844) use(1261) util(961) }
{ measur(2081) correl(1212) valu(896) }
{ featur(3375) classif(2383) classifi(1994) }
{ error(1145) method(1030) estim(1020) }
{ method(1557) propos(1049) approach(1037) }
{ general(901) number(790) one(736) }
{ compound(1573) activ(1297) structur(1058) }
{ model(2656) set(1616) predict(1553) }
{ group(2977) signific(1463) compar(1072) }
{ data(3008) multipl(1320) sourc(1022) }
{ first(2504) two(1366) second(1323) }
{ time(1939) patient(1703) rate(768) }
{ patient(1821) servic(1111) care(1106) }
{ use(1733) differ(960) four(931) }
{ estim(2440) model(1874) function(577) }
{ model(3404) distribut(989) bayesian(671) }
{ can(774) often(719) complex(702) }
{ imag(1947) propos(1133) code(1026) }
{ inform(2794) health(2639) internet(1427) }
{ imag(1057) registr(996) error(939) }
{ bind(1733) structur(1185) ligand(1036) }
{ method(1219) similar(1157) match(930) }
{ imag(2830) propos(1344) filter(1198) }
{ network(2748) neural(1063) input(814) }
{ imag(2675) segment(2577) method(1081) }
{ patient(2315) diseas(1263) diabet(1191) }
{ take(945) account(800) differ(722) }
{ motion(1329) object(1292) video(1091) }
{ assess(1506) score(1403) qualiti(1306) }
{ surgeri(1148) surgic(1085) robot(1054) }
{ framework(1458) process(801) describ(734) }
{ problem(2511) optim(1539) algorithm(950) }
{ learn(2355) train(1041) set(1003) }
{ concept(1167) ontolog(924) domain(897) }
{ algorithm(1844) comput(1787) effici(935) }
{ data(1714) softwar(1251) tool(1186) }
{ design(1359) user(1324) use(1319) }
{ model(2220) cell(1177) simul(1124) }
{ care(1570) inform(1187) nurs(1089) }
{ search(2224) databas(1162) retriev(909) }
{ featur(1941) imag(1645) propos(1176) }
{ case(1353) use(1143) diagnosi(1136) }
{ howev(809) still(633) remain(590) }
{ data(3963) clinic(1234) research(1004) }
{ studi(1410) differ(1259) use(1210) }
{ risk(3053) factor(974) diseas(938) }
{ perform(999) metric(946) measur(919) }
{ research(1085) discuss(1038) issu(1018) }
{ import(1318) role(1303) understand(862) }
{ model(2341) predict(2261) use(1141) }
{ perform(1367) use(1326) method(1137) }
{ studi(1119) effect(1106) posit(819) }
{ spatial(1525) area(1432) region(1030) }
{ health(3367) inform(1360) care(1135) }
{ model(3480) simul(1196) paramet(876) }
{ monitor(1329) mobil(1314) devic(1160) }
{ ehr(2073) health(1662) electron(1139) }
{ research(1218) medic(880) student(794) }
{ patient(2837) hospit(1953) medic(668) }
{ data(2317) use(1299) case(1017) }
{ age(1611) year(1155) adult(843) }
{ medic(1828) order(1363) alert(1069) }
{ signal(2180) analysi(812) frequenc(800) }
{ cost(1906) reduc(1198) effect(832) }
{ sampl(1606) size(1419) use(1276) }
{ gene(2352) biolog(1181) express(1162) }
{ intervent(3218) particip(2042) group(1664) }
{ activ(1138) subject(705) human(624) }
{ use(2086) technolog(871) perceiv(783) }
{ health(1844) social(1437) communiti(874) }
{ structur(1116) can(940) graph(676) }
{ cancer(2502) breast(956) screen(824) }
{ use(976) code(926) identifi(902) }
{ result(1111) use(1088) new(759) }
{ implement(1333) system(1263) develop(1122) }
{ survey(1388) particip(1329) question(1065) }
{ decis(3086) make(1611) patient(1517) }
{ process(1125) use(805) approach(778) }
{ activ(1452) weight(1219) physic(1104) }
{ method(1969) cluster(1462) data(1082) }
{ method(2212) result(1239) propos(1039) }
{ detect(2391) sensit(1101) algorithm(908) }

Resumo

JECTIVE: To determine whether assisted annotation using interactive training can reduce the time required to annotate a clinical document corpus without introducing bias.MATERIALS AND METHODS: A tool, RapTAT, was designed to assist annotation by iteratively pre-annotating probable phrases of interest within a document, presenting the annotations to a reviewer for correction, and then using the corrected annotations for further machine learning-based training before pre-annotating subsequent documents. Annotators reviewed 404 clinical notes either manually or using RapTAT assistance for concepts related to quality of care during heart failure treatment. Notes were divided into 20 batches of 19-21 documents for iterative annotation and training.RESULTS: The number of correct RapTAT pre-annotations increased significantly and annotation time per batch decreased by ~50% over the course of annotation. Annotation rate increased from batch to batch for assisted but not manual reviewers. Pre-annotation F-measure increased from 0.5 to 0.6 to >0.80 (relative to both assisted reviewer and reference annotations) over the first three batches and more slowly thereafter. Overall inter-annotator agreement was significantly higher between RapTAT-assisted reviewers (0.89) than between manual reviewers (0.85).DISCUSSION: The tool reduced workload by decreasing the number of annotations needing to be added and helping reviewers to annotate at an increased rate. Agreement between the pre-annotations and reference standard, and agreement between the pre-annotations and assisted annotations, were similar throughout the annotation process, which suggests that pre-annotation did not introduce bias.CONCLUSIONS: Pre-annotations generated by a tool capable of interactive training can reduce the time required to create an annotated document corpus by up to 50%.

Resumo Limpo

jectiv determin whether assist annot use interact train can reduc time requir annot clinic document corpus without introduc biasmateri method tool raptat design assist annot iter preannot probabl phrase interest within document present annot review correct use correct annot machin learningbas train preannot subsequ document annot review clinic note either manual use raptat assist concept relat qualiti care heart failur treatment note divid batch document iter annot trainingresult number correct raptat preannot increas signific annot time per batch decreas cours annot annot rate increas batch batch assist manual review preannot fmeasur increas relat assist review refer annot first three batch slowli thereaft overal interannot agreement signific higher raptatassist review manual review discuss tool reduc workload decreas number annot need ad help review annot increas rate agreement preannot refer standard agreement preannot assist annot similar throughout annot process suggest preannot introduc biasconclus preannot generat tool capabl interact train can reduc time requir creat annot document corpus

Resumos Similares

J Biomed Inform - MedTime: a temporal information extraction system for clinical narratives. ( 0,893259140299983 )
J Biomed Inform - Development and evaluation of RapTAT: a machine learning system for concept mapping of phrases from medical narratives. ( 0,875330634977074 )
Int J Med Inform - Bootstrapping a de-identification system for narrative patient records: cost-performance tradeoffs. ( 0,870644352640113 )
J Am Med Inform Assoc - Combining rules and machine learning for extraction of temporal expressions and events from clinical narratives. ( 0,863892699681333 )
J Am Med Inform Assoc - Eventual situations for timeline extraction from clinical reports. ( 0,857935712392097 )
Artif Intell Med - Biomedical events extraction using the hidden vector state model. ( 0,854343431484857 )
AMIA Annu Symp Proc - Inter-annotator reliability of medical events, coreferences and temporal relations in clinical narratives by annotators with varying levels of clinical expertise. ( 0,854018045688599 )
J Am Med Inform Assoc - An end-to-end system to identify temporal relation in discharge summaries: 2012 i2b2 challenge. ( 0,846723144571756 )
J Am Med Inform Assoc - A sense inventory for clinical abbreviations and acronyms created using clinical notes and medical dictionary resources. ( 0,846413915186634 )
J Biomed Inform - Semi-automatic semantic annotation of PubMed queries: a study on quality, efficiency, satisfaction. ( 0,846111827501118 )
J Am Med Inform Assoc - Anaphoric relations in the clinical narrative: corpus creation. ( 0,843913825299259 )
J Am Med Inform Assoc - A hybrid system for temporal information extraction from clinical text. ( 0,837207304126224 )
J Am Med Inform Assoc - Assessing the role of a medication-indication resource in the treatment relation extraction from clinical text. ( 0,836900630894103 )
J Biomed Inform - Identifying non-elliptical entity mentions in a coordinated NP with ellipses. ( 0,8347718610798 )
J. Med. Internet Res. - Web 2.0-based crowdsourcing for high-quality gold standard development in clinical natural language processing. ( 0,832932326674277 )
J Am Med Inform Assoc - MedXN: an open source medication extraction and normalization tool for clinical text. ( 0,827179123273854 )
J Biomed Inform - Towards generating a patient's timeline: extracting temporal relationships from clinical notes. ( 0,825505232480638 )
Appl Clin Inform - Representation of information about family relatives as structured data in electronic health records. ( 0,820708177442471 )
J Biomed Inform - Anaphoric reference in clinical reports: characteristics of an annotated corpus. ( 0,819199171138254 )
AMIA Annu Symp Proc - Mapping annotations with textual evidence using an scLDA model. ( 0,817966544632627 )
J Am Med Inform Assoc - Knowledge-based biomedical word sense disambiguation: an evaluation and application to clinical document classification. ( 0,816977758583698 )
AMIA Annu Symp Proc - Semantic processing to identify adverse drug event information from black box warnings. ( 0,816927517782814 )
Int J Med Inform - Detecting temporal expressions in medical narratives. ( 0,816003197742628 )
J Biomed Inform - A concept-driven biomedical knowledge extraction and visualization framework for conceptualization of text corpora. ( 0,81564316774737 )
J Am Med Inform Assoc - Automatic discourse connective detection in biomedical text. ( 0,813536363836558 )
J Am Med Inform Assoc - Evaluating temporal relations in clinical text: 2012 i2b2 Challenge. ( 0,813414154503189 )
AMIA Annu Symp Proc - Throw the bath water out, keep the baby: keeping medically-relevant terms for text mining. ( 0,810831657692761 )
J Med Syst - Redactable signatures for signed CDA Documents. ( 0,8089351557848 )
J Biomed Inform - Text summarization in the biomedical domain: a systematic review of recent research. ( 0,806800554470868 )
BMC Med Inform Decis Mak - Text summarization as a decision support aid. ( 0,805928443085605 )
Perspect Health Inf Manag - A comparison of two approaches to text processing: facilitating chart reviews of radiology reports in electronic medical records. ( 0,805464644348566 )
Comput Math Methods Med - Ranking biomedical annotations with annotator's semantic relevancy. ( 0,804635448571405 )
J Am Med Inform Assoc - Hybrid methods for improving information access in clinical documents: concept, assertion, and relation identification. ( 0,801864829797143 )
J Biomed Inform - Extraction of events and temporal expressions from clinical narratives. ( 0,801303493800544 )
J Am Med Inform Assoc - Evaluating the impact of pre-annotation on annotation speed and potential bias: natural language processing gold standard development for clinical named entity recognition in clinical trial announcements. ( 0,798969103533282 )
AMIA Annu Symp Proc - Extracting Concepts Related to Homelessness from the Free Text of VA Electronic Medical Records. ( 0,798597724936855 )
J Biomed Inform - Lexical patterns, features and knowledge resources for coreference resolution in clinical notes. ( 0,797660390672894 )
AMIA Annu Symp Proc - Natural language processing for lines and devices in portable chest x-rays. ( 0,797351374499539 )
Int J Med Inform - Detection of infectious symptoms from VA emergency department and primary care clinical documentation. ( 0,793988773691107 )
AMIA Annu Symp Proc - Pharmacovigilance on twitter? Mining tweets for adverse drug reactions. ( 0,790097418933817 )
J Am Med Inform Assoc - Syntactic parsing of clinical text: guideline and corpus development with handling ill-formed sentences. ( 0,789467912795935 )
J Am Med Inform Assoc - A flexible framework for recognizing events, temporal expressions, and temporal relations in clinical text. ( 0,787817231599629 )
J Biomed Inform - Text de-identification for privacy protection: a study of its impact on clinical text information content. ( 0,786991798878617 )
J Biomed Inform - Lessons learnt from the DDIExtraction-2013 Shared Task. ( 0,785926220207019 )
J Am Med Inform Assoc - 2010 i2b2/VA challenge on concepts, assertions, and relations in clinical text. ( 0,785536427433485 )
AMIA Annu Symp Proc - A cloud-based approach to medical NLP. ( 0,785321127896578 )
J Biomed Inform - NCBI disease corpus: a resource for disease name recognition and concept normalization. ( 0,784609511067268 )
AMIA Annu Symp Proc - Building gold standard corpora for medical natural language processing tasks. ( 0,782765969928454 )
Comput Methods Programs Biomed - BioAnnote: a software platform for annotating biomedical documents with application in medical learning environments. ( 0,782537963275078 )
J Biomed Inform - Evaluating the effects of machine pre-annotation and an interactive annotation interface on manual de-identification of clinical text. ( 0,781988586380917 )
J Biomed Inform - Enhancing clinical concept extraction with distributional semantics. ( 0,780067525719112 )
J Am Med Inform Assoc - A study of machine-learning-based approaches to extract clinical entities and their assertions from discharge summaries. ( 0,779860361013384 )
AMIA Annu Symp Proc - Extracting temporal constraints from clinical research eligibility criteria using conditional random fields. ( 0,779366784838431 )
J Am Med Inform Assoc - Extracting drug indication information from structured product labels using natural language processing. ( 0,779211320272011 )
AMIA Annu Symp Proc - Automatically pairing measured findings across narrative abdomen CT reports. ( 0,778914964291169 )
AMIA Annu Symp Proc - Natural language processing to extract follow-up provider information from hospital discharge summaries. ( 0,775648241796794 )
J Am Med Inform Assoc - Using rule-based natural language processing to improve disease normalization in biomedical text. ( 0,775359034522231 )
J Biomed Inform - Desiderata for ontologies to be used in semantic annotation of biomedical documents. ( 0,773800755020053 )
J Biomed Inform - Automatically extracting information needs from complex clinical questions. ( 0,770747737442043 )
J Am Med Inform Assoc - MITRE system for clinical assertion status classification. ( 0,769653207648343 )
J Biomed Inform - UMLS content views appropriate for NLP processing of the biomedical literature vs. clinical text. ( 0,769442320974842 )
AMIA Annu Symp Proc - Developing a section labeler for clinical documents. ( 0,765874340976971 )
Int J Med Inform - A methodology to enhance spatial understanding of disease outbreak events reported in news articles. ( 0,760529410802598 )
J Am Med Inform Assoc - The effect of word familiarity on actual and perceived text difficulty. ( 0,758448505378461 )
J Biomed Inform - Detecting hedge cues and their scope in biomedical text with conditional random fields. ( 0,757185425701062 )
J Biomed Inform - A new clustering method for detecting rare senses of abbreviations in clinical notes. ( 0,756043831612338 )
J Chem Inf Model - Automated extraction of information on chemical-P-glycoprotein interactions from the literature. ( 0,753839227437721 )
AMIA Annu Symp Proc - Detecting abbreviations in discharge summaries using machine learning methods. ( 0,753085915639726 )
J Biomed Inform - Degree centrality for semantic abstraction summarization of therapeutic studies. ( 0,752421773708228 )
J Am Med Inform Assoc - Large-scale evaluation of automated clinical note de-identification and its impact on information extraction. ( 0,750323278626865 )
AMIA Annu Symp Proc - TagLine: Information Extraction for Semi-Structured Text in Medical Progress Notes. ( 0,749344961294993 )
J Integr Bioinform - Automatic extraction of microorganisms and their habitats from free text using text mining workflows. ( 0,749225674116543 )
Brief. Bioinformatics - A survey on annotation tools for the biomedical literature. ( 0,749004458029633 )
J Am Med Inform Assoc - Automated clinical trial eligibility prescreening: increasing the efficiency of patient identification for clinical trials in the emergency department. ( 0,748197169284911 )
AMIA Annu Symp Proc - Semantic processing to identify adverse drug event information from black box warnings. ( 0,74750832877552 )
Sci Data - Building the graph of medicine from millions of clinical narratives. ( 0,74727013132218 )
AMIA Annu Symp Proc - Combining corpus-derived sense profiles with estimated frequency information to disambiguate clinical abbreviations. ( 0,74669286681071 )
AMIA Annu Symp Proc - Automated illustration of patients instructions. ( 0,744358775640956 )
AMIA Annu Symp Proc - Towards a semantic lexicon for clinical natural language processing. ( 0,744263874517507 )
AMIA Annu Symp Proc - Sophia: A Expedient UMLS Concept Extraction Annotator. ( 0,744252546688917 )
J Biomed Inform - Semantator: semantic annotator for converting biomedical text to linked data. ( 0,742144494310222 )
J Biomed Inform - Annotating temporal information in clinical narratives. ( 0,741854144944742 )
AMIA Annu Symp Proc - Critical finding capture in the impression section of radiology reports. ( 0,741678444874001 )
IEEE Trans Pattern Anal Mach Intell - Toward Integrated Scene Text Reading. ( 0,741133281789352 )
J Biomed Inform - Evaluating measures of semantic similarity and relatedness to disambiguate terms in biomedical text. ( 0,740978366859022 )
AMIA Annu Symp Proc - Qualitative analysis of workflow modifications used to generate the reference standard for the 2010 i2b2/VA challenge. ( 0,7399038442544 )
J Am Med Inform Assoc - EliXR: an approach to eligibility criteria extraction and representation. ( 0,73890100551324 )
J Am Med Inform Assoc - Towards comprehensive syntactic and semantic annotations of the clinical narrative. ( 0,734040116411434 )
AMIA Annu Symp Proc - Extracting patient demographics and personal medical information from online health forums. ( 0,730046266664367 )
BMC Med Inform Decis Mak - Detecting causality from online psychiatric texts using inter-sentential language patterns. ( 0,728717788779702 )
J Am Med Inform Assoc - A la Recherche du Temps Perdu: extracting temporal relations from medical text in the 2012 i2b2 NLP challenge. ( 0,727754530898678 )
AMIA Annu Symp Proc - Voice-dictated versus typed-in clinician notes: linguistic properties and the potential implications on natural language processing. ( 0,726350898979471 )
AMIA Annu Symp Proc - A comparative study of current Clinical Natural Language Processing systems on handling abbreviations in discharge summaries. ( 0,724175667599896 )
Comput. Biol. Med. - A P300-based brain computer interface system for words typing. ( 0,723809446635817 )
J Biomed Inform - Approaches to verb subcategorization for biomedicine. ( 0,723252454445007 )
BMC Med Inform Decis Mak - A framework for enhancing spatial and temporal granularity in report-based health surveillance systems. ( 0,722411977216672 )
J Biomed Inform - Common data model for natural language processing based on two existing standard information models: CDA+GrAF. ( 0,721081438781205 )
J Biomed Inform - Automatic recognition of disorders, findings, pharmaceuticals and body structures from clinical text: an annotation and machine learning study. ( 0,720920472658773 )
J Biomed Inform - Secondary use of electronic health records for building cohort studies through top-down information extraction. ( 0,720442869050876 )
AMIA Annu Symp Proc - Extracting semantic lexicons from discharge summaries using machine learning and the C-Value method. ( 0,719806915031452 )