J Biomed Inform - Evaluating the effects of machine pre-annotation and an interactive annotation interface on manual de-identification of clinical text.

Tópicos

{ extract(1171) text(1153) clinic(932) }
{ clinic(1479) use(1117) guidelin(835) }
{ system(1976) rule(880) can(841) }
{ perform(999) metric(946) measur(919) }
{ patient(2315) diseas(1263) diabet(1191) }
{ assess(1506) score(1403) qualiti(1306) }
{ ehr(2073) health(1662) electron(1139) }
{ sampl(1606) size(1419) use(1276) }
{ concept(1167) ontolog(924) domain(897) }
{ take(945) account(800) differ(722) }
{ algorithm(1844) comput(1787) effici(935) }
{ studi(1119) effect(1106) posit(819) }
{ data(3008) multipl(1320) sourc(1022) }
{ structur(1116) can(940) graph(676) }
{ featur(1941) imag(1645) propos(1176) }
{ case(1353) use(1143) diagnosi(1136) }
{ time(1939) patient(1703) rate(768) }
{ model(3404) distribut(989) bayesian(671) }
{ bind(1733) structur(1185) ligand(1036) }
{ featur(3375) classif(2383) classifi(1994) }
{ problem(2511) optim(1539) algorithm(950) }
{ model(2220) cell(1177) simul(1124) }
{ howev(809) still(633) remain(590) }
{ system(1050) medic(1026) inform(1018) }
{ visual(1396) interact(850) tool(830) }
{ compound(1573) activ(1297) structur(1058) }
{ state(1844) use(1261) util(961) }
{ research(1218) medic(880) student(794) }
{ data(2317) use(1299) case(1017) }
{ intervent(3218) particip(2042) group(1664) }
{ activ(1138) subject(705) human(624) }
{ drug(1928) target(777) effect(648) }
{ activ(1452) weight(1219) physic(1104) }
{ detect(2391) sensit(1101) algorithm(908) }
{ can(774) often(719) complex(702) }
{ imag(1947) propos(1133) code(1026) }
{ data(1737) use(1416) pattern(1282) }
{ inform(2794) health(2639) internet(1427) }
{ measur(2081) correl(1212) valu(896) }
{ imag(1057) registr(996) error(939) }
{ sequenc(1873) structur(1644) protein(1328) }
{ method(1219) similar(1157) match(930) }
{ imag(2830) propos(1344) filter(1198) }
{ network(2748) neural(1063) input(814) }
{ imag(2675) segment(2577) method(1081) }
{ studi(2440) review(1878) systemat(933) }
{ motion(1329) object(1292) video(1091) }
{ treatment(1704) effect(941) patient(846) }
{ surgeri(1148) surgic(1085) robot(1054) }
{ framework(1458) process(801) describ(734) }
{ error(1145) method(1030) estim(1020) }
{ chang(1828) time(1643) increas(1301) }
{ learn(2355) train(1041) set(1003) }
{ method(1557) propos(1049) approach(1037) }
{ data(1714) softwar(1251) tool(1186) }
{ design(1359) user(1324) use(1319) }
{ control(1307) perform(991) simul(935) }
{ care(1570) inform(1187) nurs(1089) }
{ general(901) number(790) one(736) }
{ method(984) reconstruct(947) comput(926) }
{ search(2224) databas(1162) retriev(909) }
{ data(3963) clinic(1234) research(1004) }
{ studi(1410) differ(1259) use(1210) }
{ risk(3053) factor(974) diseas(938) }
{ research(1085) discuss(1038) issu(1018) }
{ import(1318) role(1303) understand(862) }
{ model(2341) predict(2261) use(1141) }
{ perform(1367) use(1326) method(1137) }
{ blood(1257) pressur(1144) flow(957) }
{ spatial(1525) area(1432) region(1030) }
{ record(1888) medic(1808) patient(1693) }
{ health(3367) inform(1360) care(1135) }
{ model(3480) simul(1196) paramet(876) }
{ monitor(1329) mobil(1314) devic(1160) }
{ patient(2837) hospit(1953) medic(668) }
{ model(2656) set(1616) predict(1553) }
{ age(1611) year(1155) adult(843) }
{ medic(1828) order(1363) alert(1069) }
{ signal(2180) analysi(812) frequenc(800) }
{ cost(1906) reduc(1198) effect(832) }
{ group(2977) signific(1463) compar(1072) }
{ gene(2352) biolog(1181) express(1162) }
{ first(2504) two(1366) second(1323) }
{ patient(1821) servic(1111) care(1106) }
{ use(2086) technolog(871) perceiv(783) }
{ can(981) present(881) function(850) }
{ analysi(2126) use(1163) compon(1037) }
{ health(1844) social(1437) communiti(874) }
{ high(1669) rate(1365) level(1280) }
{ cancer(2502) breast(956) screen(824) }
{ use(976) code(926) identifi(902) }
{ use(1733) differ(960) four(931) }
{ result(1111) use(1088) new(759) }
{ implement(1333) system(1263) develop(1122) }
{ survey(1388) particip(1329) question(1065) }
{ estim(2440) model(1874) function(577) }
{ decis(3086) make(1611) patient(1517) }
{ process(1125) use(805) approach(778) }
{ method(1969) cluster(1462) data(1082) }
{ method(2212) result(1239) propos(1039) }

Resumo

The Health Insurance Portability and Accountability Act (HIPAA) Safe Harbor method requires removal of 18 types of protected health information (PHI) from clinical documents to be considered "de-identified" prior to use for research purposes. Human review of PHI elements from a large corpus of clinical documents can be tedious and error-prone. Indeed, multiple annotators may be required to consistently redact information that represents each PHI class. Automated de-identification has the potential to improve annotation quality and reduce annotation time. For instance, using machine-assisted annotation by combining de-identification system outputs used as pre-annotations and an interactive annotation interface to provide annotators with PHI annotations for "curation" rather than manual annotation from "scratch" on raw clinical documents. In order to assess whether machine-assisted annotation improves the reliability and accuracy of the reference standard quality and reduces annotation effort, we conducted an annotation experiment. In this annotation study, we assessed the generalizability of the VA Consortium for Healthcare Informatics Research (CHIR) annotation schema and guidelines applied to a corpus of publicly available clinical documents called MTSamples. Specifically, our goals were to (1) characterize a heterogeneous corpus of clinical documents manually annotated for risk-ranked PHI and other annotation types (clinical eponyms and person relations), (2) evaluate how well annotators apply the CHIR schema to the heterogeneous corpus, (3) compare whether machine-assisted annotation (experiment) improves annotation quality and reduces annotation time compared to manual annotation (control), and (4) assess the change in quality of reference standard coverage with each added annotator's annotations.

Resumo Limpo

health insur portabl account act hipaa safe harbor method requir remov type protect health inform phi clinic document consid deidentifi prior use research purpos human review phi element larg corpus clinic document can tedious errorpron inde multipl annot may requir consist redact inform repres phi class autom deidentif potenti improv annot qualiti reduc annot time instanc use machineassist annot combin deidentif system output use preannot interact annot interfac provid annot phi annot curat rather manual annot scratch raw clinic document order assess whether machineassist annot improv reliabl accuraci refer standard qualiti reduc annot effort conduct annot experi annot studi assess generaliz va consortium healthcar informat research chir annot schema guidelin appli corpus public avail clinic document call mtsampl specif goal character heterogen corpus clinic document manual annot riskrank phi annot type clinic eponym person relat evalu well annot appli chir schema heterogen corpus compar whether machineassist annot experi improv annot qualiti reduc annot time compar manual annot control assess chang qualiti refer standard coverag ad annot annot

Resumos Similares

J Biomed Inform - Text de-identification for privacy protection: a study of its impact on clinical text information content. ( 0,926807135572703 )
J Am Med Inform Assoc - Syntactic parsing of clinical text: guideline and corpus development with handling ill-formed sentences. ( 0,893557630303784 )
J. Med. Internet Res. - Web 2.0-based crowdsourcing for high-quality gold standard development in clinical natural language processing. ( 0,885750043805607 )
Int J Med Inform - Detecting temporal expressions in medical narratives. ( 0,878013892171158 )
J Am Med Inform Assoc - Anaphoric relations in the clinical narrative: corpus creation. ( 0,877472296264894 )
J Am Med Inform Assoc - MedXN: an open source medication extraction and normalization tool for clinical text. ( 0,868781948489504 )
J Am Med Inform Assoc - Combining rules and machine learning for extraction of temporal expressions and events from clinical narratives. ( 0,859520498213358 )
Appl Clin Inform - Representation of information about family relatives as structured data in electronic health records. ( 0,8547521024468 )
J Biomed Inform - Anaphoric reference in clinical reports: characteristics of an annotated corpus. ( 0,84982812163666 )
AMIA Annu Symp Proc - Inter-annotator reliability of medical events, coreferences and temporal relations in clinical narratives by annotators with varying levels of clinical expertise. ( 0,849430441968342 )
AMIA Annu Symp Proc - Automatically pairing measured findings across narrative abdomen CT reports. ( 0,84858617146179 )
J Am Med Inform Assoc - An end-to-end system to identify temporal relation in discharge summaries: 2012 i2b2 challenge. ( 0,847493324265345 )
J Biomed Inform - Lexical patterns, features and knowledge resources for coreference resolution in clinical notes. ( 0,846345989369353 )
J Am Med Inform Assoc - Knowledge-based biomedical word sense disambiguation: an evaluation and application to clinical document classification. ( 0,836502419135425 )
J Am Med Inform Assoc - Assessing the role of a medication-indication resource in the treatment relation extraction from clinical text. ( 0,833113376582468 )
J Biomed Inform - MedTime: a temporal information extraction system for clinical narratives. ( 0,83256233011617 )
Artif Intell Med - Biomedical events extraction using the hidden vector state model. ( 0,830856848776094 )
J Am Med Inform Assoc - Eventual situations for timeline extraction from clinical reports. ( 0,828165209442704 )
J Biomed Inform - Towards generating a patient's timeline: extracting temporal relationships from clinical notes. ( 0,825304189350225 )
AMIA Annu Symp Proc - Throw the bath water out, keep the baby: keeping medically-relevant terms for text mining. ( 0,824830673116281 )
J Biomed Inform - Identifying non-elliptical entity mentions in a coordinated NP with ellipses. ( 0,822591395235935 )
J Biomed Inform - A concept-driven biomedical knowledge extraction and visualization framework for conceptualization of text corpora. ( 0,82215149081094 )
AMIA Annu Symp Proc - Natural language processing for lines and devices in portable chest x-rays. ( 0,821352570015967 )
J Am Med Inform Assoc - A sense inventory for clinical abbreviations and acronyms created using clinical notes and medical dictionary resources. ( 0,819608240310216 )
J Am Med Inform Assoc - A hybrid system for temporal information extraction from clinical text. ( 0,819368426831248 )
J Am Med Inform Assoc - Evaluating the impact of pre-annotation on annotation speed and potential bias: natural language processing gold standard development for clinical named entity recognition in clinical trial announcements. ( 0,818628215969382 )
J Biomed Inform - Extraction of events and temporal expressions from clinical narratives. ( 0,815570715560923 )
J Am Med Inform Assoc - Evaluating temporal relations in clinical text: 2012 i2b2 Challenge. ( 0,814317595254567 )
AMIA Annu Symp Proc - Semantic processing to identify adverse drug event information from black box warnings. ( 0,811886627276422 )
J Biomed Inform - Development and evaluation of RapTAT: a machine learning system for concept mapping of phrases from medical narratives. ( 0,811538824484714 )
J Am Med Inform Assoc - Towards comprehensive syntactic and semantic annotations of the clinical narrative. ( 0,811191752336572 )
J Biomed Inform - Semi-automatic semantic annotation of PubMed queries: a study on quality, efficiency, satisfaction. ( 0,811166065984443 )
Comput Math Methods Med - Ranking biomedical annotations with annotator's semantic relevancy. ( 0,807943342377065 )
J Am Med Inform Assoc - Automatic discourse connective detection in biomedical text. ( 0,801731441082573 )
AMIA Annu Symp Proc - Building gold standard corpora for medical natural language processing tasks. ( 0,800730777576583 )
J Biomed Inform - The DDI corpus: an annotated corpus with pharmacological substances and drug-drug interactions. ( 0,796947692350903 )
J Biomed Inform - Desiderata for ontologies to be used in semantic annotation of biomedical documents. ( 0,796820931803383 )
J Am Med Inform Assoc - A study of machine-learning-based approaches to extract clinical entities and their assertions from discharge summaries. ( 0,796722966154294 )
Int J Med Inform - Detection of infectious symptoms from VA emergency department and primary care clinical documentation. ( 0,795597046406982 )
J Am Med Inform Assoc - A flexible framework for recognizing events, temporal expressions, and temporal relations in clinical text. ( 0,791530535354323 )
AMIA Annu Symp Proc - Towards a semantic lexicon for clinical natural language processing. ( 0,789156444212816 )
J Am Med Inform Assoc - The effect of word familiarity on actual and perceived text difficulty. ( 0,788337949596386 )
J Biomed Inform - A new clustering method for detecting rare senses of abbreviations in clinical notes. ( 0,787872800088511 )
J Med Syst - Redactable signatures for signed CDA Documents. ( 0,786452034730879 )
AMIA Annu Symp Proc - Pharmacovigilance on twitter? Mining tweets for adverse drug reactions. ( 0,786395809931157 )
J Biomed Inform - NCBI disease corpus: a resource for disease name recognition and concept normalization. ( 0,786366463403611 )
J Biomed Inform - UMLS content views appropriate for NLP processing of the biomedical literature vs. clinical text. ( 0,784976741561856 )
AMIA Annu Symp Proc - Automated illustration of patients instructions. ( 0,784849176290755 )
J Biomed Inform - Lessons learnt from the DDIExtraction-2013 Shared Task. ( 0,784743945734628 )
J Am Med Inform Assoc - Assisted annotation of medical free text using RapTAT. ( 0,781988586380917 )
Brief. Bioinformatics - A survey on annotation tools for the biomedical literature. ( 0,778321261727845 )
AMIA Annu Symp Proc - Natural language processing to extract follow-up provider information from hospital discharge summaries. ( 0,777625834361316 )
J Am Med Inform Assoc - MITRE system for clinical assertion status classification. ( 0,776735875467767 )
AMIA Annu Symp Proc - Extracting Concepts Related to Homelessness from the Free Text of VA Electronic Medical Records. ( 0,77482310930862 )
J Biomed Inform - Annotating temporal information in clinical narratives. ( 0,774107557115333 )
J Am Med Inform Assoc - 2010 i2b2/VA challenge on concepts, assertions, and relations in clinical text. ( 0,773931785215325 )
J Integr Bioinform - Automatic extraction of microorganisms and their habitats from free text using text mining workflows. ( 0,773587818099731 )
AMIA Annu Symp Proc - Extracting semantic lexicons from discharge summaries using machine learning and the C-Value method. ( 0,771902370460832 )
AMIA Annu Symp Proc - Mapping annotations with textual evidence using an scLDA model. ( 0,769909030220293 )
Int J Med Inform - Bootstrapping a de-identification system for narrative patient records: cost-performance tradeoffs. ( 0,769341460932208 )
J Am Med Inform Assoc - Using rule-based natural language processing to improve disease normalization in biomedical text. ( 0,763792237416645 )
AMIA Annu Symp Proc - Voice-dictated versus typed-in clinician notes: linguistic properties and the potential implications on natural language processing. ( 0,762465591130567 )
BMC Med Inform Decis Mak - Text summarization as a decision support aid. ( 0,762312836705742 )
Sci Data - Building the graph of medicine from millions of clinical narratives. ( 0,762301805620466 )
Comput Methods Programs Biomed - BioAnnote: a software platform for annotating biomedical documents with application in medical learning environments. ( 0,75995524613223 )
J Am Med Inform Assoc - Comparison of a semi-automatic annotation tool and a natural language processing application for the generation of clinical statement entries. ( 0,759344841637197 )
J Biomed Inform - Evaluating measures of semantic similarity and relatedness to disambiguate terms in biomedical text. ( 0,759200709637583 )
AMIA Annu Symp Proc - Semantic processing to identify adverse drug event information from black box warnings. ( 0,757189779531931 )
J Biomed Inform - Semantator: semantic annotator for converting biomedical text to linked data. ( 0,75309705761259 )
J Biomed Inform - The EU-ADR corpus: annotated drugs, diseases, targets, and their relationships. ( 0,752118858998246 )
AMIA Annu Symp Proc - EpiDEA: extracting structured epilepsy and seizure information from patient discharge summaries for cohort identification. ( 0,751777671702807 )
J Biomed Inform - Automatically extracting information needs from complex clinical questions. ( 0,751743881982756 )
AMIA Annu Symp Proc - Critical finding capture in the impression section of radiology reports. ( 0,750676619432171 )
J Biomed Inform - Enhancing clinical concept extraction with distributional semantics. ( 0,747014429556632 )
J Biomed Inform - Text summarization in the biomedical domain: a systematic review of recent research. ( 0,746131134450833 )
AMIA Annu Symp Proc - A cloud-based approach to medical NLP. ( 0,744266133259312 )
AMIA Annu Symp Proc - Developing a section labeler for clinical documents. ( 0,744264626631863 )
J Am Med Inform Assoc - Hybrid methods for improving information access in clinical documents: concept, assertion, and relation identification. ( 0,743102396757959 )
AMIA Annu Symp Proc - A comparative study of current Clinical Natural Language Processing systems on handling abbreviations in discharge summaries. ( 0,741816656503577 )
AMIA Annu Symp Proc - Detecting abbreviations in discharge summaries using machine learning methods. ( 0,741360792563712 )
Int J Med Inform - A methodology to enhance spatial understanding of disease outbreak events reported in news articles. ( 0,740115350490659 )
J Am Med Inform Assoc - Extracting drug indication information from structured product labels using natural language processing. ( 0,738575810010742 )
J Am Med Inform Assoc - A knowledge discovery and reuse pipeline for information extraction in clinical notes. ( 0,737496571423162 )
J Am Med Inform Assoc - Large-scale evaluation of automated clinical note de-identification and its impact on information extraction. ( 0,736990995199395 )
J Biomed Inform - Degree centrality for semantic abstraction summarization of therapeutic studies. ( 0,736276324932366 )
AMIA Annu Symp Proc - Sophia: A Expedient UMLS Concept Extraction Annotator. ( 0,732276478601272 )
J Biomed Inform - Ontology modularization to improve semantic medical image annotation. ( 0,730314662091054 )
AMIA Annu Symp Proc - It's about this and that: a description of anaphoric expressions in clinical text. ( 0,730310518755314 )
AMIA Annu Symp Proc - TagLine: Information Extraction for Semi-Structured Text in Medical Progress Notes. ( 0,729091805425474 )
J Am Med Inform Assoc - Automated clinical trial eligibility prescreening: increasing the efficiency of patient identification for clinical trials in the emergency department. ( 0,725440219899478 )
AMIA Annu Symp Proc - Generalizability and comparison of automatic clinical text de-identification methods and resources. ( 0,725148253757948 )
J Am Med Inform Assoc - Automatic abstraction of imaging observations with their characteristics from mammography reports. ( 0,724923029669365 )
Telemed J E Health - Information extraction for tracking liver cancer patients' statuses: from mixture of clinical narrative report types. ( 0,7247074366758 )
J Am Med Inform Assoc - Comprehensive temporal information detection from clinical text: medical events, time, and TLINK identification. ( 0,724033189441532 )
Perspect Health Inf Manag - A comparison of two approaches to text processing: facilitating chart reviews of radiology reports in electronic medical records. ( 0,717524615782737 )
AMIA Annu Symp Proc - Automatic acquisition of sublanguage semantic schema: towards the word sense disambiguation of clinical narratives. ( 0,716247687632831 )
J Am Med Inform Assoc - Functional evaluation of out-of-the-box text-mining tools for data-mining tasks. ( 0,714741767720524 )
AMIA Annu Symp Proc - Active Learning-based corpus annotation--the PathoJen experience. ( 0,714024888059904 )
AMIA Annu Symp Proc - Extracting patient demographics and personal medical information from online health forums. ( 0,712393487213174 )
J Am Med Inform Assoc - ccML, a new mark-up language to improve ISO/EN 13606-based electronic health record extracts practical edition. ( 0,711868957402993 )