Int J Med Inform - Are three methods better than one? A comparative assessment of usability evaluation methods in an EHR.

Tópicos

{ care(1570) inform(1187) nurs(1089) }
{ design(1359) user(1324) use(1319) }
{ use(976) code(926) identifi(902) }
{ ehr(2073) health(1662) electron(1139) }
{ use(1733) differ(960) four(931) }
{ method(1969) cluster(1462) data(1082) }
{ sampl(1606) size(1419) use(1276) }
{ patient(2315) diseas(1263) diabet(1191) }
{ studi(2440) review(1878) systemat(933) }
{ motion(1329) object(1292) video(1091) }
{ clinic(1479) use(1117) guidelin(835) }
{ import(1318) role(1303) understand(862) }
{ activ(1138) subject(705) human(624) }
{ high(1669) rate(1365) level(1280) }
{ cancer(2502) breast(956) screen(824) }
{ process(1125) use(805) approach(778) }
{ can(774) often(719) complex(702) }
{ data(1737) use(1416) pattern(1282) }
{ inform(2794) health(2639) internet(1427) }
{ featur(3375) classif(2383) classifi(1994) }
{ surgeri(1148) surgic(1085) robot(1054) }
{ data(1714) softwar(1251) tool(1186) }
{ data(3963) clinic(1234) research(1004) }
{ research(1085) discuss(1038) issu(1018) }
{ research(1218) medic(880) student(794) }
{ data(2317) use(1299) case(1017) }
{ medic(1828) order(1363) alert(1069) }
{ data(3008) multipl(1320) sourc(1022) }
{ survey(1388) particip(1329) question(1065) }
{ method(2212) result(1239) propos(1039) }
{ model(3404) distribut(989) bayesian(671) }
{ imag(1947) propos(1133) code(1026) }
{ system(1976) rule(880) can(841) }
{ measur(2081) correl(1212) valu(896) }
{ imag(1057) registr(996) error(939) }
{ bind(1733) structur(1185) ligand(1036) }
{ sequenc(1873) structur(1644) protein(1328) }
{ method(1219) similar(1157) match(930) }
{ imag(2830) propos(1344) filter(1198) }
{ network(2748) neural(1063) input(814) }
{ imag(2675) segment(2577) method(1081) }
{ take(945) account(800) differ(722) }
{ assess(1506) score(1403) qualiti(1306) }
{ treatment(1704) effect(941) patient(846) }
{ framework(1458) process(801) describ(734) }
{ problem(2511) optim(1539) algorithm(950) }
{ error(1145) method(1030) estim(1020) }
{ chang(1828) time(1643) increas(1301) }
{ learn(2355) train(1041) set(1003) }
{ concept(1167) ontolog(924) domain(897) }
{ algorithm(1844) comput(1787) effici(935) }
{ extract(1171) text(1153) clinic(932) }
{ method(1557) propos(1049) approach(1037) }
{ control(1307) perform(991) simul(935) }
{ model(2220) cell(1177) simul(1124) }
{ general(901) number(790) one(736) }
{ method(984) reconstruct(947) comput(926) }
{ search(2224) databas(1162) retriev(909) }
{ featur(1941) imag(1645) propos(1176) }
{ case(1353) use(1143) diagnosi(1136) }
{ howev(809) still(633) remain(590) }
{ studi(1410) differ(1259) use(1210) }
{ risk(3053) factor(974) diseas(938) }
{ perform(999) metric(946) measur(919) }
{ system(1050) medic(1026) inform(1018) }
{ model(2341) predict(2261) use(1141) }
{ visual(1396) interact(850) tool(830) }
{ compound(1573) activ(1297) structur(1058) }
{ perform(1367) use(1326) method(1137) }
{ studi(1119) effect(1106) posit(819) }
{ blood(1257) pressur(1144) flow(957) }
{ spatial(1525) area(1432) region(1030) }
{ record(1888) medic(1808) patient(1693) }
{ health(3367) inform(1360) care(1135) }
{ model(3480) simul(1196) paramet(876) }
{ monitor(1329) mobil(1314) devic(1160) }
{ state(1844) use(1261) util(961) }
{ patient(2837) hospit(1953) medic(668) }
{ model(2656) set(1616) predict(1553) }
{ age(1611) year(1155) adult(843) }
{ signal(2180) analysi(812) frequenc(800) }
{ cost(1906) reduc(1198) effect(832) }
{ group(2977) signific(1463) compar(1072) }
{ gene(2352) biolog(1181) express(1162) }
{ first(2504) two(1366) second(1323) }
{ intervent(3218) particip(2042) group(1664) }
{ time(1939) patient(1703) rate(768) }
{ patient(1821) servic(1111) care(1106) }
{ use(2086) technolog(871) perceiv(783) }
{ can(981) present(881) function(850) }
{ analysi(2126) use(1163) compon(1037) }
{ health(1844) social(1437) communiti(874) }
{ structur(1116) can(940) graph(676) }
{ drug(1928) target(777) effect(648) }
{ result(1111) use(1088) new(759) }
{ implement(1333) system(1263) develop(1122) }
{ estim(2440) model(1874) function(577) }
{ decis(3086) make(1611) patient(1517) }
{ activ(1452) weight(1219) physic(1104) }
{ detect(2391) sensit(1101) algorithm(908) }

Resumo

JECTIVE: To comparatively evaluate the effectiveness of three different methods involving end-users for detecting usability problems in an EHR: user testing, semi-structured interviews and surveys.MATERIALS AND METHODS: Data were collected at two major urban dental schools from faculty, residents and dental students to assess the usability of a dental EHR for developing a treatment plan. These included user testing (N=32), semi-structured interviews (N=36), and surveys (N=35).RESULTS: The three methods together identified a total of 187 usability violations: 54% via user testing, 28% via the semi-structured interview and 18% from the survey method, with modest overlap. These usability problems were classified into 24 problem themes in 3 broad categories. User testing covered the broadest range of themes (83%), followed by the interview (63%) and survey (29%) methods.DISCUSSION: Multiple evaluation methods provide a comprehensive approach to identifying EHR usability challenges and specific problems. The three methods were found to be complementary, and thus each can provide unique insights for software enhancement. Interview and survey methods were found not to be sufficient by themselves, but when used in conjunction with the user testing method, they provided a comprehensive evaluation of the EHR.CONCLUSION: We recommend using a multi-method approach when testing the usability of health information technology because it provides a more comprehensive picture of usability challenges.

Resumo Limpo

jectiv compar evalu effect three differ method involv endus detect usabl problem ehr user test semistructur interview surveysmateri method data collect two major urban dental school faculti resid dental student assess usabl dental ehr develop treatment plan includ user test n semistructur interview n survey nresult three method togeth identifi total usabl violat via user test via semistructur interview survey method modest overlap usabl problem classifi problem theme broad categori user test cover broadest rang theme follow interview survey methodsdiscuss multipl evalu method provid comprehens approach identifi ehr usabl challeng specif problem three method found complementari thus can provid uniqu insight softwar enhanc interview survey method found suffici use conjunct user test method provid comprehens evalu ehrconclus recommend use multimethod approach test usabl health inform technolog provid comprehens pictur usabl challeng

Resumos Similares

J Am Med Inform Assoc - Paper- and computer-based workarounds to electronic health record use at three benchmark institutions. ( 0,735717945692734 )
Appl Clin Inform - A pilot study on usability analysis of emergency department information system by nurses. ( 0,729580931734384 )
Appl Clin Inform - An evaluation of the usability of a computerized decision support system for nursing homes. ( 0,705081594500131 )
AMIA Annu Symp Proc - A multi-perspective analysis of lessons learned from building an Integrated Care Coordination Information System (ICCIS). ( 0,665920279947981 )
J Am Med Inform Assoc - Information needs of case managers caring for persons living with HIV. ( 0,654945328959502 )
J Biomed Inform - Scenarios, personas and user stories: user-centered evidence-based design representations of communicable disease investigations. ( 0,654509977517974 )
BMC Med Inform Decis Mak - Qualitative evaluation of a diabetes electronic decision support tool: views of users. ( 0,649401175739837 )
J Am Med Inform Assoc - Content and functional specifications for a standards-based multidisciplinary rounding tool to maintain continuity across acute and critical care. ( 0,643642189493481 )
BMC Med Inform Decis Mak - Participatory eHealth development to support nurses in antimicrobial stewardship. ( 0,643419055454276 )
Int J Med Inform - Barriers and facilitators to the use of computer-based intensive insulin therapy. ( 0,639203992756694 )
Int J Med Inform - Bedside information technology to support patient-centered care. ( 0,638101619610638 )
Int J Med Inform - Evaluation of a comprehensive EHR based on the DeLone and McLean model for IS success: approach, results, and success factors. ( 0,631397048214094 )
Int J Med Inform - Use of a human factors approach to uncover informatics needs of nurses in documentation of care. ( 0,628575577411581 )
J Clin Monit Comput - Clinical refinement of the automatic lung parameter estimator (ALPE). ( 0,624196171467501 )
BMC Med Inform Decis Mak - Quality of prenatal and maternal care: bridging the know-do gap (QUALMAT study): an electronic clinical decision support system for rural Sub-Saharan Africa. ( 0,617696384375168 )
Appl Clin Inform - CAH to CAH: EHR implementation advice to critical access hospitals from peer experts and other key informants. ( 0,610300740038006 )
J Am Med Inform Assoc - Health information exchange technology on the front lines of healthcare: workflow factors and patterns of use. ( 0,604511845650652 )
Int J Med Inform - Coping with the unforeseen in surgical work. ( 0,602544481670078 )
J Biomed Inform - Content overlap in nurse and physician handoff artifacts and the potential role of electronic health records: a systematic review. ( 0,598778926496354 )
Appl Clin Inform - Advice for Decision Makers Based on an Electronic Health Record Evaluation at a Program for All-inclusive Care for Elders Site. ( 0,597220536610034 )
Inform Health Soc Care - Developing nurse educators' computer skills towards proficiency in nursing informatics. ( 0,593100780900669 )
Int J Med Inform - Use of electronic information systems in nursing management. ( 0,5905981634159 )
Int J Med Inform - The benefits of introducing electronic health records in residential aged care facilities: a multiple case study. ( 0,588657004155225 )
AMIA Annu Symp Proc - Ensuring patient safety in care transitions: an empirical evaluation of a Handoff Intervention Tool. ( 0,58757012935984 )
Int J Med Inform - Health information exchange in small-to-medium sized family medicine practices: motivators, barriers, and potential facilitators of adoption. ( 0,586912356396326 )
Perspect Health Inf Manag - Incorporating patient perspectives into the personal health record: implications for care and caring. ( 0,583446220825454 )
Telemed J E Health - Heuristic evaluation of online COPD respiratory therapy and education video resource center. ( 0,581166237100619 )
Int J Med Inform - Lost in translation: the challenges of seamless integration in nursing practices. ( 0,580746460128815 )
Methods Inf Med - Real-time feedback on nonverbal clinical communication. Theoretical framework and clinician acceptance of ambient visual design. ( 0,580660653851573 )
Int J Med Inform - A model of awareness to enhance our understanding of interprofessional collaborative care delivery and health information system design to support it. ( 0,579678925377441 )
Appl Clin Inform - Adoption of electronic health records: a qualitative study of academic and private physicians and health administrators. ( 0,57885363337023 )
Int J Med Inform - Unintended adverse consequences of introducing electronic health records in residential aged care homes. ( 0,57760580666328 )
Int J Med Inform - Icon and user interface design for emergency medical information systems: a case study. ( 0,576899777603578 )
J Am Med Inform Assoc - Evaluation of medium-term consequences of implementing commercial computerized physician order entry and clinical decision support prescribing systems in two 'early adopter' hospitals. ( 0,576749362110472 )
J Am Med Inform Assoc - A clinical decision support needs assessment of community-based physicians. ( 0,575281170951097 )
Int J Med Inform - Detection and characterization of usability problems in structured data entry interfaces in dentistry. ( 0,574678180534797 )
Appl Clin Inform - Structuring clinical workflows for diabetes care: an overview of the OntoHealth approach. ( 0,571562065264389 )
Int J Med Inform - Tensions of network security and collaborative work practice: understanding a single sign-on deployment in a regional hospital. ( 0,571436266244478 )
J Am Med Inform Assoc - Towards public health decision support: a systematic review of bidirectional communication approaches. ( 0,568904072367479 )
Inform Health Soc Care - Information practices of health care professionals related to patient discharge from hospital. ( 0,559892889847874 )
J Med Syst - How are health professionals using health information exchange systems? Measuring usage for evaluation and system improvement. ( 0,559401170258764 )
Appl Clin Inform - Dealing with the archetypes development process for a regional EHR system. ( 0,559289453776911 )
Telemed J E Health - Task-technology fit of video telehealth for nurses in an outpatient clinic setting. ( 0,558823670265943 )
J Biomed Inform - Informing the design of clinical decision support services for evaluation of children with minor blunt head trauma in the emergency department: a sociotechnical analysis. ( 0,557211977596123 )
Comput. Biol. Med. - Usability testing of a respiratory interface using computer screen and facial expressions videos. ( 0,556442638816182 )
J Med Syst - A secure 2G-RFID-Sys mechanism for applying to the medical emergency system. ( 0,555033219214221 )
AMIA Annu Symp Proc - Describing the Clinical Communication Space through a Model of Common Ground: 'you don't know what you don't know'. ( 0,554241740287594 )
Inform Health Soc Care - Nurses' use of an integrated electronic health record: results of a case site analysis. ( 0,554140498737877 )
Inform Health Soc Care - Adopting nursing health record standards. ( 0,553583454688184 )
J Biomed Inform - Computer-interpretable clinical guidelines: a methodological review. ( 0,551546578940121 )
Int J Med Inform - CareCoor: augmenting the coordination of cooperative home care work. ( 0,549645589531819 )
J Med Syst - Usability evaluation of Laboratory and Radiology Information Systems integrated into a hospital information system. ( 0,549366151164418 )
AMIA Annu Symp Proc - Finding hidden sources of new work from BCMA implementation: the value of an organizational routines perspective. ( 0,54922134418563 )
AMIA Annu Symp Proc - Cognitive design of a digital desk for the emergency room setting. ( 0,548930416443912 )
J Am Med Inform Assoc - Retail pharmacy staff perceptions of design strengths and weaknesses of electronic prescribing. ( 0,548517999123748 )
Comput Methods Programs Biomed - A preliminary study on the use of clinical care classification in nursing documentation data sets. ( 0,548490359303897 )
AMIA Annu Symp Proc - Characterization of a handoff documentation tool through usage log data. ( 0,54685951823 )
Appl Clin Inform - Clinician preferences for verbal communication compared to EHR documentation in the ICU. ( 0,546329741812195 )
AMIA Annu Symp Proc - Examining the Multi-level Fit between Work and Technology in a Secure Messaging Implementation. ( 0,54479135469988 )
BMC Med Inform Decis Mak - What is needed to implement a computer-assisted health risk assessment tool? An exploratory concept mapping study. ( 0,544499336527911 )
AMIA Annu Symp Proc - Optimization of an EHR mobile application using the UFuRT conceptual framework. ( 0,543726741911047 )
AMIA Annu Symp Proc - Electronic end-of-life care registry: the Utah ePOLST initiative. ( 0,543459164185095 )
J Am Med Inform Assoc - A patient-centered longitudinal care plan: vision versus reality. ( 0,543417221811878 )
Appl Clin Inform - User-centered design and usability testing of an innovative health-related quality of life module. ( 0,541663432942343 )
AMIA Annu Symp Proc - Coordination of care for complex pediatric patients: perspectives from providers and parents. ( 0,541658848279451 )
Int J Med Inform - The impact of medical record technologies on collaboration in emergency medicine. ( 0,540146963069539 )
J Biomed Inform - The use of fault reporting of medical equipment to identify latent design flaws. ( 0,538731228103022 )
Int J Med Inform - Perceived efficiency impacts following electronic health record implementation: an exploratory study of an urban community health center network. ( 0,537911441309899 )
Int J Med Inform - The success of a management information system in health care - a case study from Finland. ( 0,536145409766138 )
Appl Clin Inform - How could health information exchange better meet the needs of care practitioners? ( 0,534563059264362 )
J Am Med Inform Assoc - The discriminatory cost of ICD-10-CM transition between clinical specialties: metrics, case study, and mitigating tools. ( 0,534307639271937 )
Int J Med Inform - Using Cognitive Work Analysis to fit decision support tools to nurse managers' work flow. ( 0,534003110784626 )
J Biomed Inform - The clinician in the Driver's Seat: part 1 - a drag/drop user-composable electronic health record platform. ( 0,533904682062184 )
Telemed J E Health - Telehealth group interactions in the hospice setting: assessing technical quality across platforms. ( 0,533738549254782 )
J Am Med Inform Assoc - Governance for clinical decision support: case studies and recommended practices from leading institutions. ( 0,533591955679839 )
J Am Med Inform Assoc - Adoption of a wiki within a large internal medicine residency program: a 3-year experience. ( 0,533536292901348 )
Int J Med Inform - A combined disease management and process modeling approach for assessing and improving care processes: a fall management case-study. ( 0,532600839226352 )
J Med Syst - EHR implementation in a new clinic: a case study of clinician perceptions. ( 0,531812412705183 )
J Biomed Inform - Digital video analysis of health professionals' interactions with an electronic whiteboard: a longitudinal, naturalistic study of changes to user interactions. ( 0,531048856364404 )
BMC Med Inform Decis Mak - A qualitative evaluation of general practitioners' views on protocol-driven eReferral in Scotland. ( 0,530711665813496 )
Int J Med Inform - Addressing critical issues in the development of an Oncology Information System. ( 0,529130364254195 )
BMC Med Inform Decis Mak - Clinician attitudes toward and use of electronic problem lists: a thematic analysis. ( 0,527665365549345 )
J Am Med Inform Assoc - Intensive care unit nurses' information needs and recommendations for integrated displays to improve nurses' situation awareness. ( 0,526772054703347 )
Methods Inf Med - An observation tool for studying patient-oriented workflow in hospital emergency departments. ( 0,525670657480812 )
Int J Med Inform - Effects of a computerized decision support system on care planning for pressure ulcers and malnutrition in nursing homes: an intervention study. ( 0,524577019574642 )
Health Informatics J - Fitness for purpose when there are many different purposes: who are electronic patient records for? ( 0,524234543827442 )
J Med Syst - A mobile Nursing Information System based on human-computer interaction design for improving quality of nursing. ( 0,52384954609667 )
Int J Med Inform - The use of technology for urgent clinician to clinician communications: a systematic review of the literature. ( 0,522883796838919 )
Health Informatics J - Accessibility, usability, and usefulness of a Web-based clinical decision support tool to enhance provider-patient communication around Self-management TO Prevent (STOP) Stroke. ( 0,522442605418681 )
AMIA Annu Symp Proc - Development of a workflow integration survey (WIS) for implementing computerized clinical decision support. ( 0,522358565604169 )
Int J Med Inform - Guidelines for maternal and neonatal point of care: needs of and attitudes towards a computerized clinical decision support system in rural Burkina Faso. ( 0,522354158273574 )
Int J Med Inform - An exploration of the impact of computerized patient documentation on clinical collaboration. ( 0,522201955110337 )
Int J Med Inform - The importance of the verbal shift handover report: a multi-site case study. ( 0,522163555232569 )
J Am Med Inform Assoc - A qualitative study identifying the cost categories associated with electronic health record implementation in the UK. ( 0,51934352861625 )
BMC Med Inform Decis Mak - Prescriber and staff perceptions of an electronic prescribing system in primary care: a qualitative assessment. ( 0,51911600381512 )
AMIA Annu Symp Proc - Clinical decision support for whole genome sequence information leveraging a service-oriented architecture: a prototype. ( 0,517359336695279 )
J Biomed Inform - Bridging gaps in handoffs: a continuity of care based approach. ( 0,516594270847768 )
J. Med. Internet Res. - Usability testing of an online self-management program for adolescents with juvenile idiopathic arthritis. ( 0,515819168478 )
J Am Med Inform Assoc - Let the left hand know what the right is doing: a vision for care coordination and electronic health records. ( 0,515764074560138 )
Int J Med Inform - A study of user requests regarding the fully electronic health record system at Seoul National University Bundang Hospital: challenges for future electronic health record systems. ( 0,515630411808503 )