Methods Inf Med - Learning the preferences of physicians for the organization of result lists of medical evidence articles.


{ search(2224) databas(1162) retriev(909) }
{ can(981) present(881) function(850) }
{ decis(3086) make(1611) patient(1517) }
{ take(945) account(800) differ(722) }
{ method(1557) propos(1049) approach(1037) }
{ use(1733) differ(960) four(931) }
{ use(2086) technolog(871) perceiv(783) }
{ detect(2391) sensit(1101) algorithm(908) }
{ patient(2837) hospit(1953) medic(668) }
{ record(1888) medic(1808) patient(1693) }
{ concept(1167) ontolog(924) domain(897) }
{ design(1359) user(1324) use(1319) }
{ blood(1257) pressur(1144) flow(957) }
{ state(1844) use(1261) util(961) }
{ inform(2794) health(2639) internet(1427) }
{ case(1353) use(1143) diagnosi(1136) }
{ howev(809) still(633) remain(590) }
{ import(1318) role(1303) understand(862) }
{ age(1611) year(1155) adult(843) }
{ time(1939) patient(1703) rate(768) }
{ method(2212) result(1239) propos(1039) }
{ can(774) often(719) complex(702) }
{ measur(2081) correl(1212) valu(896) }
{ assess(1506) score(1403) qualiti(1306) }
{ error(1145) method(1030) estim(1020) }
{ clinic(1479) use(1117) guidelin(835) }
{ compound(1573) activ(1297) structur(1058) }
{ data(3008) multipl(1320) sourc(1022) }
{ intervent(3218) particip(2042) group(1664) }
{ result(1111) use(1088) new(759) }
{ imag(2675) segment(2577) method(1081) }
{ patient(2315) diseas(1263) diabet(1191) }
{ surgeri(1148) surgic(1085) robot(1054) }
{ framework(1458) process(801) describ(734) }
{ learn(2355) train(1041) set(1003) }
{ medic(1828) order(1363) alert(1069) }
{ group(2977) signific(1463) compar(1072) }
{ first(2504) two(1366) second(1323) }
{ patient(1821) servic(1111) care(1106) }
{ analysi(2126) use(1163) compon(1037) }
{ structur(1116) can(940) graph(676) }
{ high(1669) rate(1365) level(1280) }
{ use(976) code(926) identifi(902) }
{ survey(1388) particip(1329) question(1065) }
{ estim(2440) model(1874) function(577) }
{ activ(1452) weight(1219) physic(1104) }
{ model(3404) distribut(989) bayesian(671) }
{ imag(1947) propos(1133) code(1026) }
{ data(1737) use(1416) pattern(1282) }
{ system(1976) rule(880) can(841) }
{ imag(1057) registr(996) error(939) }
{ bind(1733) structur(1185) ligand(1036) }
{ sequenc(1873) structur(1644) protein(1328) }
{ method(1219) similar(1157) match(930) }
{ featur(3375) classif(2383) classifi(1994) }
{ imag(2830) propos(1344) filter(1198) }
{ network(2748) neural(1063) input(814) }
{ studi(2440) review(1878) systemat(933) }
{ motion(1329) object(1292) video(1091) }
{ treatment(1704) effect(941) patient(846) }
{ problem(2511) optim(1539) algorithm(950) }
{ chang(1828) time(1643) increas(1301) }
{ algorithm(1844) comput(1787) effici(935) }
{ extract(1171) text(1153) clinic(932) }
{ data(1714) softwar(1251) tool(1186) }
{ control(1307) perform(991) simul(935) }
{ model(2220) cell(1177) simul(1124) }
{ care(1570) inform(1187) nurs(1089) }
{ general(901) number(790) one(736) }
{ method(984) reconstruct(947) comput(926) }
{ featur(1941) imag(1645) propos(1176) }
{ data(3963) clinic(1234) research(1004) }
{ studi(1410) differ(1259) use(1210) }
{ risk(3053) factor(974) diseas(938) }
{ perform(999) metric(946) measur(919) }
{ research(1085) discuss(1038) issu(1018) }
{ system(1050) medic(1026) inform(1018) }
{ model(2341) predict(2261) use(1141) }
{ visual(1396) interact(850) tool(830) }
{ perform(1367) use(1326) method(1137) }
{ studi(1119) effect(1106) posit(819) }
{ spatial(1525) area(1432) region(1030) }
{ health(3367) inform(1360) care(1135) }
{ model(3480) simul(1196) paramet(876) }
{ monitor(1329) mobil(1314) devic(1160) }
{ ehr(2073) health(1662) electron(1139) }
{ research(1218) medic(880) student(794) }
{ model(2656) set(1616) predict(1553) }
{ data(2317) use(1299) case(1017) }
{ signal(2180) analysi(812) frequenc(800) }
{ cost(1906) reduc(1198) effect(832) }
{ sampl(1606) size(1419) use(1276) }
{ gene(2352) biolog(1181) express(1162) }
{ activ(1138) subject(705) human(624) }
{ health(1844) social(1437) communiti(874) }
{ cancer(2502) breast(956) screen(824) }
{ drug(1928) target(777) effect(648) }
{ implement(1333) system(1263) develop(1122) }
{ process(1125) use(805) approach(778) }
{ method(1969) cluster(1462) data(1082) }


CKGROUND: Online medical knowledge repositories such as MEDLINE and The Cochrane Library are increasingly used by physicians to retrieve articles to aid with clinical decision making. The prevailing approach for organizing retrieved articles is in the form of a rank-ordered list, with the assumption that the higher an article is presented on a list, the more relevant it is.OBJECTIVES: Despite this common list-based organization, it is seldom studied how physicians perceive the association between the relevance of articles and the order in which articles are presented. In this paper we describe a case study that captured physician preferences for 3-element lists of medical articles in order to learn how to organize medical knowledge for decision-making.METHODS: Comprehensive relevance evaluations were developed to represent 3-element lists of hypothetical articles that may be retrieved from an online medical knowledge source such as MEDLINE or The Cochrane Library. Comprehensive relevance evaluations asses not only an article's relevance for a query, but also whether it has been placed on the correct list position. In other words an article may be relevant and correctly placed on a result list (e.g. the most relevant article appears first in the result list), an article may be relevant for a query but placed on an incorrect list position (e.g. the most relevant article appears second in a result list), or an article may be irrelevant for a query yet still appear in the result list. The relevance evaluations were presented to six senior physicians who were asked to express their preferences for an article's relevance and its position on a list by pairwise comparisons representing different combinations of 3-element lists. The elicited preferences were assessed using a novel GRIP (Generalized Regression with Intensities of Preference) method and represented as an additive value function. Value functions were derived for individual physicians as well as the group of physicians.RESULTS: The results show that physicians assign significant value to the 1st position on a list and they expect that the most relevant article is presented first. Whilst physicians still prefer obtaining a correctly placed article on position 2, they are also quite satisfied with misplaced relevant article. Low consideration of the 3rd position was uniformly confirmed.CONCLUSIONS: Our findings confirm the importance of placing the most relevant article on the 1st position on a list and the importance paid to position on a list significantly diminishes after the 2nd position. The derived value functions may be used by developers of clinical decision support applications to decide how best to organize medical knowledge for decision making and to create personalized evaluation measures that can augment typical measures used to evaluate information retrieval systems.

Resumo Limpo

ckground onlin medic knowledg repositori medlin cochran librari increas use physician retriev articl aid clinic decis make prevail approach organ retriev articl form rankord list assumpt higher articl present list relev isobject despit common listbas organ seldom studi physician perceiv associ relev articl order articl present paper describ case studi captur physician prefer element list medic articl order learn organ medic knowledg decisionmakingmethod comprehens relev evalu develop repres element list hypothet articl may retriev onlin medic knowledg sourc medlin cochran librari comprehens relev evalu ass articl relev queri also whether place correct list posit word articl may relev correct place result list eg relev articl appear first result list articl may relev queri place incorrect list posit eg relev articl appear second result list articl may irrelev queri yet still appear result list relev evalu present six senior physician ask express prefer articl relev posit list pairwis comparison repres differ combin element list elicit prefer assess use novel grip general regress intens prefer method repres addit valu function valu function deriv individu physician well group physiciansresult result show physician assign signific valu st posit list expect relev articl present first whilst physician still prefer obtain correct place articl posit also quit satisfi misplac relev articl low consider rd posit uniform confirmedconclus find confirm import place relev articl st posit list import paid posit list signific diminish nd posit deriv valu function may use develop clinic decis support applic decid best organ medic knowledg decis make creat person evalu measur can augment typic measur use evalu inform retriev system

Resumos Similares

J. Med. Internet Res. - Sensitivity and predictive value of 15 PubMed search strategies to answer clinical questions rated against full systematic reviews. ( 0,897383225357344 )
Telemed J E Health - MEDLINE versus EMBASE and CINAHL for telemedicine searches. ( 0,896383805459752 )
BMC Med Inform Decis Mak - Glomerular disease search filters for Pubmed, Ovid Medline, and Embase: a development and validation study. ( 0,89445222562164 )
J Am Med Inform Assoc - Search filters to identify geriatric medicine in Medline. ( 0,880368423143182 )
Health Info Libr J - Medical literature searches: a comparison of PubMed and Google Scholar. ( 0,878308430749428 )
AMIA Annu Symp Proc - Search filter precision can be improved by NOTing out irrelevant content. ( 0,877107109315894 )
J. Med. Internet Res. - Retrieving clinical evidence: a comparison of PubMed and Google Scholar for quick clinical searches. ( 0,875275826915964 )
AMIA Annu Symp Proc - Evaluation of automated term groupings for detecting anaphylactic shock signals for drugs. ( 0,867276077089727 )
J Biomed Inform - On the query reformulation technique for effective MEDLINE document retrieval. ( 0,866380569042271 )
J Integr Bioinform - The LAILAPS search engine: a feature model for relevance ranking in life science databases. ( 0,86622579651907 )
J Am Med Inform Assoc - MEDLINE clinical queries are robust when searching in recent publishing years. ( 0,861938071073742 )
J. Med. Internet Res. - Development and validation of filters for the retrieval of studies of clinical examination from Medline. ( 0,86148386524509 )
Health Info Libr J - Searching for randomised controlled trials and clinical controlled trials in Thai online bibliographical biomedical databases. ( 0,858468172909802 )
J Am Med Inform Assoc - Retrieval of diagnostic and treatment studies for clinical use through PubMed and PubMed's Clinical Queries filters. ( 0,850081648997434 )
BMC Med Inform Decis Mak - Publication trends of shared decision making in 15 high impact medical journals: a full-text review with bibliometric analysis. ( 0,838295143273928 )
Health Info Libr J - Facilitating access to evidence: Primary Health Care Search Filter. ( 0,826672809182271 )
Health Info Libr J - The performance of adverse effects search filters in MEDLINE and EMBASE. ( 0,825813192015151 )
Health Info Libr J - Utilisation of search filters in systematic reviews of prognosis questions. ( 0,823086326345182 )
Health Info Libr J - Assessment of indexing trends with specific and general terms for herbal medicine. ( 0,814078155297022 )
J Biomed Inform - MeSHy: Mining unanticipated PubMed information using frequencies of occurrences and concurrences of MeSH terms. ( 0,813028956699373 )
Health Info Libr J - Developing a geographic search filter to identify randomised controlled trials in Africa: finding the optimal balance between sensitivity and precision. ( 0,808789692200686 )
J Integr Bioinform - Classification methods for finding articles describing protein-protein interactions in PubMed. ( 0,808628873084602 )
Int J Health Geogr - HEALTH GeoJunction: place-time-concept browsing of health publications. ( 0,808360738066296 )
BMC Med Inform Decis Mak - Performance evaluation of Unified Medical Language System?'s synonyms expansion to query PubMed. ( 0,808055471546039 )
J Am Med Inform Assoc - Search terms and a validated brief search filter to retrieve publications on health-related values in Medline: a word frequency analysis study. ( 0,806858888098672 )
J. Med. Internet Res. - Definition of Health 2.0 and Medicine 2.0: a systematic review. ( 0,805458260644433 )
Int J Med Inform - An analysis of clinical queries in an electronic health record search utility. ( 0,804778933329912 )
BMC Med Inform Decis Mak - Boolean versus ranked querying for biomedical systematic reviews. ( 0,798471896974837 )
J Integr Bioinform - A query suggestion workflow for life science IR-systems. ( 0,79705369690188 )
J. Med. Internet Res. - A search engine to access PubMed monolingual subsets: proof of concept and evaluation in French. ( 0,797035604246263 )
Health Info Libr J - Sensitivity and precision of adverse effects search filters in MEDLINE and EMBASE: a case study of fractures with thiazolidinediones. ( 0,795345872753589 )
Methods Inf Med - Developing topic-specific search filters for PubMed with click-through data. ( 0,791817527729368 )
Res Synth Methods - Comprehensive computer searches and reporting in systematic reviews. ( 0,79180935997511 )
AMIA Annu Symp Proc - Does query expansion limit our learning? A comparison of social-based expansion to content-based expansion for medical queries on the internet. ( 0,787203498516983 )
J. Med. Internet Res. - Using Internet search engines to obtain medical information: a comparative study. ( 0,779746488413351 )
J Biomed Inform - Reflective random indexing for semi-automatic indexing of the biomedical literature. ( 0,775673739506087 )
J Biomed Inform - Development and evaluation of a biomedical search engine using a predicate-based vector space model. ( 0,772492101319268 )
J Am Med Inform Assoc - Automatically extracting sentences from Medline citations to support clinicians' information needs. ( 0,77226978872622 )
J Telemed Telecare - How to improve your PubMed/MEDLINE searches: 1. background and basic searching. ( 0,769655043202326 )
BMC Med Inform Decis Mak - BOSS: context-enhanced search for biomedical objects. ( 0,768232595420021 )
J Integr Bioinform - The LAILAPS search engine: relevance ranking in life science databases. ( 0,766236836422445 )
J Med Syst - MIRASS: medical informatics research activity support system using information mashup network. ( 0,763656160884437 )
J Biomed Inform - A comparison of evaluation metrics for biomedical journals, articles, and websites in terms of sensitivity to topic. ( 0,763278036621458 )
IEEE Trans Vis Comput Graph - WORDGRAPH: Keyword-in-Context Visualization for NETSPEAK's Wildcard Search. ( 0,761497158005523 )
J Biomed Inform - Using statistical text mining to supplement the development of an ontology. ( 0,759599821822634 )
Int J Med Inform - MEDRank: using graph-based concept ranking to index biomedical texts. ( 0,758542712578398 )
BMC Med Inform Decis Mak - CDAPubMed: a browser extension to retrieve EHR-based biomedical literature. ( 0,757712136353925 )
J Am Med Inform Assoc - A literature search tool for intelligent extraction of disease-associated genes. ( 0,750705781122634 )
J Biomed Inform - Improving search over Electronic Health Records using UMLS-based query expansion through random walks. ( 0,748946704379937 )
AMIA Annu Symp Proc - BIOSPIDA: A Relational Database Translator for NCBI. ( 0,746005039812493 )
Brief. Bioinformatics - Fast and efficient searching of biological data resources--using EB-eye. ( 0,743936000392927 )
Inform Health Soc Care - Readability of online health information: implications for health literacy. ( 0,743652488995403 )
AMIA Annu Symp Proc - A bottom-up approach to MEDLINE indexing recommendations. ( 0,743641427509173 )
AMIA Annu Symp Proc - Using Co-Authoring and Cross-Referencing Information for MEDLINE Indexing. ( 0,740729485884427 )
J Am Med Inform Assoc - Improving image retrieval effectiveness via query expansion using MeSH hierarchical structure. ( 0,734337664122455 )
AMIA Annu Symp Proc - Query log analysis of an electronic health record search engine. ( 0,734063869783922 )
J Am Med Inform Assoc - Directing the public to evidence-based online content. ( 0,73060679699775 )
J. Med. Internet Res. - Clinician search behaviors may be influenced by search engine design. ( 0,73045838193463 )
Int J Med Inform - FindZebra: a search engine for rare diseases. ( 0,72936840850161 )
J Am Med Inform Assoc - Design and usability study of an iconic user interface to ease information retrieval of medical guidelines. ( 0,725758967196535 )
Sci Data - Erratum: Parallel genome-scale loss of function screens in 216 cancer cell lines for the identification of context-specific genetic dependencies. ( 0,725447271694174 )
J Biomed Inform - Supporting effective health and biomedical information retrieval and navigation: a novel facet view interface evaluation. ( 0,723167112529138 )
J Biomed Inform - A semi-supervised approach to extract pharmacogenomics-specific drug-gene pairs from biomedical literature for personalized medicine. ( 0,718940894821551 )
Health Info Libr J - Can we prioritise which databases to search? A case study using a systematic review of frozen shoulder management. ( 0,718629979068827 )
Perspect Health Inf Manag - Risk factors for bladder cancer: challenges of conducting a literature search using PubMed. ( 0,716222979531081 )
Health Info Libr J - Where and how to search for information on the effectiveness of public health interventions - a case study for prevention of cardiovascular disease. ( 0,714409739322561 )
J. Med. Internet Res. - Net improvement of correct answers to therapy questions after pubmed searches: pre/post comparison. ( 0,708386911145382 )
J Chem Inf Model - Speeding up chemical searches using the inverted index: the convergence of chemoinformatics and text search methods. ( 0,708309430200565 )
J Am Med Inform Assoc - A practical approach to achieve private medical record linkage in light of public resources. ( 0,707297265950878 )
J. Med. Internet Res. - The impact of search engine selection and sorting criteria on vaccination beliefs and attitudes: two experiments manipulating Google output. ( 0,706188748853698 )
J Chem Inf Model - Efficient substructure searching of large chemical libraries: the ABCD chemical cartridge. ( 0,704325809913128 )
Int J Med Inform - The publication echo: effects of retrieving literature in PubMed by year of publication. ( 0,704287290467373 )
Methods Inf Med - A survey on visual information search behavior and requirements of radiologists. ( 0,704132775910808 )
J. Med. Internet Res. - Automatic evidence retrieval for systematic reviews. ( 0,698059644543593 )
J Biomed Inform - Improving MeSH classification of biomedical articles using citation contexts. ( 0,695344007545221 )
Int J Med Inform - A study of the influence of task familiarity on user behaviors and performance with a MeSH term suggestion interface for PubMed bibliographic search. ( 0,69506568513622 )
Methods Inf Med - Technology-induced errors. The current use of frameworks and models from the biomedical and life sciences literatures. ( 0,694615276097353 )
J Biomed Inform - Knowledge-based personalized search engine for the Web-based Human Musculoskeletal System Resources (HMSR) in biomechanics. ( 0,690985977972753 )
Med Decis Making - How do physicians provide statistical information about antidepressants to hypothetical patients? ( 0,686930219919872 )
BMC Med Inform Decis Mak - How are the different specialties represented in the major journals in general medicine? ( 0,686492087332753 )
J Am Med Inform Assoc - Clinical research data warehouse governance for distributed research networks in the USA: a systematic review of the literature. ( 0,685461459745555 )
Telemed J E Health - A web search on environmental topics: what is the role of ranking? ( 0,683753372818147 )
J Integr Bioinform - GMB: an efficient query processor for biological data. ( 0,681484609928132 )
BMC Med Inform Decis Mak - Pharmacoeconomics and its implication on priority-setting for essential medicines in Tanzania: a systematic review. ( 0,675607855718707 )
AMIA Annu Symp Proc - An automated approach for ranking journals to help in clinician decision support. ( 0,666752261792253 )
AMIA Annu Symp Proc - Finding and accessing diagrams in biomedical publications. ( 0,666207707010594 )
Health Info Libr J - Searching MEDLINE for Aboriginal and Torres Strait Islander health literature: questionable sensitivity. ( 0,663152504526987 )
AMIA Annu Symp Proc - Optimizing the txt2MEDLINE search portal for low-resource clinical decision support. ( 0,661757178173016 )
Res Synth Methods - Inquisitio validus Index Medicus: A simple method of validating MEDLINE systematic review searches. ( 0,660418464645516 )
J. Med. Internet Res. - Comparative analysis of online health queries originating from personal computers and smart devices on a consumer health information portal. ( 0,657700924242541 )
BMC Med Inform Decis Mak - Information discovery on electronic health records using authority flow techniques. ( 0,657088143826337 )
J Am Med Inform Assoc - Leveraging medical thesauri and physician feedback for improving medical literature retrieval for case queries. ( 0,65609077196118 )
J Biomed Inform - A mutation-centric approach to identifying pharmacogenomic relations in text. ( 0,655989312633456 )
J Am Med Inform Assoc - Federated queries of clinical data repositories: the sum of the parts does not equal the whole. ( 0,653860310000869 )
AMIA Annu Symp Proc - Barriers to retrieving patient information from electronic health record data: failure analysis from the TREC Medical Records Track. ( 0,652091720752343 )
Brief. Bioinformatics - Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees. ( 0,652041015931492 )
J. Med. Internet Res. - Searching for truth: internet search patterns as a method of investigating online responses to a Russian illicit drug policy debate. ( 0,650290698456721 )
J Am Med Inform Assoc - Automatic detection of omissions in medication lists. ( 0,649588376742846 )
AMIA Annu Symp Proc - MeSH term explosion and author rank improve expert recommendations. ( 0,646796590307909 )
J Chem Inf Model - Critical analysis of CCSD data quality. ( 0,644646390339714 )