J Biomed Inform - A comparison of evaluation metrics for biomedical journals, articles, and websites in terms of sensitivity to topic.

Tópicos

{ search(2224) databas(1162) retriev(909) }
{ perform(999) metric(946) measur(919) }
{ use(2086) technolog(871) perceiv(783) }
{ can(774) often(719) complex(702) }
{ inform(2794) health(2639) internet(1427) }
{ imag(1057) registr(996) error(939) }
{ research(1085) discuss(1038) issu(1018) }
{ state(1844) use(1261) util(961) }
{ cost(1906) reduc(1198) effect(832) }
{ decis(3086) make(1611) patient(1517) }
{ method(2212) result(1239) propos(1039) }
{ featur(3375) classif(2383) classifi(1994) }
{ design(1359) user(1324) use(1319) }
{ general(901) number(790) one(736) }
{ model(2341) predict(2261) use(1141) }
{ result(1111) use(1088) new(759) }
{ estim(2440) model(1874) function(577) }
{ data(1737) use(1416) pattern(1282) }
{ take(945) account(800) differ(722) }
{ framework(1458) process(801) describ(734) }
{ method(1557) propos(1049) approach(1037) }
{ data(3963) clinic(1234) research(1004) }
{ visual(1396) interact(850) tool(830) }
{ compound(1573) activ(1297) structur(1058) }
{ studi(1119) effect(1106) posit(819) }
{ model(3480) simul(1196) paramet(876) }
{ can(981) present(881) function(850) }
{ activ(1452) weight(1219) physic(1104) }
{ model(3404) distribut(989) bayesian(671) }
{ imag(1947) propos(1133) code(1026) }
{ system(1976) rule(880) can(841) }
{ measur(2081) correl(1212) valu(896) }
{ bind(1733) structur(1185) ligand(1036) }
{ sequenc(1873) structur(1644) protein(1328) }
{ method(1219) similar(1157) match(930) }
{ imag(2830) propos(1344) filter(1198) }
{ network(2748) neural(1063) input(814) }
{ imag(2675) segment(2577) method(1081) }
{ patient(2315) diseas(1263) diabet(1191) }
{ studi(2440) review(1878) systemat(933) }
{ motion(1329) object(1292) video(1091) }
{ assess(1506) score(1403) qualiti(1306) }
{ treatment(1704) effect(941) patient(846) }
{ surgeri(1148) surgic(1085) robot(1054) }
{ problem(2511) optim(1539) algorithm(950) }
{ error(1145) method(1030) estim(1020) }
{ chang(1828) time(1643) increas(1301) }
{ learn(2355) train(1041) set(1003) }
{ concept(1167) ontolog(924) domain(897) }
{ clinic(1479) use(1117) guidelin(835) }
{ algorithm(1844) comput(1787) effici(935) }
{ extract(1171) text(1153) clinic(932) }
{ data(1714) softwar(1251) tool(1186) }
{ control(1307) perform(991) simul(935) }
{ model(2220) cell(1177) simul(1124) }
{ care(1570) inform(1187) nurs(1089) }
{ method(984) reconstruct(947) comput(926) }
{ featur(1941) imag(1645) propos(1176) }
{ case(1353) use(1143) diagnosi(1136) }
{ howev(809) still(633) remain(590) }
{ studi(1410) differ(1259) use(1210) }
{ risk(3053) factor(974) diseas(938) }
{ system(1050) medic(1026) inform(1018) }
{ import(1318) role(1303) understand(862) }
{ perform(1367) use(1326) method(1137) }
{ blood(1257) pressur(1144) flow(957) }
{ spatial(1525) area(1432) region(1030) }
{ record(1888) medic(1808) patient(1693) }
{ health(3367) inform(1360) care(1135) }
{ monitor(1329) mobil(1314) devic(1160) }
{ ehr(2073) health(1662) electron(1139) }
{ research(1218) medic(880) student(794) }
{ patient(2837) hospit(1953) medic(668) }
{ model(2656) set(1616) predict(1553) }
{ data(2317) use(1299) case(1017) }
{ age(1611) year(1155) adult(843) }
{ medic(1828) order(1363) alert(1069) }
{ signal(2180) analysi(812) frequenc(800) }
{ group(2977) signific(1463) compar(1072) }
{ sampl(1606) size(1419) use(1276) }
{ gene(2352) biolog(1181) express(1162) }
{ data(3008) multipl(1320) sourc(1022) }
{ first(2504) two(1366) second(1323) }
{ intervent(3218) particip(2042) group(1664) }
{ activ(1138) subject(705) human(624) }
{ time(1939) patient(1703) rate(768) }
{ patient(1821) servic(1111) care(1106) }
{ analysi(2126) use(1163) compon(1037) }
{ health(1844) social(1437) communiti(874) }
{ structur(1116) can(940) graph(676) }
{ high(1669) rate(1365) level(1280) }
{ cancer(2502) breast(956) screen(824) }
{ use(976) code(926) identifi(902) }
{ use(1733) differ(960) four(931) }
{ drug(1928) target(777) effect(648) }
{ implement(1333) system(1263) develop(1122) }
{ survey(1388) particip(1329) question(1065) }
{ process(1125) use(805) approach(778) }
{ method(1969) cluster(1462) data(1082) }
{ detect(2391) sensit(1101) algorithm(908) }

Resumo

Evaluating the biomedical literature and health-related websites for quality are challenging information retrieval tasks. Current commonly used methods include impact factor for journals, PubMed's clinical query filters and machine learning-based filter models for articles, and PageRank for websites. Previous work has focused on the average performance of these methods without considering the topic, and it is unknown how performance varies for specific topics or focused searches. Clinicians, researchers, and users should be aware when expected performance is not achieved for specific topics. The present work analyzes the behavior of these methods for a variety of topics. Impact factor, clinical query filters, and PageRank vary widely across different topics while a topic-specific impact factor and machine learning-based filter models are more stable. The results demonstrate that a method may perform excellently on average but struggle when used on a number of narrower topics. Topic-adjusted metrics and other topic robust methods have an advantage in such situations. Users of traditional topic-sensitive metrics should be aware of their limitations.

Resumo Limpo

evalu biomed literatur healthrel websit qualiti challeng inform retriev task current common use method includ impact factor journal pubm clinic queri filter machin learningbas filter model articl pagerank websit previous work focus averag perform method without consid topic unknown perform vari specif topic focus search clinician research user awar expect perform achiev specif topic present work analyz behavior method varieti topic impact factor clinic queri filter pagerank vari wide across differ topic topicspecif impact factor machin learningbas filter model stabl result demonstr method may perform excel averag struggl use number narrow topic topicadjust metric topic robust method advantag situat user tradit topicsensit metric awar limit

Resumos Similares

J Integr Bioinform - The LAILAPS search engine: a feature model for relevance ranking in life science databases. ( 0,783483084893947 )
Telemed J E Health - MEDLINE versus EMBASE and CINAHL for telemedicine searches. ( 0,780626965277711 )
Health Info Libr J - Medical literature searches: a comparison of PubMed and Google Scholar. ( 0,779481679503297 )
Methods Inf Med - Learning the preferences of physicians for the organization of result lists of medical evidence articles. ( 0,763278036621458 )
J. Med. Internet Res. - Retrieving clinical evidence: a comparison of PubMed and Google Scholar for quick clinical searches. ( 0,76249168217346 )
J Chem Inf Model - Speeding up chemical searches using the inverted index: the convergence of chemoinformatics and text search methods. ( 0,760535664157491 )
J. Med. Internet Res. - Definition of Health 2.0 and Medicine 2.0: a systematic review. ( 0,75645367753514 )
J Integr Bioinform - Classification methods for finding articles describing protein-protein interactions in PubMed. ( 0,755543680046828 )
J Am Med Inform Assoc - Search filters to identify geriatric medicine in Medline. ( 0,742675535861355 )
J. Med. Internet Res. - Sensitivity and predictive value of 15 PubMed search strategies to answer clinical questions rated against full systematic reviews. ( 0,737450445786613 )
J Biomed Inform - On the query reformulation technique for effective MEDLINE document retrieval. ( 0,736218802450196 )
J. Med. Internet Res. - Development and validation of filters for the retrieval of studies of clinical examination from Medline. ( 0,731670766307321 )
BMC Med Inform Decis Mak - Publication trends of shared decision making in 15 high impact medical journals: a full-text review with bibliometric analysis. ( 0,720079848738598 )
BMC Med Inform Decis Mak - Glomerular disease search filters for Pubmed, Ovid Medline, and Embase: a development and validation study. ( 0,719726342296319 )
Health Info Libr J - Facilitating access to evidence: Primary Health Care Search Filter. ( 0,716174852962348 )
AMIA Annu Symp Proc - Evaluation of automated term groupings for detecting anaphylactic shock signals for drugs. ( 0,715989087332764 )
AMIA Annu Symp Proc - Search filter precision can be improved by NOTing out irrelevant content. ( 0,713174658722373 )
AMIA Annu Symp Proc - Does query expansion limit our learning? A comparison of social-based expansion to content-based expansion for medical queries on the internet. ( 0,712462289768249 )
Int J Med Inform - An analysis of clinical queries in an electronic health record search utility. ( 0,70691980050978 )
Health Info Libr J - Searching for randomised controlled trials and clinical controlled trials in Thai online bibliographical biomedical databases. ( 0,706010917447469 )
Int J Health Geogr - HEALTH GeoJunction: place-time-concept browsing of health publications. ( 0,704314769912251 )
J Am Med Inform Assoc - Retrieval of diagnostic and treatment studies for clinical use through PubMed and PubMed's Clinical Queries filters. ( 0,702239534482201 )
J. Med. Internet Res. - A search engine to access PubMed monolingual subsets: proof of concept and evaluation in French. ( 0,701125991569861 )
J Biomed Inform - MeSHy: Mining unanticipated PubMed information using frequencies of occurrences and concurrences of MeSH terms. ( 0,698294494757266 )
J Biomed Inform - Supporting effective health and biomedical information retrieval and navigation: a novel facet view interface evaluation. ( 0,696487206706649 )
Health Info Libr J - Utilisation of search filters in systematic reviews of prognosis questions. ( 0,69552781175501 )
J. Med. Internet Res. - Using Internet search engines to obtain medical information: a comparative study. ( 0,692337545704551 )
J Integr Bioinform - A query suggestion workflow for life science IR-systems. ( 0,691694767082477 )
Int J Med Inform - MEDRank: using graph-based concept ranking to index biomedical texts. ( 0,690077907909093 )
Health Info Libr J - Assessment of indexing trends with specific and general terms for herbal medicine. ( 0,68790378028456 )
BMC Med Inform Decis Mak - Boolean versus ranked querying for biomedical systematic reviews. ( 0,687432027678181 )
Brief. Bioinformatics - Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees. ( 0,686574352491618 )
Inform Health Soc Care - Readability of online health information: implications for health literacy. ( 0,686475507403003 )
J Integr Bioinform - On comparison of SimTandem with state-of-the-art peptide identification tools, efficiency of precursor mass filter and dealing with variable modifications. ( 0,684671389646274 )
J Am Med Inform Assoc - Search terms and a validated brief search filter to retrieve publications on health-related values in Medline: a word frequency analysis study. ( 0,683017348218698 )
J Integr Bioinform - The LAILAPS search engine: relevance ranking in life science databases. ( 0,677422309546714 )
J Am Med Inform Assoc - Leveraging medical thesauri and physician feedback for improving medical literature retrieval for case queries. ( 0,677159119618921 )
Methods Inf Med - Developing topic-specific search filters for PubMed with click-through data. ( 0,675755306672667 )
J Telemed Telecare - How to improve your PubMed/MEDLINE searches: 1. background and basic searching. ( 0,675136104227696 )
J Am Med Inform Assoc - MEDLINE clinical queries are robust when searching in recent publishing years. ( 0,673711324417438 )
BMC Med Inform Decis Mak - BOSS: context-enhanced search for biomedical objects. ( 0,672745787805728 )
J Biomed Inform - Reflective random indexing for semi-automatic indexing of the biomedical literature. ( 0,672534283183587 )
J Biomed Inform - Improving search over Electronic Health Records using UMLS-based query expansion through random walks. ( 0,6700437450966 )
J. Med. Internet Res. - The impact of search engine selection and sorting criteria on vaccination beliefs and attitudes: two experiments manipulating Google output. ( 0,669676265436304 )
IEEE Trans Vis Comput Graph - WORDGRAPH: Keyword-in-Context Visualization for NETSPEAK's Wildcard Search. ( 0,669559212592704 )
J Am Med Inform Assoc - Improving image retrieval effectiveness via query expansion using MeSH hierarchical structure. ( 0,669113610134423 )
J Biomed Inform - Development and evaluation of a biomedical search engine using a predicate-based vector space model. ( 0,667974355357096 )
J Am Med Inform Assoc - Directing the public to evidence-based online content. ( 0,667723661214019 )
Health Info Libr J - The performance of adverse effects search filters in MEDLINE and EMBASE. ( 0,665682737548668 )
BMC Med Inform Decis Mak - Performance evaluation of Unified Medical Language System?'s synonyms expansion to query PubMed. ( 0,663768949734987 )
Health Info Libr J - Developing a geographic search filter to identify randomised controlled trials in Africa: finding the optimal balance between sensitivity and precision. ( 0,663631861318242 )
AMIA Annu Symp Proc - Finding and accessing diagrams in biomedical publications. ( 0,662688946643586 )
Health Info Libr J - Sensitivity and precision of adverse effects search filters in MEDLINE and EMBASE: a case study of fractures with thiazolidinediones. ( 0,661276689350995 )
BMC Med Inform Decis Mak - CDAPubMed: a browser extension to retrieve EHR-based biomedical literature. ( 0,657090325502607 )
J Am Med Inform Assoc - Design and usability study of an iconic user interface to ease information retrieval of medical guidelines. ( 0,651004616016822 )
J Med Syst - MIRASS: medical informatics research activity support system using information mashup network. ( 0,644681815437128 )
J. Med. Internet Res. - Accessing suicide-related information on the internet: a retrospective observational study of search behavior. ( 0,635994473822033 )
AMIA Annu Symp Proc - BIOSPIDA: A Relational Database Translator for NCBI. ( 0,635925054665232 )
J Am Med Inform Assoc - A literature search tool for intelligent extraction of disease-associated genes. ( 0,63317784441593 )
Perspect Health Inf Manag - Risk factors for bladder cancer: challenges of conducting a literature search using PubMed. ( 0,630285866867252 )
Brief. Bioinformatics - Fast and efficient searching of biological data resources--using EB-eye. ( 0,630034535440091 )
AMIA Annu Symp Proc - A bottom-up approach to MEDLINE indexing recommendations. ( 0,628091696316659 )
AMIA Annu Symp Proc - Using Co-Authoring and Cross-Referencing Information for MEDLINE Indexing. ( 0,626345342022832 )
J Biomed Inform - Using statistical text mining to supplement the development of an ontology. ( 0,623851515028473 )
Methods Inf Med - Technology-induced errors. The current use of frameworks and models from the biomedical and life sciences literatures. ( 0,622831968085658 )
AMIA Annu Symp Proc - An automated approach for ranking journals to help in clinician decision support. ( 0,622612135860383 )
AMIA Annu Symp Proc - Query log analysis of an electronic health record search engine. ( 0,620996633394603 )
Int J Med Inform - FindZebra: a search engine for rare diseases. ( 0,616079223346046 )
AMIA Annu Symp Proc - Web to world: predicting transitions from self-diagnosis to the pursuit of local medical assistance in web search. ( 0,612376965127968 )
Artif Intell Med - Adaptation of machine translation for multilingual information retrieval in the medical domain. ( 0,61230892978703 )
J Am Med Inform Assoc - Automatically extracting sentences from Medline citations to support clinicians' information needs. ( 0,611973607749328 )
Health Info Libr J - Can we prioritise which databases to search? A case study using a systematic review of frozen shoulder management. ( 0,611295993104155 )
J Biomed Inform - A semi-supervised approach to extract pharmacogenomics-specific drug-gene pairs from biomedical literature for personalized medicine. ( 0,610716249737856 )
Health Info Libr J - Where and how to search for information on the effectiveness of public health interventions - a case study for prevention of cardiovascular disease. ( 0,610583619465238 )
J Chem Inf Model - Chemical and biological properties of frequent screening hits. ( 0,609883584402777 )
Methods Inf Med - A survey on visual information search behavior and requirements of radiologists. ( 0,608442860941191 )
Comput Methods Programs Biomed - METRADISC-XL: a program for meta-analysis of multidimensional ranked discovery oriented datasets including microarrays. ( 0,606996890081726 )
J. Med. Internet Res. - Comparative analysis of online health queries originating from personal computers and smart devices on a consumer health information portal. ( 0,606701032908773 )
J Am Med Inform Assoc - Clinical research data warehouse governance for distributed research networks in the USA: a systematic review of the literature. ( 0,60638057763534 )
BMC Med Inform Decis Mak - A study on PubMed search tag usage pattern: association rule mining of a full-day PubMed query log. ( 0,605373938526957 )
J. Med. Internet Res. - Clinician search behaviors may be influenced by search engine design. ( 0,60063317307755 )
J Biomed Inform - Knowledge-based personalized search engine for the Web-based Human Musculoskeletal System Resources (HMSR) in biomechanics. ( 0,599797446995942 )
J Biomed Inform - A mutation-centric approach to identifying pharmacogenomic relations in text. ( 0,599182112875188 )
J Chem Inf Model - Efficient substructure searching of large chemical libraries: the ABCD chemical cartridge. ( 0,598993477743617 )
BMC Med Inform Decis Mak - Dynamic summarization of bibliographic-based data. ( 0,597814831320104 )
Health Info Libr J - Searching MEDLINE for Aboriginal and Torres Strait Islander health literature: questionable sensitivity. ( 0,597795545890985 )
Telemed J E Health - A web search on environmental topics: what is the role of ranking? ( 0,597283903496495 )
Int J Med Inform - A study of the influence of task familiarity on user behaviors and performance with a MeSH term suggestion interface for PubMed bibliographic search. ( 0,596307539988569 )
Res Synth Methods - Comprehensive computer searches and reporting in systematic reviews. ( 0,594410864594793 )
J. Med. Internet Res. - Net improvement of correct answers to therapy questions after pubmed searches: pre/post comparison. ( 0,588038212181474 )
AMIA Annu Symp Proc - Optimizing the txt2MEDLINE search portal for low-resource clinical decision support. ( 0,586224086109577 )
Telemed J E Health - A working lexicon for the tele-intensive care unit: we need to define tele-intensive care unit to grow and understand it. ( 0,58544907758413 )
AMIA Annu Symp Proc - Author keywords in biomedical journal articles. ( 0,583632535296692 )
J Am Med Inform Assoc - A practical approach to achieve private medical record linkage in light of public resources. ( 0,582732855234235 )
J. Med. Internet Res. - Searching for truth: internet search patterns as a method of investigating online responses to a Russian illicit drug policy debate. ( 0,582382021290256 )
J Integr Bioinform - GMB: an efficient query processor for biological data. ( 0,5814999169502 )
Int J Med Inform - The publication echo: effects of retrieving literature in PubMed by year of publication. ( 0,574514896809424 )
J. Med. Internet Res. - Cumulative query method for influenza surveillance using search engine data. ( 0,574408260535046 )
J. Med. Internet Res. - Automatic evidence retrieval for systematic reviews. ( 0,573161097225501 )
AMIA Annu Symp Proc - Mobile app versus Web app: a comparison using 2008-2012 PubMed for Handhelds server data. ( 0,569204275178108 )