Methods Inf Med - The evolution of boosting algorithms. From machine learning to statistical modelling.

Tópicos

{ learn(2355) train(1041) set(1003) }
{ model(3404) distribut(989) bayesian(671) }
{ problem(2511) optim(1539) algorithm(950) }
{ howev(809) still(633) remain(590) }
{ can(981) present(881) function(850) }
{ concept(1167) ontolog(924) domain(897) }
{ research(1085) discuss(1038) issu(1018) }
{ model(2341) predict(2261) use(1141) }
{ framework(1458) process(801) describ(734) }
{ method(984) reconstruct(947) comput(926) }
{ perform(1367) use(1326) method(1137) }
{ model(2656) set(1616) predict(1553) }
{ featur(3375) classif(2383) classifi(1994) }
{ imag(2830) propos(1344) filter(1198) }
{ network(2748) neural(1063) input(814) }
{ data(1714) softwar(1251) tool(1186) }
{ featur(1941) imag(1645) propos(1176) }
{ system(1050) medic(1026) inform(1018) }
{ import(1318) role(1303) understand(862) }
{ cost(1906) reduc(1198) effect(832) }
{ activ(1138) subject(705) human(624) }
{ can(774) often(719) complex(702) }
{ inform(2794) health(2639) internet(1427) }
{ method(1219) similar(1157) match(930) }
{ take(945) account(800) differ(722) }
{ studi(2440) review(1878) systemat(933) }
{ surgeri(1148) surgic(1085) robot(1054) }
{ design(1359) user(1324) use(1319) }
{ model(2220) cell(1177) simul(1124) }
{ general(901) number(790) one(736) }
{ case(1353) use(1143) diagnosi(1136) }
{ spatial(1525) area(1432) region(1030) }
{ monitor(1329) mobil(1314) devic(1160) }
{ state(1844) use(1261) util(961) }
{ research(1218) medic(880) student(794) }
{ group(2977) signific(1463) compar(1072) }
{ sampl(1606) size(1419) use(1276) }
{ first(2504) two(1366) second(1323) }
{ structur(1116) can(940) graph(676) }
{ use(1733) differ(960) four(931) }
{ result(1111) use(1088) new(759) }
{ survey(1388) particip(1329) question(1065) }
{ estim(2440) model(1874) function(577) }
{ decis(3086) make(1611) patient(1517) }
{ process(1125) use(805) approach(778) }
{ imag(1947) propos(1133) code(1026) }
{ data(1737) use(1416) pattern(1282) }
{ system(1976) rule(880) can(841) }
{ measur(2081) correl(1212) valu(896) }
{ imag(1057) registr(996) error(939) }
{ bind(1733) structur(1185) ligand(1036) }
{ sequenc(1873) structur(1644) protein(1328) }
{ imag(2675) segment(2577) method(1081) }
{ patient(2315) diseas(1263) diabet(1191) }
{ motion(1329) object(1292) video(1091) }
{ assess(1506) score(1403) qualiti(1306) }
{ treatment(1704) effect(941) patient(846) }
{ error(1145) method(1030) estim(1020) }
{ chang(1828) time(1643) increas(1301) }
{ clinic(1479) use(1117) guidelin(835) }
{ algorithm(1844) comput(1787) effici(935) }
{ extract(1171) text(1153) clinic(932) }
{ method(1557) propos(1049) approach(1037) }
{ control(1307) perform(991) simul(935) }
{ care(1570) inform(1187) nurs(1089) }
{ search(2224) databas(1162) retriev(909) }
{ data(3963) clinic(1234) research(1004) }
{ studi(1410) differ(1259) use(1210) }
{ risk(3053) factor(974) diseas(938) }
{ perform(999) metric(946) measur(919) }
{ visual(1396) interact(850) tool(830) }
{ compound(1573) activ(1297) structur(1058) }
{ studi(1119) effect(1106) posit(819) }
{ blood(1257) pressur(1144) flow(957) }
{ record(1888) medic(1808) patient(1693) }
{ health(3367) inform(1360) care(1135) }
{ model(3480) simul(1196) paramet(876) }
{ ehr(2073) health(1662) electron(1139) }
{ patient(2837) hospit(1953) medic(668) }
{ data(2317) use(1299) case(1017) }
{ age(1611) year(1155) adult(843) }
{ medic(1828) order(1363) alert(1069) }
{ signal(2180) analysi(812) frequenc(800) }
{ gene(2352) biolog(1181) express(1162) }
{ data(3008) multipl(1320) sourc(1022) }
{ intervent(3218) particip(2042) group(1664) }
{ time(1939) patient(1703) rate(768) }
{ patient(1821) servic(1111) care(1106) }
{ use(2086) technolog(871) perceiv(783) }
{ analysi(2126) use(1163) compon(1037) }
{ health(1844) social(1437) communiti(874) }
{ high(1669) rate(1365) level(1280) }
{ cancer(2502) breast(956) screen(824) }
{ use(976) code(926) identifi(902) }
{ drug(1928) target(777) effect(648) }
{ implement(1333) system(1263) develop(1122) }
{ activ(1452) weight(1219) physic(1104) }
{ method(1969) cluster(1462) data(1082) }
{ method(2212) result(1239) propos(1039) }
{ detect(2391) sensit(1101) algorithm(908) }

Resumo

CKGROUND: The concept of boosting emerged from the field of machine learning. The basic idea is to boost the accuracy of a weak classifying tool by combining various instances into a more accurate prediction. This general concept was later adapted to the field of statistical modelling. Nowadays, boosting algorithms are often applied to estimate and select predictor effects in statistical regression models.OBJECTIVES: This review article attempts to highlight the evolution of boosting algorithms from machine learning to statistical modelling.METHODS: We describe the AdaBoost algorithm for classification as well as the two most prominent statistical boosting approaches, gradient boosting and likelihood-based boosting for statistical modelling. We highlight the methodological background and present the most common software implementations.RESULTS: Although gradient boosting and likelihood-based boosting are typically treated separately in the literature, they share the same methodological roots and follow the same fundamental concepts. Compared to the initial machine learning algorithms, which must be seen as black-box prediction schemes, they result in statistical models with a straight-forward interpretation.CONCLUSIONS: Statistical boosting algorithms have gained substantial interest during the last decade and offer a variety of options to address important research questions in modern biomedicine.

Resumo Limpo

ckground concept boost emerg field machin learn basic idea boost accuraci weak classifi tool combin various instanc accur predict general concept later adapt field statist model nowaday boost algorithm often appli estim select predictor effect statist regress modelsobject review articl attempt highlight evolut boost algorithm machin learn statist modellingmethod describ adaboost algorithm classif well two promin statist boost approach gradient boost likelihoodbas boost statist model highlight methodolog background present common softwar implementationsresult although gradient boost likelihoodbas boost typic treat separ literatur share methodolog root follow fundament concept compar initi machin learn algorithm must seen blackbox predict scheme result statist model straightforward interpretationconclus statist boost algorithm gain substanti interest last decad offer varieti option address import research question modern biomedicin

Resumos Similares

IEEE Trans Image Process - Shape-based normalized cuts using spectral relaxation for biomedical segmentation. ( 0,667832267905321 )
IEEE J Biomed Health Inform - Supervised hierarchical Bayesian model-based electomyographic control and analysis. ( 0,6533511892155 )
IEEE Trans Pattern Anal Mach Intell - Exemplar-Based Colour Constancy and Multiple Illumination. ( 0,64274839881289 )
Neural Comput - Learning with convex loss and indefinite kernels. ( 0,637948715497625 )
IEEE Trans Neural Netw Learn Syst - Generalized multiple kernel learning with data-dependent priors. ( 0,63773701152953 )
Neural Comput - Bayesian sparse partial least squares. ( 0,635527063437023 )
IEEE Trans Neural Netw Learn Syst - Semi-supervised domain adaptation on manifolds. ( 0,635355227070485 )
Neural Comput - Robust subspace discovery via relaxed rank minimization. ( 0,626531911384439 )
IEEE Trans Image Process - On regularized reconstruction of vector fields. ( 0,625344265080966 )
Neural Comput - Mismatched training and test distributions can outperform matched ones. ( 0,624789121050561 )
Neural Comput - Parameter learning for alpha integration. ( 0,619435554938874 )
IEEE Trans Image Process - Blur and illumination robust face recognition via set-theoretic characterization. ( 0,616594006136901 )
IEEE Trans Neural Netw Learn Syst - Online Sequential Extreme Learning Machine With Kernels. ( 0,613414555876982 )
Neural Comput - Determination and the no-free-lunch paradox. ( 0,612834081020082 )
IEEE Trans Pattern Anal Mach Intell - Learning Categories from Few Examples with Multi Model Knowledge Transfer. ( 0,611978085382318 )
IEEE Trans Image Process - Manifold regularized multitask learning for semi-supervised multilabel image classification. ( 0,60655035737621 )
Neural Comput - A unified classification model based on robust optimization. ( 0,605630597518759 )
J Chem Inf Model - Classifying large chemical data sets: using a regularized potential function method. ( 0,60525216695795 )
IEEE Trans Image Process - Incremental training of a detector using online sparse eigendecomposition. ( 0,604717931395685 )
IEEE Trans Image Process - Multiview Hessian regularization for image annotation. ( 0,603350856216826 )
IEEE Trans Pattern Anal Mach Intell - Representation Learning: A Review and New Perspectives. ( 0,601399411953561 )
IEEE Trans Pattern Anal Mach Intell - Feature Selection with Conjunctions of Decision Stumps and Learning from Microarray Data. ( 0,590101782110073 )
Neural Comput - The basal ganglia optimize decision making over general perceptual hypotheses. ( 0,589006072796909 )
Comput. Biol. Med. - Hangman BCI: an unsupervised adaptive self-paced Brain-Computer Interface for playing games. ( 0,588013945490181 )
IEEE Trans Image Process - Real-time object tracking via online discriminative feature selection. ( 0,585402644959017 )
J Biomed Inform - Incremental Gaussian Discriminant Analysis based on Graybill and Deal weighted combination of estimators for brain tumour diagnosis. ( 0,584402412768604 )
IEEE Trans Image Process - Bayesian nonparametric dictionary learning for compressed sensing MRI. ( 0,583336970007249 )
AMIA Annu Symp Proc - Testing the calibration of classification models from first principles. ( 0,582413222617538 )
IEEE Trans Pattern Anal Mach Intell - Latent Dirichlet Allocation Models for Image Classification. ( 0,581216646027984 )
Neural Comput - Representing objects, relations, and sequences. ( 0,580565101916617 )
IEEE Trans Image Process - Grassmannian regularized structured multi-view embedding for image classification. ( 0,578882879599796 )
IEEE Trans Pattern Anal Mach Intell - The Effect of Model Misspecification on Semi-Supervised Classification. ( 0,578741293790465 )
IEEE Trans Image Process - Artistic image analysis using graph-based learning approaches. ( 0,578419437270584 )
IEEE Trans Image Process - Example-driven manifold priors for image deconvolution. ( 0,577826512996736 )
IEEE Trans Image Process - Separable Markov random field model and its applications in low level vision. ( 0,576843829327236 )
IEEE Trans Image Process - A Bayesian framework for image segmentation with spatially varying mixtures. ( 0,573584383790875 )
Neural Comput - Formal modeling of robot behavior with learning. ( 0,573066509184782 )
IEEE Trans Image Process - Unsupervised amplitude and texture classification of SAR images with multinomial latent model. ( 0,571764220603665 )
Artif Intell Med - Cost-sensitive case-based reasoning using a genetic algorithm: application to medical diagnosis. ( 0,569766624250587 )
IEEE Trans Neural Netw Learn Syst - Learning With Mixed Hard/Soft Pointwise Constraints. ( 0,568296388445327 )
Comput Methods Programs Biomed - Biomedical system based on the Discrete Hidden Markov Model using the Rocchio-Genetic approach for the classification of internal carotid artery Doppler signals. ( 0,566638685200256 )
Neural Comput - Learning coefficient of generalization error in Bayesian estimation and vandermonde matrix-type singularity. ( 0,565752138885489 )
IEEE Trans Image Process - User-assisted ink-bleed reduction. ( 0,565658234852773 )
Neural Comput - Foundations of support constraint machines. ( 0,565610099871206 )
IEEE Trans Neural Netw Learn Syst - Scalable Nonparametric Low-Rank Kernel Learning Using Block Coordinate Descent. ( 0,56505233910631 )
IEEE J Biomed Health Inform - Joint probabilistic model of shape and intensity for multiple abdominal organ segmentation from volumetric CT images. ( 0,564083642804066 )
Neural Comput - Multiple spectral kernel learning and a gaussian complexity computation. ( 0,563885925315726 )
IEEE Trans Image Process - Learning conditional random fields for classification of hyperspectral images. ( 0,563127465802371 )
J Biomed Inform - Markov blanket-based approach for learning multi-dimensional Bayesian network classifiers: an application to predict the European Quality of Life-5 Dimensions (EQ-5D) from the 39-item Parkinson's Disease Questionnaire (PDQ-39). ( 0,562443145789783 )
Neural Comput - Learning rates of lq coefficient regularization learning with gaussian kernel. ( 0,561403365176937 )
Neural Comput - Strictly positive-definite spike train kernels for point-process divergences. ( 0,561007581285971 )
IEEE Trans Pattern Anal Mach Intell - Bayesian Nonparametric Methods for Partially-Observable Reinforcement Learning. ( 0,559267452789479 )
IEEE Trans Neural Netw Learn Syst - Comparison of l1-Norm SVR and Sparse Coding Algorithms for Linear Regression. ( 0,558618356189166 )
Neural Comput - Online learning of single- and multivalued functions with an infinite mixture of linear experts. ( 0,557924368676682 )
IEEE Trans Image Process - Analyzing image deblurring through three paradigms. ( 0,556282329700644 )
IEEE Trans Image Process - Flexible manifold embedding: a framework for semi-supervised and unsupervised dimension reduction. ( 0,555737148727027 )
IEEE J Biomed Health Inform - Service-oriented medical system for supporting decisions with missing and imbalanced data. ( 0,554792497038924 )
Neural Comput - Computing sparse representations of multidimensional signals using Kronecker bases. ( 0,553476837126521 )
Spat Spatiotemporal Epidemiol - Spatial and spatio-temporal models with R-INLA. ( 0,552797478352333 )
Neural Comput - Divergence-based vector quantization. ( 0,552322974540018 )
J. Comput. Biol. - Imbalanced class learning in epigenetics. ( 0,551529316225894 )
IEEE Trans Image Process - Deconvolving images with unknown boundaries using the alternating direction method of multipliers. ( 0,551433505568989 )
IEEE Trans Image Process - Labeling Spain with Stanford. ( 0,551103311038639 )
J Med Syst - 3D matrix pattern based Support Vector Machines for identifying pulmonary cancer in CT scanned images. ( 0,550452273231875 )
Neural Comput - Large margin low rank tensor analysis. ( 0,549786376914674 )
AMIA Annu Symp Proc - Pediatric readmission classification using stacked regularized logistic regression models. ( 0,548702383555104 )
IEEE Trans Image Process - Fast bilateral filter with arbitrary range and domain kernels. ( 0,548650735752172 )
IEEE Trans Image Process - Generative Bayesian image super resolution with natural image prior. ( 0,547914186925722 )
IEEE Trans Pattern Anal Mach Intell - Distance-Based Image Classification: Generalizing to New Classes at Near Zero Cost. ( 0,546232013836547 )
Comput. Biol. Med. - Robust prediction of protein subcellular localization combining PCA and WSVMs. ( 0,545130302372412 )
IEEE Trans Image Process - Task-specific image partitioning. ( 0,543010062075223 )
IEEE Trans Image Process - Stable orthogonal local discriminant embedding for linear dimensionality reduction. ( 0,542760781703626 )
IEEE Trans Image Process - Unified structured learning for simultaneous human pose estimation and garment attribute classification. ( 0,542753260871387 )
Int J Neural Syst - Aggregation of sparse linear discriminant analyses for event-related potential classification in brain-computer interface. ( 0,542548850521894 )
IEEE Trans Image Process - Sparse bayesian learning of filters for efficient image expansion. ( 0,542159216493951 )
Comput Methods Programs Biomed - Design of fuzzy classifier for diabetes disease using Modified Artificial Bee Colony algorithm. ( 0,541714362198304 )
IEEE Trans Image Process - Saliency and gist features for target detection in satellite images. ( 0,540691935815768 )
Neural Comput - Sufficient dimension reduction via squared-loss mutual information estimation. ( 0,539376606024634 )
IEEE Trans Pattern Anal Mach Intell - Constrained Nonnegative Matrix Factorization for Image Representation. ( 0,53889205456598 )
IEEE Trans Image Process - SAR-based terrain classification using weakly supervised hierarchical Markov aspect models. ( 0,538473111145372 )
J Biomed Inform - Supervised methods for symptom name recognition in free-text clinical records of traditional Chinese medicine: an empirical study. ( 0,537687142850435 )
IEEE Trans Pattern Anal Mach Intell - Probabilistic Common Spatial Patterns for Multichannel EEG Analysis. ( 0,537048448773862 )
IEEE Trans Image Process - Active learning for solving the incomplete data problem in facial age classification by the furthest nearest-neighbor criterion. ( 0,536801763507862 )
Neural Comput - Inhibition in multiclass classification. ( 0,535262850752066 )
IEEE Trans Image Process - Single image super-resolution with non-local means and steering kernel regression. ( 0,534780435602657 )
Med Decis Making - The Impact of Oversampling with SMOTE on the Performance of 3 Classifiers in Prediction of Type 2 Diabetes. ( 0,534321890017913 )
Neural Comput - Direct learning of sparse changes in Markov networks by density ratio estimation. ( 0,533985544981319 )
Comput Methods Programs Biomed - On the prediction of glucose concentration under intra-patient variability in type 1 diabetes: a monotone systems approach. ( 0,533629900675315 )
AMIA Annu Symp Proc - Outlier Detection with One-Class SVMs: An Application to Melanoma Prognosis. ( 0,533340806996054 )
Neural Comput - Online learning with (multiple) kernels: a review. ( 0,532968518604056 )
Neural Comput - Learning with boundary conditions. ( 0,532781603596883 )
J Biomed Inform - Applying active learning to assertion classification of concepts in clinical text. ( 0,532646728482303 )
IEEE Trans Neural Netw Learn Syst - Hyperparameter Selection for Gaussian Process One-Class Classification. ( 0,532284562814232 )
Methods Inf Med - Probability machines: consistent probability estimation using nonparametric learning machines. ( 0,532258147408258 )
IEEE Trans Image Process - A linear support higher-order tensor machine for classification. ( 0,532115075243739 )
J Chem Inf Model - Introduction of a methodology for visualization and graphical interpretation of Bayesian classification models. ( 0,530841336397631 )
IEEE Trans Pattern Anal Mach Intell - A Variance Minimization Criterion to Feature Selection Using Laplacian Regularization. ( 0,53060532377903 )
Int J Neural Syst - Structurally enhanced incremental neural learning for image classification with subgraph extraction. ( 0,530507661363682 )
IEEE Trans Image Process - Subspaces indexing model on Grassmann manifold for image search. ( 0,530469039329616 )
J Biomed Inform - A medical diagnostic tool based on radial basis function classifiers and evolutionary simulated annealing. ( 0,529242219752943 )