Neural Comput - Universal approximation depth and errors of narrow belief networks with discrete units.

Tópicos

{ model(3404) distribut(989) bayesian(671) }
{ error(1145) method(1030) estim(1020) }
{ network(2748) neural(1063) input(814) }
{ general(901) number(790) one(736) }
{ learn(2355) train(1041) set(1003) }
{ spatial(1525) area(1432) region(1030) }
{ imag(1947) propos(1133) code(1026) }
{ problem(2511) optim(1539) algorithm(950) }
{ state(1844) use(1261) util(961) }
{ process(1125) use(805) approach(778) }
{ bind(1733) structur(1185) ligand(1036) }
{ sequenc(1873) structur(1644) protein(1328) }
{ method(1219) similar(1157) match(930) }
{ method(1557) propos(1049) approach(1037) }
{ design(1359) user(1324) use(1319) }
{ model(2220) cell(1177) simul(1124) }
{ care(1570) inform(1187) nurs(1089) }
{ use(2086) technolog(871) perceiv(783) }
{ cancer(2502) breast(956) screen(824) }
{ can(774) often(719) complex(702) }
{ data(1737) use(1416) pattern(1282) }
{ inform(2794) health(2639) internet(1427) }
{ system(1976) rule(880) can(841) }
{ measur(2081) correl(1212) valu(896) }
{ imag(1057) registr(996) error(939) }
{ featur(3375) classif(2383) classifi(1994) }
{ imag(2830) propos(1344) filter(1198) }
{ imag(2675) segment(2577) method(1081) }
{ patient(2315) diseas(1263) diabet(1191) }
{ take(945) account(800) differ(722) }
{ studi(2440) review(1878) systemat(933) }
{ motion(1329) object(1292) video(1091) }
{ assess(1506) score(1403) qualiti(1306) }
{ treatment(1704) effect(941) patient(846) }
{ surgeri(1148) surgic(1085) robot(1054) }
{ framework(1458) process(801) describ(734) }
{ chang(1828) time(1643) increas(1301) }
{ concept(1167) ontolog(924) domain(897) }
{ clinic(1479) use(1117) guidelin(835) }
{ algorithm(1844) comput(1787) effici(935) }
{ extract(1171) text(1153) clinic(932) }
{ data(1714) softwar(1251) tool(1186) }
{ control(1307) perform(991) simul(935) }
{ method(984) reconstruct(947) comput(926) }
{ search(2224) databas(1162) retriev(909) }
{ featur(1941) imag(1645) propos(1176) }
{ case(1353) use(1143) diagnosi(1136) }
{ howev(809) still(633) remain(590) }
{ data(3963) clinic(1234) research(1004) }
{ studi(1410) differ(1259) use(1210) }
{ risk(3053) factor(974) diseas(938) }
{ perform(999) metric(946) measur(919) }
{ research(1085) discuss(1038) issu(1018) }
{ system(1050) medic(1026) inform(1018) }
{ import(1318) role(1303) understand(862) }
{ model(2341) predict(2261) use(1141) }
{ visual(1396) interact(850) tool(830) }
{ compound(1573) activ(1297) structur(1058) }
{ perform(1367) use(1326) method(1137) }
{ studi(1119) effect(1106) posit(819) }
{ blood(1257) pressur(1144) flow(957) }
{ record(1888) medic(1808) patient(1693) }
{ health(3367) inform(1360) care(1135) }
{ model(3480) simul(1196) paramet(876) }
{ monitor(1329) mobil(1314) devic(1160) }
{ ehr(2073) health(1662) electron(1139) }
{ research(1218) medic(880) student(794) }
{ patient(2837) hospit(1953) medic(668) }
{ model(2656) set(1616) predict(1553) }
{ data(2317) use(1299) case(1017) }
{ age(1611) year(1155) adult(843) }
{ medic(1828) order(1363) alert(1069) }
{ signal(2180) analysi(812) frequenc(800) }
{ cost(1906) reduc(1198) effect(832) }
{ group(2977) signific(1463) compar(1072) }
{ sampl(1606) size(1419) use(1276) }
{ gene(2352) biolog(1181) express(1162) }
{ data(3008) multipl(1320) sourc(1022) }
{ first(2504) two(1366) second(1323) }
{ intervent(3218) particip(2042) group(1664) }
{ activ(1138) subject(705) human(624) }
{ time(1939) patient(1703) rate(768) }
{ patient(1821) servic(1111) care(1106) }
{ can(981) present(881) function(850) }
{ analysi(2126) use(1163) compon(1037) }
{ health(1844) social(1437) communiti(874) }
{ structur(1116) can(940) graph(676) }
{ high(1669) rate(1365) level(1280) }
{ use(976) code(926) identifi(902) }
{ use(1733) differ(960) four(931) }
{ drug(1928) target(777) effect(648) }
{ result(1111) use(1088) new(759) }
{ implement(1333) system(1263) develop(1122) }
{ survey(1388) particip(1329) question(1065) }
{ estim(2440) model(1874) function(577) }
{ decis(3086) make(1611) patient(1517) }
{ activ(1452) weight(1219) physic(1104) }
{ method(1969) cluster(1462) data(1082) }
{ method(2212) result(1239) propos(1039) }
{ detect(2391) sensit(1101) algorithm(908) }

Resumo

We generalize recent theoretical work on the minimal number of layers of narrow deep belief networks that can approximate any probability distribution on the states of their visible units arbitrarily well. We relax the setting of binary units (Sutskever & Hinton, 2008 ; Le Roux & Bengio, 2008 , 2010 ; Mont?far & Ay, 2011 ) to units with arbitrary finite state spaces and the vanishing approximation error to an arbitrary approximation error tolerance. For example, we show that a q-ary deep belief network with L > or = 2 + (q[m-delta]-1 / (q-1)) layers of width n < or = + log(q) (m) + 1 for some [Formula : see text] can approximate any probability distribution on {0, 1, ... , q-1}n without exceeding a Kullback-Leibler divergence of delta. Our analysis covers discrete restricted Boltzmann machines and naive Bayes models as special cases.

Resumo Limpo

general recent theoret work minim number layer narrow deep belief network can approxim probabl distribut state visibl unit arbitrarili well relax set binari unit sutskev hinton le roux bengio montfar ay unit arbitrari finit state space vanish approxim error arbitrari approxim error toler exampl show qari deep belief network l qmdelta q layer width n logq m formula see text can approxim probabl distribut qn without exceed kullbackleibl diverg delta analysi cover discret restrict boltzmann machin naiv bay model special case

Resumos Similares

Neural Comput - A semiparametric Bayesian model for detecting synchrony among multiple neurons. ( 0,765176519834129 )
IEEE Trans Image Process - Bayesian robust principal component analysis. ( 0,760908206824317 )
Neural Comput - Bayesian sparse partial least squares. ( 0,757187779440036 )
Neural Comput - Learning coefficient of generalization error in Bayesian estimation and vandermonde matrix-type singularity. ( 0,742804843915667 )
Neural Comput - Efficient sensory encoding and Bayesian inference with heterogeneous neural populations. ( 0,735640538586661 )
IEEE Trans Pattern Anal Mach Intell - Are Gibbs-Type Priors the Most Natural Generalization of the Dirichlet Process? ( 0,730355293275317 )
Comput Math Methods Med - Bayesian inference of the Weibull model based on interval-censored survival data. ( 0,728120810519898 )
IEEE Trans Image Process - A Bayesian framework for image segmentation with spatially varying mixtures. ( 0,712138627145599 )
J. Comput. Biol. - A spatial haplotype copying model with applications to genotype imputation. ( 0,711466894176696 )
Neural Comput - Attention as reward-driven optimization of sensory processing. ( 0,709755674304181 )
IEEE Trans Neural Netw Learn Syst - Variational Bayesian Inference Algorithms for Infinite Relational Model of Network Data. ( 0,707188786238472 )
IEEE Trans Image Process - Variational Bayesian method for Retinex. ( 0,700889439490835 )
Res Synth Methods - A Bayesian nonparametric meta-analysis model. ( 0,699569838674934 )
AMIA Annu Symp Proc - Testing the calibration of classification models from first principles. ( 0,698754816683837 )
J. Comput. Biol. - Computational methods for a class of network models. ( 0,697819136868052 )
Lifetime Data Anal - Bayesian semiparametric modeling for stochastic precedence, with applications in epidemiology and survival analysis. ( 0,693577984200816 )
Lifetime Data Anal - Bayesian nonparametric models for ranked set sampling. ( 0,692070534903898 )
Med Decis Making - Calibration of complex models through Bayesian evidence synthesis: a demonstration and tutorial. ( 0,690147534446765 )
Neural Comput - Efficient Markov chain Monte Carlo methods for decoding neural spike trains. ( 0,68947533950178 )
IEEE Trans Image Process - Bayesian blind deconvolution from differently exposed image pairs. ( 0,688486573193617 )
Neural Comput - Multistability and perceptual inference. ( 0,68718754401384 )
Res Synth Methods - Critical interpretation of Cochran's Q test depends on power and prior assumptions about heterogeneity. ( 0,686814728998082 )
IEEE Trans Image Process - Computationally tractable stochastic image modeling based on symmetric Markov mesh random fields. ( 0,683474859090191 )
Comput Math Methods Med - A generalized gamma mixture model for ultrasonic tissue characterization. ( 0,675989303511186 )
Comput Math Methods Med - Bayesian hierarchical modeling for categorical longitudinal data from sedation measurements. ( 0,673300329224138 )
Neural Comput - Determination and the no-free-lunch paradox. ( 0,670668606757837 )
IEEE Trans Pattern Anal Mach Intell - Modeling Natural Images Using Gated MRFs. ( 0,670060567697847 )
Spat Spatiotemporal Epidemiol - A Bayesian space-time model for discrete spread processes on a lattice. ( 0,668071983725254 )
Spat Spatiotemporal Epidemiol - Goodness-of-fit measures for individual-level models of infectious disease in a Bayesian framework. ( 0,667160311063568 )
Comput Math Methods Med - Inference for ecological dynamical systems: a case study of two endemic diseases. ( 0,665656065767088 )
IEEE Trans Image Process - Generative Bayesian image super resolution with natural image prior. ( 0,66474272406741 )
Int J Health Geogr - Gumbel based p-value approximations for spatial scan statistics. ( 0,664430372169437 )
Med Decis Making - Bayesian calibration of a natural history model with application to a population model for colorectal cancer. ( 0,663455047297291 )
Spat Spatiotemporal Epidemiol - Bayesian hierarchical modeling of the dynamics of spatio-temporal influenza season outbreaks. ( 0,659966329107444 )
IEEE Trans Image Process - Bayesian nonparametric dictionary learning for compressed sensing MRI. ( 0,659222296733929 )
Lifetime Data Anal - A consistent NPMLE of the joint distribution function with competing risks data under the dependent masking and right-censoring model. ( 0,65550876317127 )
Med Decis Making - Assessing uncertainties surrounding combined endpoints for use in economic models. ( 0,655294115156309 )
Med Biol Eng Comput - A poisson process model for hip fracture risk. ( 0,654984603573148 )
Lifetime Data Anal - Bayesian local influence for survival models. ( 0,653047979569452 )
Spat Spatiotemporal Epidemiol - Inference from ecological models: estimating the relative risk of stroke from air pollution exposure using small area data. ( 0,651585214027483 )
Comput Methods Programs Biomed - The exponentiated exponential mixture and non-mixture cure rate model in the presence of covariates. ( 0,649375999856161 )
J. Comput. Biol. - Expectation-maximization algorithm for determining natural selection of Y-linked genes through two-sex branching processes. ( 0,649129246206442 )
Neural Comput - Bayesian community detection. ( 0,647111855673927 )
Spat Spatiotemporal Epidemiol - The detection of spatially localised outbreaks in campylobacteriosis notification data. ( 0,646962885805481 )
Comput Methods Programs Biomed - Identification of an integrated mathematical model of standard oral glucose tolerance test for characterization of insulin potentiation in health. ( 0,643310956776469 )
IEEE J Biomed Health Inform - Sparsity-inspired nonparametric probability characterization for radio propagation in body area networks. ( 0,641490611062728 )
Comput. Biol. Med. - Expectation-maximization technique for fibro-glandular discs detection in mammography images. ( 0,639262634930207 )
Neural Comput - Learning quadratic receptive fields from neural responses to natural stimuli. ( 0,638170916363258 )
IEEE Trans Neural Netw Learn Syst - Robust Novelty Detection via Worst Case CVaR Minimization. ( 0,63588937784775 )
J Biomed Inform - Link-topic model for biomedical abbreviation disambiguation. ( 0,6288670091382 )
Comput Methods Programs Biomed - Life prediction of different commercial dental implants as influence by uncertainties in their fatigue material properties and loading conditions. ( 0,627495019900557 )
IEEE Trans Neural Netw Learn Syst - Generalized multiple kernel learning with data-dependent priors. ( 0,6236102026216 )
Spat Spatiotemporal Epidemiol - A space-time point process model for analyzing and predicting case patterns of diarrheal disease in northwestern Ecuador. ( 0,622720627430222 )
IEEE Trans Neural Netw Learn Syst - Incorporating Wind Power Forecast Uncertainties Into Stochastic Unit Commitment Using Neural Network-Based Prediction Intervals. ( 0,622255290126597 )
Med Decis Making - Estimating multiparameter partial expected value of perfect information from a probabilistic sensitivity analysis sample: a nonparametric regression approach. ( 0,62035500814812 )
Artif Intell Med - Impact of precision of Bayesian network parameters on accuracy of medical diagnostic systems. ( 0,620330381819797 )
IEEE Trans Pattern Anal Mach Intell - Negative Binomial Process Count and Mixture Modeling. ( 0,617556629367858 )
IEEE Trans Image Process - Blind image quality assessment: a natural scene statistics approach in the DCT domain. ( 0,617555203381644 )
IEEE Trans Pattern Anal Mach Intell - Gaussian Process-Mixture Conditional Heteroscedasticity. ( 0,613724862157123 )
IEEE Trans Image Process - Bayesian inference of models and hyperparameters for robust optical-flow estimation. ( 0,610563066560703 )
Neural Comput - Simple deterministically constructed cycle reservoirs with regular jumps. ( 0,606695926783228 )
Neural Comput - Bayesian active learning of neural firing rate maps with transformed gaussian process priors. ( 0,606588432805869 )
Methods Inf Med - Individual Thresholding of Voxel-based Functional Connectivity Maps. Estimation of Random Errors by Means of Surrogate Time Series. ( 0,605043351996724 )
J. Comput. Biol. - On the inference of dirichlet mixture priors for protein sequence comparison. ( 0,604721826615056 )
Comput. Biol. Med. - Vector autoregression, structural equation modeling, and their synthesis in neuroimaging data analysis. ( 0,60448772146786 )
Res Synth Methods - Bayesian model selection for meta-analysis of diagnostic test accuracy data: Application to Ddimer for deep vein thrombosis. ( 0,603103357751156 )
Comput Math Methods Med - Results on a binding neuron model and their implications for modified hourglass model for neuronal network. ( 0,600825971331206 )
Res Synth Methods - Random-effects meta-analysis of time-to-event data using the expectation-maximisation algorithm and shrinkage estimators. ( 0,600736046075154 )
IEEE Trans Image Process - Probabilistic image modeling with an extended chain graph for human activity recognition and image segmentation. ( 0,600473653895453 )
IEEE Trans Image Process - A Bayesian hierarchical factorization model for vector fields. ( 0,600219258183821 )
IEEE Trans Pattern Anal Mach Intell - Temporal Analysis of Motif Mixtures using Dirichlet Processes. ( 0,599769587168529 )
Artif Intell Med - On the interplay of machine learning and background knowledge in image interpretation by Bayesian networks. ( 0,59547118947939 )
IEEE Trans Image Process - Blind separation of time/position varying mixtures. ( 0,593503832003658 )
IEEE Trans Image Process - Posterior-mean super-resolution with a causal Gaussian Markov random field prior. ( 0,591439121987738 )
Res Synth Methods - A basic introduction to fixed-effect and random-effects models for meta-analysis. ( 0,591021937573445 )
Neural Comput - Learning nonlinear statistical regularities in natural images by modeling the outer product of image intensities. ( 0,58848234927637 )
Comput Methods Programs Biomed - Bayesian sample-size determination for two independent Poisson rates. ( 0,585155882998204 )
Med Decis Making - Not simply more of the same: distinguishing between patient heterogeneity and parameter uncertainty. ( 0,584747458325237 )
Neural Comput - Learning spatial invariance with the trace rule in nonuniform distributions. ( 0,582824489346544 )
Res Synth Methods - Automating network meta-analysis. ( 0,580207912195315 )
J Biomed Inform - Learning patient-specific predictive models from clinical data. ( 0,578541911879902 )
J Biomed Inform - Error-correction learning for artificial neural networks using the Bayesian paradigm. Application to automated medical diagnosis. ( 0,57819522990903 )
Neural Comput - Spike-based probabilistic inference in analog graphical models using interspike-interval coding. ( 0,576936599130319 )
Neural Comput - Direct learning of sparse changes in Markov networks by density ratio estimation. ( 0,576556883902696 )
Spat Spatiotemporal Epidemiol - Foot and mouth disease revisited: re-analysis using Bayesian spatial susceptible-infectious-removed models. ( 0,576545309912432 )
J Integr Bioinform - Analyzing phylogenetic trees with timed and probabilistic model checking: the lactose persistence case study. ( 0,575113515365059 )
Neural Comput - Approximate, computationally efficient online learning in Bayesian spiking neurons. ( 0,57249604726839 )
Neural Comput - Online learning of single- and multivalued functions with an infinite mixture of linear experts. ( 0,572046081603658 )
IEEE Trans Image Process - Counting people with low-level features and Bayesian regression. ( 0,571547606649408 )
Neural Comput - A finite-sample, distribution-free, probabilistic lower bound on mutual information. ( 0,568736791900734 )
Comput Math Methods Med - An empirical Bayes optimal discovery procedure based on semiparametric hierarchical mixture models. ( 0,566528599399843 )
Med Decis Making - Linear regression metamodeling as a tool to summarize and present simulation model results. ( 0,566211020544546 )
IEEE Trans Pattern Anal Mach Intell - Causal Inference on Discrete Data using Additive Noise Models. ( 0,566138517072298 )
IEEE Trans Image Process - A study of multiplicative watermark detection in the contourlet domain using alpha-stable distributions. ( 0,56466896431535 )
Neural Comput - Multinomial Bayesian learning for modeling classical and nonclassical receptive field properties. ( 0,560138393685276 )
Med Decis Making - The choice of a noninformative prior on between-study variance strongly affects predictions of future treatment effect. ( 0,55869187574356 )
Comput Methods Programs Biomed - A Bayesian multilevel model for fMRI data analysis. ( 0,55859592888304 )
Spat Spatiotemporal Epidemiol - Mapping gender variation in the spatial pattern of alcohol-related mortality: a Bayesian analysis using data from South Yorkshire, United Kingdom. ( 0,558458808597435 )
Neural Comput - Estimation of time-dependent input from neuronal membrane potential. ( 0,558271140814808 )
AMIA Annu Symp Proc - Learning to predict post-hospitalization VTE risk from EHR data. ( 0,555657360286729 )