Neural Comput - A proof of convergence of the concave-convex procedure using Zangwill's theory.

Tópicos

{ problem(2511) optim(1539) algorithm(950) }
{ learn(2355) train(1041) set(1003) }
{ studi(1410) differ(1259) use(1210) }
{ howev(809) still(633) remain(590) }
{ imag(1947) propos(1133) code(1026) }
{ take(945) account(800) differ(722) }
{ intervent(3218) particip(2042) group(1664) }
{ extract(1171) text(1153) clinic(932) }
{ research(1085) discuss(1038) issu(1018) }
{ analysi(2126) use(1163) compon(1037) }
{ sequenc(1873) structur(1644) protein(1328) }
{ motion(1329) object(1292) video(1091) }
{ framework(1458) process(801) describ(734) }
{ method(1557) propos(1049) approach(1037) }
{ data(1714) softwar(1251) tool(1186) }
{ health(3367) inform(1360) care(1135) }
{ use(2086) technolog(871) perceiv(783) }
{ use(976) code(926) identifi(902) }
{ survey(1388) particip(1329) question(1065) }
{ surgeri(1148) surgic(1085) robot(1054) }
{ error(1145) method(1030) estim(1020) }
{ algorithm(1844) comput(1787) effici(935) }
{ model(2220) cell(1177) simul(1124) }
{ method(984) reconstruct(947) comput(926) }
{ search(2224) databas(1162) retriev(909) }
{ perform(1367) use(1326) method(1137) }
{ state(1844) use(1261) util(961) }
{ cost(1906) reduc(1198) effect(832) }
{ decis(3086) make(1611) patient(1517) }
{ activ(1452) weight(1219) physic(1104) }
{ detect(2391) sensit(1101) algorithm(908) }
{ model(3404) distribut(989) bayesian(671) }
{ can(774) often(719) complex(702) }
{ data(1737) use(1416) pattern(1282) }
{ inform(2794) health(2639) internet(1427) }
{ system(1976) rule(880) can(841) }
{ measur(2081) correl(1212) valu(896) }
{ imag(1057) registr(996) error(939) }
{ bind(1733) structur(1185) ligand(1036) }
{ method(1219) similar(1157) match(930) }
{ featur(3375) classif(2383) classifi(1994) }
{ imag(2830) propos(1344) filter(1198) }
{ network(2748) neural(1063) input(814) }
{ imag(2675) segment(2577) method(1081) }
{ patient(2315) diseas(1263) diabet(1191) }
{ studi(2440) review(1878) systemat(933) }
{ assess(1506) score(1403) qualiti(1306) }
{ treatment(1704) effect(941) patient(846) }
{ chang(1828) time(1643) increas(1301) }
{ concept(1167) ontolog(924) domain(897) }
{ clinic(1479) use(1117) guidelin(835) }
{ design(1359) user(1324) use(1319) }
{ control(1307) perform(991) simul(935) }
{ care(1570) inform(1187) nurs(1089) }
{ general(901) number(790) one(736) }
{ featur(1941) imag(1645) propos(1176) }
{ case(1353) use(1143) diagnosi(1136) }
{ data(3963) clinic(1234) research(1004) }
{ risk(3053) factor(974) diseas(938) }
{ perform(999) metric(946) measur(919) }
{ system(1050) medic(1026) inform(1018) }
{ import(1318) role(1303) understand(862) }
{ model(2341) predict(2261) use(1141) }
{ visual(1396) interact(850) tool(830) }
{ compound(1573) activ(1297) structur(1058) }
{ studi(1119) effect(1106) posit(819) }
{ blood(1257) pressur(1144) flow(957) }
{ spatial(1525) area(1432) region(1030) }
{ record(1888) medic(1808) patient(1693) }
{ model(3480) simul(1196) paramet(876) }
{ monitor(1329) mobil(1314) devic(1160) }
{ ehr(2073) health(1662) electron(1139) }
{ research(1218) medic(880) student(794) }
{ patient(2837) hospit(1953) medic(668) }
{ model(2656) set(1616) predict(1553) }
{ data(2317) use(1299) case(1017) }
{ age(1611) year(1155) adult(843) }
{ medic(1828) order(1363) alert(1069) }
{ signal(2180) analysi(812) frequenc(800) }
{ group(2977) signific(1463) compar(1072) }
{ sampl(1606) size(1419) use(1276) }
{ gene(2352) biolog(1181) express(1162) }
{ data(3008) multipl(1320) sourc(1022) }
{ first(2504) two(1366) second(1323) }
{ activ(1138) subject(705) human(624) }
{ time(1939) patient(1703) rate(768) }
{ patient(1821) servic(1111) care(1106) }
{ can(981) present(881) function(850) }
{ health(1844) social(1437) communiti(874) }
{ structur(1116) can(940) graph(676) }
{ high(1669) rate(1365) level(1280) }
{ cancer(2502) breast(956) screen(824) }
{ use(1733) differ(960) four(931) }
{ drug(1928) target(777) effect(648) }
{ result(1111) use(1088) new(759) }
{ implement(1333) system(1263) develop(1122) }
{ estim(2440) model(1874) function(577) }
{ process(1125) use(805) approach(778) }
{ method(1969) cluster(1462) data(1082) }
{ method(2212) result(1239) propos(1039) }

Resumo

The concave-convex procedure (CCCP) is an iterative algorithm that solves d.c. (difference of convex functions) programs as a sequence of convex programs. In machine learning, CCCP is extensively used in many learning algorithms, including sparse support vector machines (SVMs), transductive SVMs, and sparse principal component analysis. Though CCCP is widely used in many applications, its convergence behavior has not gotten a lot of specific attention. Yuille and Rangarajan analyzed its convergence in their original paper; however, we believe the analysis is not complete. The convergence of CCCP can be derived from the convergence of the d.c. algorithm (DCA), proposed in the global optimization literature to solve general d.c. programs, whose proof relies on d.c. duality. In this note, we follow a different reasoning and show how Zangwill's global convergence theory of iterative algorithms provides a natural framework to prove the convergence of CCCP. This underlines Zangwill's theory as a powerful and general framework to deal with the convergence issues of iterative algorithms, after also being used to prove the convergence of algorithms like expectation-maximization and generalized alternating minimization. In this note, we provide a rigorous analysis of the convergence of CCCP by addressing two questions: When does CCCP find a local minimum or a stationary point of the d.c. program under consideration? and when does the sequence generated by CCCP converge? We also present an open problem on the issue of local convergence of CCCP.

Resumo Limpo

concaveconvex procedur cccp iter algorithm solv dc differ convex function program sequenc convex program machin learn cccp extens use mani learn algorithm includ spars support vector machin svms transduct svms spars princip compon analysi though cccp wide use mani applic converg behavior gotten lot specif attent yuill rangarajan analyz converg origin paper howev believ analysi complet converg cccp can deriv converg dc algorithm dca propos global optim literatur solv general dc program whose proof reli dc dualiti note follow differ reason show zangwil global converg theori iter algorithm provid natur framework prove converg cccp underlin zangwil theori power general framework deal converg issu iter algorithm also use prove converg algorithm like expectationmaxim general altern minim note provid rigor analysi converg cccp address two question cccp find local minimum stationari point dc program consider sequenc generat cccp converg also present open problem issu local converg cccp

Resumos Similares

Comput Biol Chem - A hyper-heuristic for the Longest Common Subsequence problem. ( 0,89011602559075 )
Neural Comput - Guaranteed classification via regularized similarity learning. ( 0,873853277985703 )
IEEE Trans Image Process - Fast image recovery using variable splitting and constrained optimization. ( 0,866947501276573 )
IEEE Trans Neural Netw Learn Syst - Incremental Support Vector Learning for Ordinal Regression. ( 0,862661601407222 )
IEEE Trans Image Process - Efficient algorithms for robust recovery of images from compressed data. ( 0,86201317642295 )
IEEE Trans Neural Netw Learn Syst - A one-class kernel fisher criterion for outlier detection. ( 0,857306178098866 )
Neural Comput - Nondegenerate piecewise linear systems: a finite Newton algorithm and applications in machine learning. ( 0,853784148828538 )
IEEE Trans Neural Netw Learn Syst - Learning With Mixed Hard/Soft Pointwise Constraints. ( 0,846149107443999 )
IEEE Trans Neural Netw Learn Syst - Scalable Nonparametric Low-Rank Kernel Learning Using Block Coordinate Descent. ( 0,837030914995671 )
IEEE Trans Image Process - Smoothed low rank and sparse matrix recovery by iteratively reweighted least squares minimization. ( 0,827789951730701 )
IEEE Trans Image Process - An alternating minimization algorithm for binary image restoration. ( 0,826084465794086 )
IEEE Trans Neural Netw Learn Syst - Convergence and rate analysis of neural networks for sparse approximation. ( 0,824523105113957 )
IEEE Trans Image Process - On the complexity of mumford-shah-type regularization, viewed as a relaxed sparsity constraint. ( 0,82129434950165 )
IEEE Trans Image Process - Alternating direction method for balanced image restoration. ( 0,819934676118047 )
IEEE Trans Image Process - Sparse stochastic processes and discretization of linear inverse problems. ( 0,815989444527347 )
IEEE Trans Image Process - Restoration of Poissonian images using alternating direction optimization. ( 0,814807806228752 )
IEEE Trans Image Process - An iterative L1-based image restoration algorithm with an adaptive parameter estimation. ( 0,808933606673929 )
IEEE Trans Pattern Anal Mach Intell - Constrained Nonnegative Matrix Factorization for Image Representation. ( 0,808386490128858 )
Neural Comput - Alternating direction methods for latent variable gaussian graphical model selection. ( 0,803689281281571 )
IEEE Trans Image Process - An iterative linear expansion of thresholds for l1-based image restoration. ( 0,802934880544055 )
IEEE Trans Pattern Anal Mach Intell - Maximum Correntropy Criterion for Robust Face Recognition. ( 0,798377170114812 )
IEEE Trans Image Process - Efficient algorithm for nonconvex minimization and its application to PM regularization. ( 0,795279481536383 )
Comput Math Methods Med - A 3D finite-difference BiCG iterative solver with the Fourier-Jacobi preconditioner for the anisotropic EIT/EEG forward problem. ( 0,790743525480916 )
IEEE Trans Neural Netw Learn Syst - A Neurodynamic Optimization Method for Recovery of Compressive Sensed Signals With Globally Converged Solution Approximating to l0 Minimization. ( 0,78636507916797 )
IEEE Trans Image Process - Parameter selection for total-variation-based image restoration using discrepancy principle. ( 0,785978053035606 )
Neural Comput - Alternating proximal regularized dictionary learning. ( 0,785900098821385 )
IEEE Trans Image Process - Generalized higher degree total variation (HDTV) regularization. ( 0,784217848863616 )
IEEE Trans Image Process - An alternating direction algorithm for total variation reconstruction of distributed parameters. ( 0,782976330312706 )
J. Comput. Biol. - The co phylogeny reconstruction problem is NP-complete. ( 0,781683323135177 )
IEEE Trans Image Process - Deconvolving images with unknown boundaries using the alternating direction method of multipliers. ( 0,780808360424411 )
IEEE Trans Image Process - Inductive robust principal component analysis. ( 0,780728229420317 )
Neural Comput - A novel iterative method for computing generalized inverse. ( 0,779160358069206 )
J. Comput. Biol. - An improved satisfiability algorithm for nested canalyzing functions and its application to determining a singleton attractor of a Boolean network. ( 0,776537228199413 )
IEEE Trans Image Process - A fast adaptive parameter estimation for total variation image restoration. ( 0,774621550507 )
IEEE Trans Image Process - Parallel proximal algorithm for image restoration using hybrid regularization. ( 0,774533867081072 )
IEEE Trans Neural Netw Learn Syst - Online Sequential Extreme Learning Machine With Kernels. ( 0,772839456244909 )
Neural Comput - Learning rates of lq coefficient regularization learning with gaussian kernel. ( 0,770964558931364 )
IEEE Trans Image Process - Improved image recovery from compressed data contaminated with impulsive noise. ( 0,768261645814853 )
Comput. Biol. Med. - Three penalized EM-type algorithms for PET image reconstruction. ( 0,764528178175975 )
Neural Comput - Active subspace: toward scalable low-rank learning. ( 0,760238894075041 )
IEEE Trans Image Process - A primal-dual method for total-variation-based wavelet domain inpainting. ( 0,757883462722626 )
IEEE Trans Image Process - Alternating minimization algorithm for speckle reduction with a shifting technique. ( 0,754947391635107 )
IEEE Trans Pattern Anal Mach Intell - Robust Recovery of Corrupted Low-rank Matrix by Implicit Regularizers. ( 0,75189025742616 )
IEEE Trans Image Process - Hessian Schatten-norm regularization for linear inverse problems. ( 0,750415582115101 )
IEEE Trans Image Process - Minimization of monotonically levelable higher order MRF energies via graph cuts. ( 0,75007549363884 )
IEEE Trans Neural Netw Learn Syst - Further result on guaranteed H8 performance state estimation of delayed static neural networks. ( 0,748632200911493 )
Neural Comput - Foundations of support constraint machines. ( 0,745861284484553 )
Neural Comput - Linear coordinate-descent message passing for quadratic optimization. ( 0,744959105949909 )
IEEE Trans Image Process - An augmented Lagrangian approach to the constrained optimization formulation of imaging inverse problems. ( 0,74476547132564 )
Neural Comput - A parallel dual matrix method for blind signal separation. ( 0,739926083266936 )
IEEE Trans Image Process - A generalized accelerated proximal gradient approach for total-variation-based image restoration. ( 0,737626322965664 )
IEEE Trans Image Process - Nonlocal regularization of inverse problems: a unified variational framework. ( 0,735970846197306 )
IEEE Trans Pattern Anal Mach Intell - Optimized Product Quantization. ( 0,735932957416085 )
J. Comput. Biol. - Border length minimization problem on a square array. ( 0,735863610436443 )
Comput Math Methods Med - Study on parameter optimization for support vector regression in solving the inverse ECG problem. ( 0,733031635816307 )
IEEE Trans Image Process - Efficient rate-distortion optimal packetization of embedded bitstreams into independent source packets. ( 0,732656330985719 )
IEEE Trans Neural Netw Learn Syst - Kernel reconstruction ICA for sparse representation. ( 0,732625113022466 )
Comput Math Methods Med - Optimal control of HIV dynamic using embedding method. ( 0,731777411076993 )
IEEE Trans Image Process - Graph cuts for curvature based image denoising. ( 0,728979655907591 )
IEEE Trans Image Process - Approximate least trimmed sum of squares fitting and applications in image analysis. ( 0,727539162403524 )
Comput. Biol. Med. - Nonparametric optimization of constrained total variation for tomography reconstruction. ( 0,727277659575099 )
IEEE Trans Image Process - Optimal design of FIR triplet halfband filter bank and application in image coding. ( 0,725957340755718 )
J Med Syst - ACO for the surgical cases assignment problem. ( 0,725811769785975 )
IEEE Trans Image Process - Robust principal component analysis based on maximum correntropy criterion. ( 0,725524891359166 )
IEEE Trans Neural Netw Learn Syst - Finite-Horizon Approximate Optimal Guaranteed Cost Control of Uncertain Nonlinear Systems With Application to Mars Entry Guidance. ( 0,723092509622402 )
IEEE Trans Image Process - Parameter estimation for blind and non-blind deblurring using residual whiteness measures. ( 0,720760834276113 )
IEEE Trans Pattern Anal Mach Intell - Automatic Generation of Co-Embeddings from Relational Data with Adaptive Shaping. ( 0,720385127615913 )
IEEE Trans Image Process - An augmented Lagrangian method for total variation video restoration. ( 0,716969616441274 )
IEEE Trans Image Process - Blind spectral unmixing based on sparse nonnegative matrix factorization. ( 0,716650195361414 )
IEEE Trans Pattern Anal Mach Intell - Nonnegative Matrix Factorization with Earth Mover's Distance Metric for Image Analysis. ( 0,715165090615921 )
IEEE Trans Image Process - Regularization parameter selection for nonlinear iterative image restoration and MRI reconstruction using GCV and SURE-based methods. ( 0,714748027572021 )
IEEE Trans Image Process - Multiview deblurring for 3-D images from light-sheet-based fluorescence microscopy. ( 0,708623993055421 )
Neural Comput - Information-theoretic semi-supervised metric learning via entropy regularization. ( 0,706874687425188 )
IEEE Trans Image Process - Incremental training of a detector using online sparse eigendecomposition. ( 0,706280875387465 )
IEEE Trans Pattern Anal Mach Intell - Polynomial Eigenvalue Solutions to Minimal Problems in Computer Vision. ( 0,706101511076617 )
IEEE Trans Image Process - Efficient variational Bayesian approximation method based on subspace optimization. ( 0,705531505547396 )
IEEE Trans Image Process - Enhancement of coupled multichannel images using sparsity constraints. ( 0,705247892431912 )
IEEE Trans Pattern Anal Mach Intell - A Closed-Form Solution to Retinex with Nonlocal Texture Constraints. ( 0,700821632862221 )
IEEE Trans Pattern Anal Mach Intell - Iterative Quantization: A Procrustean Approach to Learning Binary Codes for Large-scale Image Retrieval. ( 0,700339189314102 )
IEEE Trans Pattern Anal Mach Intell - Shape Representation and Registration in Vector Implicit Spaces: Adopting a Closed Form Solution in the Optimization Process. ( 0,699244028874825 )
Neural Comput - Large-scale linear rankSVM. ( 0,698658566599491 )
IEEE Trans Neural Netw Learn Syst - An incremental design of radial basis function networks. ( 0,698557349633663 )
IEEE Trans Image Process - Gradient-based image recovery methods from incomplete Fourier measurements. ( 0,697694819079207 )
IEEE Trans Image Process - Manifold regularized discriminative nonnegative matrix factorization with fast gradient descent. ( 0,697483638463541 )
IEEE Trans Pattern Anal Mach Intell - Learning with Augmented Features for Supervised and Semi-supervised Heterogeneous Domain Adaptation. ( 0,695384805919796 )
IEEE Trans Image Process - Online sparse Gaussian process regression and its applications. ( 0,695372801353156 )
IEEE Trans Image Process - Solving inverse problems with piecewise linear estimators: from Gaussian mixture models to structured sparsity. ( 0,694470052336809 )
IEEE Trans Image Process - A coding-cost framework for super-resolution motion layer decomposition. ( 0,69439723043566 )
IEEE Trans Neural Netw Learn Syst - Comparison of l1-Norm SVR and Sparse Coding Algorithms for Linear Regression. ( 0,692349865080834 )
J. Comput. Biol. - On the complexity of rearrangement problems under the breakpoint distance. ( 0,691775628441425 )
IEEE Trans Neural Netw Learn Syst - Fick's Law Assisted Propagation for Semisupervised Learning. ( 0,691620916469734 )
IEEE Trans Image Process - Bits from photons: oversampled image acquisition using binary Poisson statistics. ( 0,68900181482424 )
IEEE Trans Image Process - Double shrinking sparse dimension reduction. ( 0,688359558776445 )
IEEE Trans Pattern Anal Mach Intell - A Tensor-Based Algorithm for High-Order Graph Matching. ( 0,687280563239661 )
Comput Biol Chem - Deposition and extension approach to find longest common subsequence for thousands of long sequences. ( 0,686166023091083 )
IEEE Trans Image Process - Fast nonconvex nonsmooth minimization methods for image restoration and reconstruction. ( 0,685360026389691 )
IEEE Trans Pattern Anal Mach Intell - Efficient Methods for Overlapping Group Lasso. ( 0,684241379570858 )
IEEE Trans Pattern Anal Mach Intell - Learning Categories from Few Examples with Multi Model Knowledge Transfer. ( 0,681826610811839 )
Comput Math Methods Med - Variational principles for buckling of microtubules modeled as nonlocal orthotropic shells. ( 0,681414730465709 )
Comput Biol Chem - An integer programming approach to DNA sequence assembly. ( 0,681099136889779 )