Friday, 24 September 2010

oc.optimization control - Maximizing Sparsity in l1 Minimization?

Consider the optimization problem



minx||Ax||1+lambda||xb||2,



where AinmathbbRntimesn, x,binmathbbRn and lambda is strictly greater than 0. (This problem is closely related to the "lasso" problem in basis pursuit.) Can anything be said about the value of lambda for which Ax is sparsest? Clearly some values are bad: for instance, if lambda is huge and b is dense then it is unlikely that Axstar will be very sparse.



In other words: among all lambda>0 there is at least one value lambdastar such that ||Axstar(lambda)||0 is minimized. Are there, say, bounds on lambdastar in terms of A and b? I'd also be interested in results pertaining to basis pursuit or other similar problems.



Edit: I'm primarily interested in problems where ideal sparsity cannot be achieved, i.e., ||Axstar(lambdastar)||0>0. (Assume that A is square w/ full rank and bne0.)

No comments:

Post a Comment