Solving Stochastic Optimization with Expectation Constraints Efficiently by a Stochastic Augmented Lagrangian-Type Algorithm. (arXiv:2106.11577v3 [math.OC] UPDATED)

Web: http://arxiv.org/abs/2106.11577

This paper considers the problem of minimizing a convex expectation function
with a set of inequality convex expectation constraints. We present a
computable stochastic approximation type algorithm, namely the stochastic
linearized proximal method of multipliers, to solve this convex stochastic
optimization problem. This algorithm can be roughly viewed as a hybrid of
stochastic approximation and the traditional proximal method of multipliers.
Under mild conditions, we show that this algorithm exhibits $O(K^{-1/2})$
expected convergence rates for both objective reduction and constraint …

algorithm arxiv constraints math optimization stochastic type