The Collusion of Memory and Nonlinearity in Stochastic Approximation With Constant Stepsize

In this work, we investigate stochastic approximation (SA) with Markovian data and nonlinear updates under constant stepsize $\alpha>0$. Existing work has primarily focused on either i.i.d. data or linear update rules. We take a new perspective and carefully examine the simultaneous presence of Markovian dependency of data and nonlinear update rules, delineating how the interplay between these two structures leads to complications that are not captured by prior techniques. By leveraging the smoothness and recurrence properties of the SA updates, we develop a fine-grained analysis of the correlation between the SA iterates $\theta_k$ and Markovian data $x_k$. This enables us to overcome the obstacles in existing analysis and establish for the first time the weak convergence of the joint process $(x_k, \theta_k)_{k\geq0}$. Furthermore, we present a precise characterization of the asymptotic bias of the SA iterates, given by $\mathbb{E}[\theta_\infty]-\theta^\ast=\alpha(b_\text{m}+b_\text{n}+b_\text{c})+O(\alpha^{3/2})$. Here, $b_\text{m}$ is associated with the Markovian noise, $b_\text{n}$ is tied to the nonlinearity, and notably, $b_\text{c}$ represents a multiplicative interaction between the Markovian noise and nonlinearity, which is absent in previous works. As a by-product of our analysis, we derive finite-time bounds on higher moment $\mathbb{E}[\|\theta_k-\theta^\ast\|^{2p}]$ and present non-asymptotic geometric convergence rates for the iterates, along with a Central Limit Theorem.

Paper

Similar papers

Peer review

Reviewer 9yxV7/10 · confidence 4/52024-07-10

Summary

This paper studies constant step-size stochastic approximation algorithms with Markovian noise. It is known that in this case, the error of a stochastic does not vanish asymptotically, even when consider averaging. This is \theta_n has a bias. Previous work have show how to study the bias of such algorithm for linear stochastic approximation. In this paper, the authors tackle the more challenging case of non-linear stochastic approximation. Most of the paper is devoted to proving that the bias is of order O(\alpha). Some discussion on the applicability of results is presented.

Strengths

The paper proposes a characterization of the bias under the challenging setting of Markovian noise plus non-linear drifts. The analysis is asymptotically tight as the step size \alpha converges to 0, i.e., the expression for the bias is not a bound but an equality plus smaller order terms. The implications of the results are discussed.

Weaknesses

Most of the assumptions needed to obtain the results are relatively mild but two conditions are quite strong: 1. strong monotonicity (A3) 2. Smoothness (A2) I think that the paper should discuss in more details these assumption and highlight that they are really limiting the applicability of the result. The assumption developed in part 4.2 to avoid assuming that the iterates are bounded seems quite strong, not verified in many practical cases (for instance any instance of stochastic gradient descent where the noise has a finite support would not satisfy this assumption), and very artificial (is the only purpose of this assumption to The paper is extremely long (54 pages including proofs and references). To me, this says that there is either too much content or that the results are too diluted. As a result, the paper is very technical and hard to read. There should be more effort to make the paper more readable. Some suggestions: - consider a slightly less general setting - avoid considering sub-cases (like section 4.2) that are a bit orthogoal to the paper The practical applications of the results are unclear. Some potential applications are presented in Section 4.5 / 4.6 but there are no experiments or simulations to confirm that this actually work (these sections are interesting, though). There is a lot of papers on the subject. This can be seen as a good sign (this is an active area of research), but at the same time, it is hard for me to really assess the novelty of the results. Note that there are some (recent) papers that seem related to these work and that might be cited. This last point is not a weakness since some of them are extremely recent (available online after the submission deadline): - Computing the Bias of Constant-step Stochastic Approximation with Markovian Noise. S Allmeier, N Gast (2024) - Bias in Stochastic Approximation Cannot Be Eliminated With Averaging, Caio Kalil Lauand, Sean P. Meyn (2022) - Revisiting Step-Size Assumptions in Stochastic Approximation. Caio Kalil Lauand, Sean Meyn (2024) A comparison with these papers might be useful (even of this is not mandatory for the two 2024 papers).

Questions

There are some questions / comments in the limit that would deserve some comments from the authors. The Markovian noise (x_k) is assumed exogeneous (it does not depend on \theta). For some application (like Q-learning with a navigating policy derived from \theta), this would not be satisfied. Could this assumption be lifted? The next order term is a O(\alpha^{3/2}): is it the sharpest bound or could O(\alpha^2) be obtained?

Rating

7

Confidence

4

Soundness

3

Presentation

3

Contribution

3

Limitations

The limitation of the assumptions (see "weaknesses") should be better discussed.

Reviewer gRG87/10 · confidence 4/52024-07-12

Summary

The present paper obtains a representation for the asymptotic bias of constant step-size nonlinear stochastic approximation with Markovian noise. In particular, this characterization makes the hindering effect of memory and nonlinearity explicit in terms of the algorithm's performance. Moreover, the authors establish ergodicity of the parameter-noise joint process (with and without projection of estimates), obtain finite-time bounds on L_p moments of the estimation error and establish a central limit theorem for the constant gain algorithm. Finally, a bias attenuation technique based upon the Richardson-Romberg extrapolation is proposed for the nonlinear algorithm.

Strengths

The contributions and assumptions are clearly identified. To the best of the reviewer's knowledge, the results are novel and exciting: it is great to see the hindering effect caused by the interplay between memory and nonlinearity in SA. This paper is well written, but could use some polishing. I did not have enough time to review all proofs in detail, but the analysis seems correct.

Weaknesses

One of the weaknesses of this paper is the fact that no numerical experiments are provided to illustrate any of the main results. Although a discussion on how the theory fits within Generalized Linear Models is given before the conclusions, I encourage the authors to include a simple toy example to illustrate some of their main results such as the CLT or the bias attenuation technique.

Questions

- Could the authors clarify if assuming strong monotonicity and uniform boundedness of g and its Lipschitz constant over x are indeed needed for the result in Thm. 4.6? I can see their importance for finite-time bounds, but if there are needed for the asymptotic bias bound, I believe that the authors should mention the employment of stronger assumptions when comparing their work with previous research on asymptotic results. - I am not sure I understand what the authors mean by ``fine-grained’’ when talking about the result in Thm. 4.6. Upon further inspection, it seems that equation (4.2) is an extension of the result in [40] for nonlinear recursions: it consists a representation for the dominant bias term plus an upper bound as in this previous work. Is the fine-grained part related to the upper bound for \alpha? - I might have missed this in the text, but could the authors clarify if the results in Sections 4.3 and 4.5 require projection?

Rating

7

Confidence

4

Soundness

2

Presentation

2

Contribution

3

Limitations

The authors addressed the limitations in their work through a clear list of assumptions and discussions after presenting the main results.

Reviewer o1Ug5/10 · confidence 3/52024-07-17

Summary

This paper considers a nonlinear stochastic approximation (SA) problem with Markov noise (MC). It is assumed that the MC is uniformly geometrically ergodic. Instead of the standard iterative procedure, a projection onto a bounded set is additionally introduced (the latter can be relaxed under the additional assumption of the existence of a positive density). Under these assumptions the authors manage to write a decomposition that characterizes the bias. At the same time, they manage to identify three factors influencing the bias: the factor of MC, the factor of nonlinearity of the procedure, and the factor of interaction between MC and nonlinearity. In addition, bounds for the Polyak-Ruppert averaging and the Richardson Romberg procedure are given.

Strengths

- Decomposition that characterizes the bias with explicit dependence on MC, non-linearity and interactions between MC and non-linearity.

Weaknesses

It would be good to obtain: - high probability bounds instead of the MSE - remove additional projection step and assumption on the density (it could be useful to consider convergence in the weighted W distance instead of V norm) - explicit dependence on the asymptotic variance of MC in the $O(\tau/(k - k_0))$.

Questions

Could you please comment on the fact that there is no dependence between stepsize and number of iterates in the Polyak Ruppert avaraging?

Rating

5

Confidence

3

Soundness

2

Presentation

3

Contribution

2

Limitations

-

Reviewer 3y4U7/10 · confidence 2/52024-07-18

Summary

This paper investigates stochastic approximation (SA) with Markovian data and nonlinear updates under constant stepsize, and establishes the weak convergence of the joint process $(x_t, \theta_t)$. It also presents a precise characterization of the asymptotic bias of the SA iterates.

Strengths

I find this paper well-written. The analysis appears to be correct (although details are not checked). Also, both the literature review and motivation are very clear. It seems to me that this paper has solved a challenging problem, caused by Markovian data and nonlinear updates.

Weaknesses

I find the presentation of this paper a bit technical for people that are not very familiar with this area. In addition, perhaps some numerical experiments should be performed to better illustrate the theory.

Questions

1. About Assump. 3: for many GLMs, we actually do not have strong convexity. I feel this assumption is a bit strong. 2. Page 4, line 147: is the notation superscript "\cross 2" defined anywhere? I assume this denotes the outer product of a vector. 3. Similar to Assump. 3, Assump. 4 should be justified further as well.

Rating

7

Confidence

2

Soundness

3

Presentation

3

Contribution

3

Limitations

NA

Reviewer 3y4U2024-08-07

The authors have done a good job in responding to my previous comments. I find their responses clear and detailed. I have no further questions.

Reviewer gRG82024-08-11

I thank the authors for their clarifying and detailed responses. I also thank them for including an experiment that validates their theorems. Also, it is interesting to see the experiment with i.i.d. data performing worst than the experiment with Markovian data. Here a few more observations: **On a bias equation** I apologize If I was not clear in my first response. When I mentioned [40] I was referring to their equation (10) where there are no limsups and not (8). However, it is very clear to me that this does not affect the value of our work since they do not incorporate the effects of nonlinearity. Still, I think I would be beneficial to mention that a similar fine-grained expression was obtained for the more restrictive case of linear $g$ in the final version. **Strong Monotonicity** Maybe it would be beneficial to provide a bit more discussion regarding Assumption 3 in the final version like in the responses provided (e.g. when it is satisfied/ or if it could be lifted).

Authorsrebuttal2024-08-11

Thank you for the clarification and response. We will include those discussions in our revised paper.

Reviewer o1Ug2024-08-12

I thank the authors for their response. I retain my current score.

Program Chairsdecision2024-09-25

Decision

Accept (spotlight)

© 2026 NYSGPT2525 LLC