Summary
This paper proposes a probabilistic integrator for solving stiff semi-linear ODEs that decouples linear and nonlinear components for improved accuracy. The approach uses an integrated Ornstein-Uhlenbeck process (IOUP) prior and posterior inference extends classical exponential integrator to exactly solve the linear components. Nonlinearities are approximated via local linearization similar to the extended Kalman filter (EKF). The authors present L-stability results and address computation through proposed approximations of the Jacobian that capture only the linear dynamics.
Strengths
This is a solid paper; well-written, well-motivated, nice execution. The results aren’t groundbreaking when compared to baseline, but there are clear benefits of the proposed method, particularly when nonlinearities are less significant. Furthermore, results are presented honestly and limitations are clearly identified.
Weaknesses
The paper fails to highlight any benefit of treating the initial value problem (IVP) as a Bayesian inference task. The posterior distribution *should* characterize uncertainty over the solution, and thus it is possible to quantify and report confidence in the solution. It is further possible to scrutinize the appropriateness of the IOUP as a prior. The paper does not address this, but instead prioritizes numerical accuracy and execution time. While these metrics are certainly important, they are not the primary motivation of probabilistic numerics. This is not a critical flaw, but perhaps a missed opportunity to demonstrate the benefit of a Bayesian approach to a numerical method.
Unsurprisingly, the proposed method is fairly sensitive to nonlinearity of the ODEs. The experiment in Sec. 4.1 demonstrates that accuracy degrades as the quadratic term becomes more significant. In fact, the proposed method seems to be more sensitive to this than baseline IWP methods, albeit with uniformly lower error. For the simple ODE in Sec. 4.1 all methods achieve very low error (on the order of $10^{-10}$) so the observed improvement with the IOUP is marginal unless the ODE is highly linear.
Some detailed comments:
* Fig. 5 should reference subfigures (e.g. (a) is never explicitly mentioned).
* L268: Typo "Since th problem..."
Questions
* The authors suggest that probabilistic integrators may be preferable for expensive-to-evaluate functions (L259). How? Can the method avoid explicit evaluation via prediction?
* The EKF can be quite unreliable in even simple nonlinear dynamical systems, leading to preferred approaches such as the UKF. Would not such an approach be preferable here to avoid the local linear approximations? What is the main challenge in a more accurate approximation?
Rating
8: Strong Accept: Technically strong paper, with novel ideas, excellent impact on at least one area, or high-to-excellent impact on multiple areas, with excellent evaluation, resources, and reproducibility, and no unaddressed ethical considerations.
Confidence
4: You are confident in your assessment, but not absolutely certain. It is unlikely, but not impossible, that you did not understand some parts of the submission or that you are unfamiliar with some pieces of related work.
Limitations
Limitations are clearly described in Sec. 5