Summary
The paper proposes a novel method for posterior estimation when samples of likelihood are given. Specifically, the authors propose the use of flow matching (FM) to train continuous normalizing flow-based (CNF-based) posterior distributions, a method they term "flow matching posterior estimation" (FMPE). The authors highlight that their proposed method is appealing for two primary reasons. Firstly, they emphasize that CNFs are more powerful than the conventional discrete normalizing flow-based (DNF-based) methods, as CNFs can utilize more flexible network architecture to represent complex densities.
Secondly, FM eliminates the need to run integrators for training CNFs, a factor often dissuading researchers from using them. To train a CNF, one must define parametric vector fields (VFs) and train the model by maximizing the likelihoods, a process that includes running integrators. However, FM differs from the conventional maximum likelihood estimation (MLE) method in that it strives to match the model's VFs to predefined target VFs, from a source noise to a target distribution. The source noise, often referred to as the initial distribution, commonly uses the standard normal distribution. The target VFs are inferred by assuming that conditional distributions from a single sample of the target to the source distribution take Gaussian forms, in a manner similar to the forward process in diffusion-based generative models. Interestingly, one can sample the target VFs at any specified time between the source and the target distribution, circumventing the need for running integrators.
In addition to the adoption of FM in posterior estimation, the paper demonstrates that under certain regularity assumptions, the flow matching loss provides an upper bound on the forward KL divergence between the target and the model posterior. The authors assert that this theoretical finding is crucial for posterior estimation as it suggests that the model posterior aims at covering the support of the target distribution rather than concentrating on higher density samples within the target's high probability region.
The authors also introduce some techniques to enhance FMPE. For instance, they propose the use of pyramid-like architectures from data to latent, with gated linear units to incorporate (latent, time) dependence, in place of the commonly chosen U-Net-based network architectures for CNFs in generative models. Additionally, they suggest an alternative t-weighting in the loss, superseding the uniform weighting of the original FM.
Lastly, the paper presents several experiments designed to demonstrate the effectiveness of the proposed method, including gravitational-wave inference tasks.
Strengths
Overall I find that the writing is clear, concise, and well-structured, making it easy for readers to follow the arguments and understand the key points. The authors have succeeded in providing a fresh perspective on the topic, shedding new light on the subject matter and offering meaningful contributions to the machine learning communities.
Weaknesses
From my perspective, the key innovation of this paper lies in its use of flow matching (FM) for posterior estimations. Essentially, the authors are training conditional models using FM, which marks a fresh approach in the field. While the aim of the study is clear, however, the technical challenges it faces seem minor. The authors could benefit from providing more details about these challenges to strengthen their argument and increase the depth of their research.
The choice of experiments further aggravates these issues. For instance, the use of gravitational-wave inference tasks isn't compelling enough. To better showcase the technical contributions of their work, such as the new network architectures or the t-weighting in the loss, the authors should consider more demanding tasks. These could provide a more substantial platform for discussing their technical contributions.
Rating
5: Borderline accept: Technically solid paper where reasons to accept outweigh reasons to reject, e.g., limited evaluation. Please use sparingly.
Confidence
4: You are confident in your assessment, but not absolutely certain. It is unlikely, but not impossible, that you did not understand some parts of the submission or that you are unfamiliar with some pieces of related work.
Limitations
Please refer to the comments provided in the weaknesses section.