Summary
The paper proposes the Equivariant Transformer Flow (ET-Flow) which predicts low-energy molecular conformations given the molecular graphs. Unlike existing methods that rely on large transformer-based models for conformed fields or complex internal geometry calculations, ET-Flow leverages flow matching with equivariance and harmonic prior which directly operates on all-atom coordinates with minimal assumptions. The extensive experimental results illustrate that ET-Flow achieves state-of-the-art performance in molecular conformer generation benchmarks with fewer parameters and faster inference times, outperforming or matching previous methods while maintaining high accuracy and efficiency.
Strengths
1. The proposed approach represents a significant innovation by leveraging flow matching with equivariance and harmonic prior in order to simplify the conformer generation process while maintaining high accuracy.
1. ET-Flow achieves SOTA model performance on molecular conformer generation benchmarks, outperforming or matching existing methods with much fewer parameters and faster inference times without sacrificing accuracy. The high accuracy and efficiency make it a promising candidate for practical applications.
1. The paper provides comprehensive experimental results, comparing ET-Flow with several leading approaches across various datasets. The inclusion of various evaluation metrics strengthens the validity of the findings.
Weaknesses
1. ET-Flow achieves SOTA or near-SOTA performance on the benchmarks. However, my concern is that TorchMD-Net is already a strong model with a well-established architecture that leverages equivariant transformers for molecular modeling. Given this, it can be challenging to attribute the performance improvements of ET-Flow to the flow matching approach. Ablation studies focusing on the flow matching component or results from simpler architectures might be useful.
1. The need for a post hoc chirality correction step suggests that the model does not inherently handle stereochemistry (baseline models like MCF do not require such an explicit correction). Such a weakness may result in issues in practical applications.
1. ET-Flow primarily combines TorchMD-Net with the flow matching technique. While both components are robust and effective, the novelty of the approach is limited as it largely builds on existing methodologies. This integration, although leading to performance improvements, does not significantly advance the state-of-the-art in terms of methodological innovation.
Questions
1. The proposed model utilizes an equivariant model architecture. Meanwhile, it is widely argued that equivariance is not a requirement for molecular machine learning (as suggested in the MCF paper). Without equivariance, the model is more easily generalized and scaled, and the symmetry could be implicitly learned from the data. I would like to ask the authors about the thoughts on this. In particular, I'm interested in the scaling performance (with respect to data or model size) of ET-Flow compared to MCF.
1. Have the authors considered conducting data augmentation to improve the diversity of generated conformations and enhance recall metrics?
Limitations
The authors have discussed the limitations of recall performance and additional chirality correction steps. No potential negative societal impact is involved.