DeltaDock: A Unified Framework for Accurate, Efficient, and Physically Reliable Molecular Docking

Molecular docking, a technique for predicting ligand binding poses, is crucial in structure-based drug design for understanding protein-ligand interactions. Recent advancements in docking methods, particularly those leveraging geometric deep learning (GDL), have demonstrated significant efficiency and accuracy advantages over traditional sampling methods. Despite these advancements, current methods are often tailored for specific docking settings, and limitations such as the neglect of protein side-chain structures, difficulties in handling large binding pockets, and challenges in predicting physically valid structures exist. To accommodate various docking settings and achieve accurate, efficient, and physically reliable docking, we propose a novel two-stage docking framework, DeltaDock, consisting of pocket prediction and site-specific docking. We innovatively reframe the pocket prediction task as a pocket-ligand alignment problem rather than direct prediction in the first stage. Then we follow a bi-level coarse-to-fine iterative refinement process to perform site-specific docking. Comprehensive experiments demonstrate the superior performance of DeltaDock. Notably, in the blind docking setting, DeltaDock achieves a 31\% relative improvement over the docking success rate compared with the previous state-of-the-art GDL model. With the consideration of physical validity, this improvement increases to about 300\%.

Paper

References (52)

Scroll for more · 38 remaining

Similar papers

Peer review

Reviewer qFb13/10 · confidence 4/52024-07-01

Summary

This paper proposed a model named DeltaDock for molecular docking. DeltaDock integrates protein pocket prediction and protein-ligand binding refinement. The pocket prediction is modeled as a pocket-ligand alignment problem with candidates of pockets given by other pocket prediction methods. The docking is formulated as a refinement problem given the initial docking conformation. Comparison with computational chemistry docking tools and learning-based methods show the advantages of DeltaDock. DeltaDock runs much faster than most of the baselines.

Strengths

1. The model is faster than the diffusion-based method DiffDock. 2. The experimental results show that DeltaDock has a good performance in blind docking.

Weaknesses

1. The testing set is not clearly described. Training and test proteins should have a maximum sequence identity of 40% to test the generalization. 2. in figure2, the compared methods are not consistent. For example, vina is in Figure 2 (a) but not in Figure 2 (b). This may be sometimes misleading. 3. in Line 60, "a GPU-accelerated pose sampling algorithm generating high-quality initial structure" is just DSDP, which limits the novelty of the paper. 4. what if you combine the pocket prediction of DeltaDock and autodock vina? Whether the improvement is due to the pocket prediction or the refinement is not clear.

Questions

what is the distance threshold used for graph construction?

Rating

3

Confidence

4

Soundness

2

Presentation

3

Contribution

2

Limitations

Yes

Authorsrebuttal2024-08-13

Dear Reviwer, Thank you for taking the time to read our response, and provide valuable feedback. Here’s our response to your further concerns: > The PoseBusters results on varying levels of sequence similarity are different from those in the PoseBuster paper. **This discrepancy likely stems from the different versions of the PoseBusters dataset used.** Our initial results were based on PoseBusters v1 (428 data examples), while your analysis might be based on PoseBusters v2, a subset of v1 containing 308 data points, divided into three similarity subsets of 109, 76, and 123 data points. All baseline performance metrics, except for VINA and SMINA, were directly extracted from the PoseBusters paper. We independently ran VINA and SMINA to obtain the generated poses for downstream refinement experiments with DeltaDock. We carefully followed the experimental settings outlined in the PoseBusters paper to ensure consistency and reproducibility. A bounding box with a side length of 25 Å was created around the centroid of the crystal ligand. 40 poses were generated with an exhaustiveness setting of 32, and the top-ranked pose was selected. For VINA, which only accepts PDBQT files as input, we followed the PoseBusters methodology, preparing ligand PDBQT files with Meeko and protein PDBQT files with the ADFR `prepare_receptor` script. **For clarity and comparison, the following Table presents the experimental results on the PoseBusters v2 dataset.** This table includes both our reproduced VINA results (denoted as VINA) and the VINA results reported in the PoseBusters paper (denoted as VINA*). As you can see, the performance of VINA, SMINA, and DSDP is comparable. While we aimed to replicate the VINA* results precisely, achieving identical performance can be challenging due to potential variations in computational environments. Importantly, DeltaDock consistently maintains a slight performance advantage over VINA*. |Dataset|EquiBind|TankBind|DiffDock|VINA|SMINA|VINA*|DSDP|DeltaDock| |-|-|-|-|-|-|-|-|-| |PoseBuster|2.0|16.0|38.0|50|51|60|52|**61**| |PoseBuster(PB-Valid)|0.0|3.3|12.0|49|50|58|51|**60**| |Method |% RMSD < 2.0 Å|||% RMSD < 2.0 Å & PB-Valid||| |-|-|-|-|-|-|-| ||[0,0.3]|(0.3,0.95]|(0.95,1]|[0,0.3]|(0.3,0.95]|(0.95,1]| |EquiBind|0|1.3|4.1|0|0|0| |TankBind|1.8|13|30|0|1.3|7.4| |DiffDock|15|45|54|0.92|11|24| |DSDP|40|46|65|40|43|63| |VINA|43|55|52|42|54|52| |SMINA|52|47|51|51|47|50| |VINA*|**56**|57|65|**54**|53|65| |DeltaDock|49|**58**|**73**|48|**58**|**72**| > This work is actually about pocket prediction and refining the result of an existing docking tool (DSDP), which should be made clearer. It is not proper to conflate these with a new docking framework We appreciate your point and understand the concern regarding the framing of our work. While we acknowledge it builds upon existing docking tools like DSDP, our primary contributions lie in **reframing pocket prediction** and developing an **effective iterative refinement model** that generalizes well across different docking tools. In our response, we have demonstrated its applicability to DSDP, VINA, and SMINA, showcasing its broader impact. For example, the CPLA pocket prediction model can combined with VINA to perform blind docking, and VINA/SMINA poses can be further refined by DeltaDock refinement model. We believe the evaluation of a work's could be comprehensive. While we have not developed a novel end-to-end docking framework, our framework offers a new perspective on pocket prediction and poses refinement, ultimately enhancing the accuracy and efficiency of molecular docking. --- Thank you again for your valuable feedback. We hope our revised explanation addresses your concerns and provides a better understanding of our contributions. We believe our work offers valuable advancements in the field and kindly hope you can reconsider its significance. Best regards, Paper Authors

Reviewer KF4e7/10 · confidence 4/52024-07-12

Summary

This manuscript introduces DeltaDock, a novel two-stage framework for molecular docking. Similar to previous works that use geometric deep learning methods, this work also takes the geometric dl network to do the modeling and the prediction is based on a regression problem. The main contribution is a contrastive based learning method for pocket prediction and also a bi-level update of the ligand pose prediction. The experiments are conducted on common datasets and also many studies are performed.

Strengths

1. The overall framework makes sense and is valid and useful for blind molecular docking. 2. The proposed contrastive learning approach for pocket prediction and the bi-level refinement module are novel contributions to the field. CPLA, in particular, reframes pocket prediction as a selection problem from a candidate set. 3. Lots of small tricks designed in the framework are beneficial to hold the correct structure and also help the final prediction. The detailed ablation studies, generalization analysis, and assessment of pose validity highlight the contribution of each component. 4. The experiments results are good compared to previous works.

Weaknesses

1. Though the process and the framework are reasonable, the overview of the work is quite similar to FABind, which implements a pocket prediction and a docking prediction molecules, The authors should put more comparison and describe more differences between these two works. 2. As the prediction module takes other external methods/tools, this framework is not a fully end-to-end one, though this is not a thing that we would purse must, I would like to hear my thoughts on this point. Why not do in an end-to-end way? The external tools indeed cost more and slow down the docking process. 3. The manuscript focuses on rigid protein docking, neglecting the inherent flexibility of protein side chains. Can the method get rid of the assumption that the protein side is rigid, modeling the side chain flexibility like previous works? [1, 2] [1] Qiao, Zhuoran, et al. "State-specific protein–ligand complex structure prediction with a multiscale deep generative model." Nature Machine Intelligence 6.2 (2024): 195-208. [2] Plainer, Michael, et al. "Diffdock-pocket: Diffusion for pocket-level docking with sidechain flexibility." (2023).

Questions

Please refer to Weakness Section

Rating

7

Confidence

4

Soundness

3

Presentation

3

Contribution

3

Limitations

Please refer to Weakness Section

Reviewer AHbE6/10 · confidence 4/52024-07-13

Summary

A new method for molecular docking based on neural networks, called DeltaDock, is introduced. DeltaDock uses a two-step procedure. The first step is finding the binding pocket for a given ligand, which is implemented by aligning the molecular structure with the pocket embedding. The alignment is conducted with the use of contrastive learning. The second step is the placement of the ligand in the binding pocket, which is defined as a regression task on atom positions. This step includes predicting interactions on a coarse and fine level of protein representation. A fast pose correction is implemented using torsion alignment and SMINA-based energy minimization. The experimental section shows that the proposed method outperforms other state-of-the-art methods in terms of the RMSD of generated poses. Moreover, these structures are more realistic than those produced by other deep learning approaches in terms of the PoseBuster filters.

Strengths

Originality: - The idea of pocket alignment using contrastive learning is interesting and novel in this context. This approach is usually used to predict drug-target interactions. It is interesting to see it applied to find binding pockets based on the ligand input. - The torsion alignment proposed in this paper is a new and effective method of correcting conformations produced by regression models. Quality: - The experimental section contains results on two data splits and compares both classical and neural-network-based molecular docking models, which places the DeltaDock among the state-of-the-art methods. - The average time of inference is provided for each method, which demonstrates the difference in execution time between DeltaDock and other methods. Clarity: - Overall, the paper is written clearly and is easy to follow. Significance: - The experiments show the proposed method's strong performance, outperforming other approaches in terms of pose quality and alignment with the ground-truth pose. - The full docking protocol includes some constraints that ensure there are no clashes or torsional strain. This is important due to the recent criticism of deep-learning docking methods. - At the same time, DeltaDock is faster than diffusion methods like DiffDock, which can further accelerate virtual screening.

Weaknesses

Originality: - The Bi-EGMN is based on a few architectural decisions that may have influenced the model's strong performance. For example, in Equations 7 and 8, the messages are weighted by the interatomic distances. In Equations 9 and 10, skip connections are used. Have you compared this architecture with one that uses other message weights or does not use skip connections? It would be interesting to see it in an ablation study. - FABind+ should also be described in the related work as it follows a similar approach, where first the binding pocket is predicted, and then the molecule is docked inside this binding pocket. Interestingly, the size of the binding pocket is also predicted in this improved version of FABind, which speaks to the claim that current GDL methods have “difficulties in handling large binding pockets.” Also, FABind+ shows very promising results in their paper. Now, the code of this method has been published, so it would be interesting to see this model in the comparison if possible in such a short discussion period. Quality: - I am wondering why the average (or median) RMSD is not provided in Table 1. Other papers, including FABind and EquiBind also provided percentiles. Clarity: - Figure 1b could be improved to better depict the coarse level and atom level pocket representation. I am unsure if the model block shown in between refinement steps helps in the comprehension of this figure. - The sentence in line 31 is imprecise. These methods use binding pockets in some sense because they encode the whole protein and use it to condition the generative or predictive model.

Questions

1. Is it possible to generate diverse poses with DeltaDock, e.g. by sampling different initial conformations? How diverse can these poses be, given that the networks are E(3)-equivariant? 2. Do you have any mechanism to estimate the predicted pose confidence? For example, some docking models can also provide affinity prediction or likelihood of the predicted poses.

Rating

6

Confidence

4

Soundness

3

Presentation

3

Contribution

4

Limitations

The limitations have been described.

Area Chair aZve2024-08-12

Discussion

Dear Reviewers, Please kindly review the authors' response with care, engage in discussions to clarify any uncertainties, and, if necessary, revise your comments accordingly. Thanks, AC

Authorsrebuttal2024-08-12

Dear Reviewer, thank you again for your insightful and detailed review. We conducted additional analyses and provide the results below. We believe these findings offer further clarification of the paper. > Figure 1b could be improved to better depict the coarse level and atom level pocket representation. I am unsure if the model block shown in between refinement steps helps in the comprehension of this figure. We appreciate your insightful suggestion regarding the framework figure. In response, we have revised the figure to enhance clarity. The updated figure, which incorporates your feedback by removing the model blocks and adding a visualization of fast structure correction, can be found at [this anonymous link](https://anonymous.4open.science/r/DeltaDock_NeurIPS_Rebuttal-B8EE/framework-new.png). We believe this revised version provides a clearer representation of our framework. Thank you for this valuable suggestion. > Do you have any mechanism to estimate the predicted pose confidence? For example, some docking models can also provide affinity prediction or likelihood of the predicted poses. Thank you for your valuable suggestion about confidence model. We are actively pursuing two avenues for incorporating confidence estimation into DeltaDock. - For one hand, we are developing a dedicated binary classification model for confidence estimation. - For the other hand, we also explored using SMINA directly as a confidence model. The second approach leverages SMINA's scoring function to guide pose selection from a candidate list. Specifically, we applied SMINA scoring to the top-10 poses predicted by DeltaDock, selecting the pose with the highest SMINA score. This simple strategy, denoted as "Top-10-SMINA," resulted in encouraging performance improvements. As shown in the table, "Top-10-SMINA" achieved a 3% improvement in docking success rate (Top-1 metric) on the PoseBusters dataset compared to using DeltaDock alone. While a slight performance decrease was observed for the PDBbind dataset, these results highlight the potential of combining diverse pose generation with confidence-based selection to achieve better docking accuracy. |Methods|PoseBusters||PDBbind|| |-|-|-|-|-| ||DeltaDock-SC|DeltaDock|DeltaDock-SC|DeltaDock| |Top-1|57|56|48|47| |Top-10-Best|74|73|64|59| |Top-10-SMINA|55|59|41|40| **Future Work:** We believe that integrating a robust confidence model is crucial for improving DeltaDock's performance and will be a central focus of our future work. We will continue to explore dedicated confidence models and the utilization of scoring functions like SMINA for enhanced pose selection. --- Once again, thank you for reviewing our paper and providing valuable suggestions, please let us know if you have any further concerns, and we are willing to answer any further questions you have. Best regards, Paper Authors

Reviewer AHbE2024-08-13

Thank you for the additional results and explanations. My comments have been properly addressed. I will keep my positive score.

Authorsrebuttal2024-08-13

Thank you for your reply !

Dear Reviewer, Thank you for taking me to read our response. We appreciate your careful consideration and are pleased that our responses have adequately addressed your initial concerns and inquiries. We particularly value your recommendations regarding ablation studies on the skip connection, further comparison between FABind+ and DeltaDock, the generation of diverse poses, and the insightful suggestions for improving the framework figure. These additions will undoubtedly enhance the clarity and comprehensiveness of our work, and we will incorporate them into the final revision. Regarding the generation of diverse poses followed by selection using a confidence model, we agree that this is an important avenue for future research. We plan to explore this approach in greater detail in subsequent work. Thank you again for your constructive feedback. We believe your suggestions will significantly improve the quality and impact of our manuscript. Best regards, Paper Authors

Reviewer KF4e2024-08-12

Follow-up Response

I appreciate the authors' hard work in the rebuttal. It has addressed all my concerns. Although the improvements are somewhat trivial, the authors have successfully demonstrated that this is a solid pipeline. I will raise my score.

Authorsrebuttal2024-08-12

Thank you for your reply !

Dear Reviewer, We thank you for your insightful feedback on our manuscript. We appreciate you taking the time to thoroughly review our work and provide valuable suggestions. We are pleased that our responses have adequately addressed your initial concerns and inquiries. The recommendations for further comparison between FABind/FABind+ and DeltaDock, as well as the insights on an end-to-end approach, will undoubtedly contribute to the clarity and comprehensiveness of our work. We will incorporate these additions into the final revision of our manuscript. Regarding flexible docking, we agree that extending DeltaDock to accommodate this paradigm represents a natural and critical next step for this research. Our ultimate goal is to develop a model capable of handling diverse docking scenarios, encompassing blind and site-specific docking, as well as rigid and flexible configurations. While further investigation is required, we hypothesize that several of our current observations, though perhaps not all, will likely remain relevant within the context of flexible docking. Thank you again for your constructive feedback. We believe your suggestions will significantly improve the quality and impact of our work. Best regards, Paper Authors

Reviewer qFb12024-08-13

Thanks for the rebuttal. This work is actually about pocket prediction and refining the result of an existing docking tool (DSDP), which should be made clearer. It is not proper to conflate these with a new docking framework. The PoseBusters results on varying levels of sequence similarity are different from those in the PoseBuster paper.

Program Chairsdecision2024-09-25

Decision

Accept (poster)

© 2026 NYSGPT2525 LLC