Certifiable 3D Object Pose Estimation: Foundations, Learning Models, and Self-Training

In this article, we consider a <italic>certifiable</italic> object pose estimation problem, where—given a partial point cloud of an object—the goal is to not only estimate the object pose, but also provide a certificate of correctness for the resulting estimate. Our first contribution is a general theory of certification for end-to-end perception models. In particular, we introduce the notion of <italic><inline-formula><tex-math notation="LaTeX">$\zeta$</tex-math></inline-formula>-correctness</italic>, which bounds the distance between an estimate and the ground truth. We then show that <inline-formula><tex-math notation="LaTeX">$\zeta$</tex-math></inline-formula>-correctness can be assessed by implementing two certificates: 1) a certificate of <italic>observable correctness</italic>, which asserts if the model output is consistent with the input data and prior information; and 2) a certificate of <italic>nondegeneracy</italic>, which asserts whether the input data are sufficient to compute a unique estimate. Our second contribution is to apply this theory and design a new learning-based certifiable pose estimator. In particular, we propose <monospace>C-3PO</monospace>, a semantic-keypoint-based pose estimation model, augmented with the two certificates, to solve the certifiable pose estimation problem. <monospace>C-3PO</monospace> also includes a <italic>keypoint corrector</italic>, implemented as a differentiable optimization layer, that can correct large detection errors (e.g., due to the sim-to-real gap). Our third contribution is a novel self-supervised training approach that uses our certificate of observable correctness to provide the supervisory signal to <monospace>C-3PO</monospace> during training. In it, the model trains only on the observably correct input–output pairs produced in each batch and at each iteration. As training progresses, we see that the observably correct input–output pairs grow, eventually reaching near 100% in many cases. We conduct extensive experiments to evaluate the performance of the corrector, the certification, and the proposed self-supervised training using the ShapeNet and YCB datasets. The experiments show that 1) standard semantic-keypoint-based methods (which constitute the backbone of <monospace>C-3PO</monospace>) outperform more recent alternatives in challenging problem instances; 2) <monospace>C-3PO</monospace> further improves performance and significantly outperforms all the baselines; and 3) <monospace>C-3PO</monospace>’s certificates are able to discern correct pose estimates.<sup>1</sup>

Paper

Similar papers

© 2026 NYSGPT2525 LLC