HFGaussian: Learning Generalizable Gaussian Human with Integrated Human Features

Recent advancements in radiance field rendering show promising results in 3-D scene representation, where Gaussian splatting-based techniques emerge as state-of-the-art due to their quality and efficiency. Gaussian splatting is widely used for various applications, including 3-D human representation. However, previous 3-D Gaussian splatting methods can not render RGB and human features simultaneously. Furthermore, these methods either use parametric body models as additional information or fail to provide any underlying structure, such as human biomechanical features, which are essential for various applications such as medical diagnosis. In this article, we present a novel approach called HFGaussian that can estimate novel views and human features, such as the 3-D skeleton, 3-D key points, and dense pose, from sparse input images simultaneously in real time at 25 FPS. The proposed method leverages the generalizable Gaussian splatting technique to represent the human subject and 3-D consistent human features, enabling efficient and generalizable reconstruction. By incorporating a pose regression network and the feature splatting technique with Gaussian splatting, HFGaussian demonstrates improved capabilities over existing 3-D human methods, showcasing the potential of 3-D human representations with integrated biomechanics. We thoroughly evaluate our HFGaussian method against the latest state-of-the-art techniques in human Gaussian splatting methods, demonstrating its real-time, state-of-the-art performance.

Paper

Similar papers

© 2026 NYSGPT2525 LLC