DiffPose-Animal: A Language-Conditioned Diffusion Framework for Animal Pose Estimation
By: Tianyu Xiong, Dayi Tan, Wei Tian
Potential Business Impact:
Helps computers understand animal body parts better.
Animal pose estimation is a fundamental task in computer vision, with growing importance in ecological monitoring, behavioral analysis, and intelligent livestock management. Compared to human pose estimation, animal pose estimation is more challenging due to high interspecies morphological diversity, complex body structures, and limited annotated data. In this work, we introduce DiffPose-Animal, a novel diffusion-based framework for top-down animal pose estimation. Unlike traditional heatmap regression methods, DiffPose-Animal reformulates pose estimation as a denoising process under the generative framework of diffusion models. To enhance semantic guidance during keypoint generation, we leverage large language models (LLMs) to extract both global anatomical priors and local keypoint-wise semantics based on species-specific prompts. These textual priors are encoded and fused with image features via cross-attention modules to provide biologically meaningful constraints throughout the denoising process. Additionally, a diffusion-based keypoint decoder is designed to progressively refine pose predictions, improving robustness to occlusion and annotation sparsity. Extensive experiments on public animal pose datasets demonstrate the effectiveness and generalization capability of our method, especially under challenging scenarios with diverse species, cluttered backgrounds, and incomplete keypoints.
Similar Papers
TalkingPose: Efficient Face and Gesture Animation with Feedback-guided Diffusion Model
CV and Pattern Recognition
Creates long, smooth talking animations from pictures.
DreamPose3D: Hallucinative Diffusion with Prompt Learning for 3D Human Pose Estimation
CV and Pattern Recognition
Lets computers guess people's movements in 3D.
Denoised Diffusion for Object-Focused Image Augmentation
CV and Pattern Recognition
Helps drones find sick animals even when hidden.