GrowSplat: Constructing Temporal Digital Twins of Plants with Gaussian Splats
By: Simeon Adebola , Shuangyu Xie , Chung Min Kim and more
Potential Business Impact:
Creates 3D plant growth movies from pictures.
Accurate temporal reconstructions of plant growth are essential for plant phenotyping and breeding, yet remain challenging due to complex geometries, occlusions, and non-rigid deformations of plants. We present a novel framework for building temporal digital twins of plants by combining 3D Gaussian Splatting with a robust sample alignment pipeline. Our method begins by reconstructing Gaussian Splats from multi-view camera data, then leverages a two-stage registration approach: coarse alignment through feature-based matching and Fast Global Registration, followed by fine alignment with Iterative Closest Point. This pipeline yields a consistent 4D model of plant development in discrete time steps. We evaluate the approach on data from the Netherlands Plant Eco-phenotyping Center, demonstrating detailed temporal reconstructions of Sequoia and Quinoa species. Videos and Images can be seen at https://berkeleyautomation.github.io/GrowSplat/
Similar Papers
GaussianPlant: Structure-aligned Gaussian Splatting for 3D Reconstruction of Plants
CV and Pattern Recognition
Shows plant's branches and leaves in 3D.
Cut-and-Splat: Leveraging Gaussian Splatting for Synthetic Data Generation
CV and Pattern Recognition
Creates realistic fake pictures for training AI.
TagSplat: Topology-Aware Gaussian Splatting for Dynamic Mesh Modeling and Tracking
Graphics
Creates smooth, connected 3D shapes that move realistically.