In-Field Mapping of Grape Yield and Quality with Illumination-Invariant Deep Learning
By: Ciem Cornelissen , Sander De Coninck , Axel Willekens and more
Potential Business Impact:
Robot finds and grades grapes in real-time.
This paper presents an end-to-end, IoT-enabled robotic system for the non-destructive, real-time, and spatially-resolved mapping of grape yield and quality (Brix, Acidity) in vineyards. The system features a comprehensive analytical pipeline that integrates two key modules: a high-performance model for grape bunch detection and weight estimation, and a novel deep learning framework for quality assessment from hyperspectral (HSI) data. A critical barrier to in-field HSI is the ``domain shift" caused by variable illumination. To overcome this, our quality assessment is powered by the Light-Invariant Spectral Autoencoder (LISA), a domain-adversarial framework that learns illumination-invariant features from uncalibrated data. We validated the system's robustness on a purpose-built HSI dataset spanning three distinct illumination domains: controlled artificial lighting (lab), and variable natural sunlight captured in the morning and afternoon. Results show the complete pipeline achieves a recall (0.82) for bunch detection and a $R^2$ (0.76) for weight prediction, while the LISA module improves quality prediction generalization by over 20% compared to the baselines. By combining these robust modules, the system successfully generates high-resolution, georeferenced data of both grape yield and quality, providing actionable, data-driven insights for precision viticulture.
Similar Papers
Advancing Wheat Crop Analysis: A Survey of Deep Learning Approaches Using Hyperspectral Imaging
CV and Pattern Recognition
Helps farmers spot sick wheat plants early.
Knowledge-Informed Deep Learning for Irrigation Type Mapping from Remote Sensing
CV and Pattern Recognition
Maps how farms water crops better.
Towards Realistic Low-Light Image Enhancement via ISP Driven Data Modeling
CV and Pattern Recognition
Makes dark pictures clear and bright.