Bridging Cognitive Gap: Hierarchical Description Learning for Artistic Image Aesthetics Assessment
By: Henglin Liu , Nisha Huang , Chang Liu and more
Potential Business Impact:
Helps computers judge art like people do.
The aesthetic quality assessment task is crucial for developing a human-aligned quantitative evaluation system for AIGC. However, its inherently complex nature, spanning visual perception, cognition, and emotion, poses fundamental challenges. Although aesthetic descriptions offer a viable representation of this complexity, two critical challenges persist: (1) data scarcity and imbalance: existing dataset overly focuses on visual perception and neglects deeper dimensions due to the expensive manual annotation; and (2) model fragmentation: current visual networks isolate aesthetic attributes with multi-branch encoder, while multimodal methods represented by contrastive learning struggle to effectively process long-form textual descriptions. To resolve challenge (1), we first present the Refined Aesthetic Description (RAD) dataset, a large-scale (70k), multi-dimensional structured dataset, generated via an iterative pipeline without heavy annotation costs and easy to scale. To address challenge (2), we propose ArtQuant, an aesthetics assessment framework for artistic images which not only couples isolated aesthetic dimensions through joint description generation, but also better models long-text semantics with the help of LLM decoders. Besides, theoretical analysis confirms this symbiosis: RAD's semantic adequacy (data) and generation paradigm (model) collectively minimize prediction entropy, providing mathematical grounding for the framework. Our approach achieves state-of-the-art performance on several datasets while requiring only 33% of conventional training epochs, narrowing the cognitive gap between artistic images and aesthetic judgment. We will release both code and dataset to support future research.
Similar Papers
Image Aesthetic Reasoning via HCM-GRPO: Empowering Compact Model for Superior Performance
CV and Pattern Recognition
Teaches computers to judge if pictures look good.
Simple Lines, Big Ideas: Towards Interpretable Assessment of Human Creativity from Drawings
CV and Pattern Recognition
Computer grades drawings for creativity automatically.
Visual Categorization Across Minds and Models: Cognitive Analysis of Human Labeling and Neuro-Symbolic Integration
Artificial Intelligence
Helps computers understand pictures like people do.