Feature Modulation for Semi-Supervised Domain Generalization without Domain Labels
By: Venuri Amarasinghe , Asini Jayakody , Isun Randila and more
Potential Business Impact:
Helps computers learn from messy, unlabeled data.
Semi-supervised domain generalization (SSDG) leverages a small fraction of labeled data alongside unlabeled data to enhance model generalization. Most of the existing SSDG methods rely on pseudo-labeling (PL) for unlabeled data, often assuming access to domain labels-a privilege not always available. However, domain shifts introduce domain noise, leading to inconsistent PLs that degrade model performance. Methods derived from FixMatch suffer particularly from lower PL accuracy, reducing the effectiveness of unlabeled data. To address this, we tackle the more challenging domain-label agnostic SSDG, where domain labels for unlabeled data are not available during training. First, we propose a feature modulation strategy that enhances class-discriminative features while suppressing domain-specific information. This modulation shifts features toward Similar Average Representations-a modified version of class prototypes-that are robust across domains, encouraging the classifier to distinguish between closely related classes and feature extractor to form tightly clustered, domain-invariant representations. Second, to mitigate domain noise and improve pseudo-label accuracy, we introduce a loss-scaling function that dynamically lowers the fixed confidence threshold for pseudo-labels, optimizing the use of unlabeled data. With these key innovations, our approach achieves significant improvements on four major domain generalization benchmarks-even without domain labels. We will make the code available.
Similar Papers
Dual-supervised Asymmetric Co-training for Semi-supervised Medical Domain Generalization
CV and Pattern Recognition
Helps doctors see diseases in medical scans.
Unlocking the Potential of Unlabeled Data in Semi-Supervised Domain Generalization
CV and Pattern Recognition
Teaches computers to learn from less-sure guesses.
Single Domain Generalization with Adversarial Memory
Machine Learning (CS)
Teaches computers to work with new data.