Divergent Paths: Separating Homophilic and Heterophilic Learning for Enhanced Graph-level Representations
By: Han Lei , Jiaxing Xu , Xia Dong and more
Potential Business Impact:
Helps computers understand group patterns better.
Graph Convolutional Networks (GCNs) are predominantly tailored for graphs displaying homophily, where similar nodes connect, but often fail on heterophilic graphs. The strategy of adopting distinct approaches to learn from homophilic and heterophilic components in node-level tasks has been widely discussed and proven effective both theoretically and experimentally. However, in graph-level tasks, research on this topic remains notably scarce. Addressing this gap, our research conducts an analysis on graphs with nodes' category ID available, distinguishing intra-category and inter-category components as embodiment of homophily and heterophily, respectively. We find while GCNs excel at extracting information within categories, they frequently capture noise from inter-category components. Consequently, it is crucial to employ distinct learning strategies for intra- and inter-category elements. To alleviate this problem, we separately learn the intra- and inter-category parts by a combination of an intra-category convolution (IntraNet) and an inter-category high-pass graph convolution (InterNet). Our IntraNet is supported by sophisticated graph preprocessing steps and a novel category-based graph readout function. For the InterNet, we utilize a high-pass filter to amplify the node disparities, enhancing the recognition of details in the high-frequency components. The proposed approach, DivGNN, combines the IntraNet and InterNet with a gated mechanism and substantially improves classification performance on graph-level tasks, surpassing traditional GNN baselines in effectiveness.
Similar Papers
Exploring Adaptive Structure Learning for Heterophilic Graphs
Machine Learning (CS)
Helps computers learn from messy, connected data.
Interpretable and Adaptive Node Classification on Heterophilic Graphs via Combinatorial Scoring and Hybrid Learning
Machine Learning (CS)
Helps computers learn from messy, mixed-up data.
Adaptive Heterogeneous Graph Neural Networks: Bridging Heterophily and Heterogeneity
Machine Learning (CS)
Helps computers understand messy, connected information better.