Sample Complexity of Correlation Detection in the Gaussian Wigner Model
By: Dong Huang, Pengkun Yang
Potential Business Impact:
Find hidden connections in data networks.
Correlation analysis is a fundamental step in uncovering meaningful insights from complex datasets. In this paper, we study the problem of detecting correlations between two random graphs following the Gaussian Wigner model with unlabeled vertices. Specifically, the task is formulated as a hypothesis testing problem: under the null hypothesis, the two graphs are independent, while under the alternative hypothesis, they are edge-correlated through a latent vertex permutation, yet maintain the same marginal distributions as under the null. We focus on the scenario where two induced subgraphs, each with a fixed number of vertices, are sampled. We determine the optimal rate for the sample size required for correlation detection, derived through an analysis of the conditional second moment. Additionally, we propose an efficient approximate algorithm that significantly reduces running time.
Similar Papers
Detecting Correlation between Multiple Unlabeled Gaussian Networks
Statistics Theory
Finds hidden patterns in connected data.
Optimal community detection in dense bipartite graphs
Statistics Theory
Find hidden groups in complex connections.
Testing Correlation in Graphs by Counting Bounded Degree Motifs
Social and Information Networks
Finds hidden connections between two sets of data.