On the inverse of covariance matrices for unbalanced crossed designs
By: Ziyang Lyu, S. A. Sisson, A. H. Welsh
Potential Business Impact:
Finds math shortcuts for complex data analysis.
This paper addresses a long-standing open problem in the analysis of linear mixed models with crossed random effects under unbalanced designs: how to find an analytic expression for the inverse of $\mathbf{V}$, the covariance matrix of the observed response. The inverse matrix $\mathbf{V}^{-1}$ is required for likelihood-based estimation and inference. However, for unbalanced crossed designs, $\mathbf{V}$ is dense and the lack of a closed-form representation for $\mathbf{V}^{-1}$, until now, has made using likelihood-based methods computationally challenging and difficult to analyse mathematically. We use the Khatri--Rao product to represent $\mathbf{V}$ and then to construct a modified covariance matrix whose inverse admits an exact spectral decomposition. Building on this construction, we obtain an elegant and simple approximation to $\mathbf{V}^{-1}$ for asymptotic unbalanced designs. For non-asymptotic settings, we derive an accurate and interpretable approximation under mildly unbalanced data and establish an exact inverse representation as a low-rank correction to this approximation, applicable to arbitrary degrees of unbalance. Simulation studies demonstrate the accuracy, stability, and computational tractability of the proposed framework.
Similar Papers
Non-Asymptotic Analysis of Data Augmentation for Precision Matrix Estimation
Machine Learning (Stat)
Helps computers learn better from more data.
Inference on covariance structure in high-dimensional multi-view data
Methodology
Finds patterns in different kinds of data.
Optimal Data Splitting for Holdout Cross-Validation in Large Covariance Matrix Estimation
Statistics Theory
Improves computer guesses about data patterns.