Near-Efficient and Non-Asymptotic Multiway Inference
By: Oscar López , Arvind Prasadan , Carlos Llosa-Vite and more
Potential Business Impact:
Helps computers understand patterns in counting data.
We establish non-asymptotic efficiency guarantees for tensor decomposition-based inference in count data models. Under a Poisson framework, we consider two related goals: (i) parametric inference, the estimation of the full distributional parameter tensor, and (ii) multiway analysis, the recovery of its canonical polyadic (CP) decomposition factors. Our main result shows that in the rank-one setting, a rank-constrained maximum-likelihood estimator achieves multiway analysis with variance matching the Cram\'{e}r-Rao Lower Bound (CRLB) up to absolute constants and logarithmic factors. This provides a general framework for studying "near-efficient" multiway estimators in finite-sample settings. For higher ranks, we illustrate that our multiway estimator may not attain the CRLB; nevertheless, CP-based parametric inference remains nearly minimax optimal, with error bounds that improve on prior work by offering more favorable dependence on the CP rank. Numerical experiments corroborate near-efficiency in the rank-one case and highlight the efficiency gap in higher-rank scenarios.
Similar Papers
A Latent-Variable Formulation of the Poisson Canonical Polyadic Tensor Model: Maximum Likelihood Estimation and Fisher Information
Statistics Theory
Finds hidden patterns in complex data.
Pseudo-Maximum Likelihood Theory for High-Dimensional Rank One Inference
Statistics Theory
Helps computers find hidden patterns in data.
An Efficient and Interpretable Autoregressive Model for High-Dimensional Tensor-Valued Time Series
Methodology
Finds patterns in weather to predict future changes.