Score Matching for Estimating Finite Point Processes
By: Haoqun Cao, Yixuan Zhang, Feng Zhou
Potential Business Impact:
Helps computers learn patterns from event data.
Score matching estimators have garnered significant attention in recent years because they eliminate the need to compute normalizing constants, thereby mitigating the computational challenges associated with maximum likelihood estimation (MLE).While several studies have proposed score matching estimators for point processes, this work highlights the limitations of these existing methods, which stem primarily from the lack of a mathematically rigorous analysis of how score matching behaves on finite point processes -- special random configurations on bounded spaces where many of the usual assumptions and properties of score matching no longer hold. To this end, we develop a formal framework for score matching on finite point processes via Janossy measures and, within this framework, introduce an (autoregressive) weighted score-matching estimator, whose statistical properties we analyze in classical parametric settings. For general nonparametric (e.g., deep) point process models, we show that score matching alone does not uniquely identify the ground-truth distribution due to subtle normalization issues, and we propose a simple survival-classification augmentation that yields a complete, integration-free training objective for any intensity-based point process model for spatio-temporal case. Experiments on synthetic and real-world temporal and spatio-temporal datasets, demonstrate that our method accurately recovers intensities and achieves performance comparable to MLE with better efficiency.
Similar Papers
Score Matching With Missing Data
Machine Learning (Stat)
Helps computers learn from messy, incomplete information.
Convergence Dynamics of Over-Parameterized Score Matching for a Single Gaussian
Machine Learning (CS)
Teaches computers to learn patterns from data.
Multi-Marginal Stochastic Flow Matching for High-Dimensional Snapshot Data at Irregular Time Points
Machine Learning (CS)
Tracks complex changes from few, uneven snapshots.