Data-driven informative priors for Bayesian inference with quasi-periodic data
By: Javier Lopez-Santiago , Luca Martino , Joaquin Miguez and more
Potential Business Impact:
Helps computers find hidden patterns in repeating data.
Bayesian computational strategies for inference can be inefficient in approximating the posterior distribution in models that exhibit some form of periodicity. This is because the probability mass of the marginal posterior distribution of the parameter representing the period is usually highly concentrated in a very small region of the parameter space. Therefore, it is necessary to provide as much information as possible to the inference method through the parameter prior distribution. We intend to show that it is possible to construct a prior distribution from the data by fitting a Gaussian process (GP) with a periodic kernel. More specifically, we want to show that it is possible to approximate the marginal posterior distribution of the hyperparameter corresponding to the period in the kernel. Subsequently, this distribution can be used as a prior distribution for the inference method. We use an adaptive importance sampling method to approximate the posterior distribution of the hyperparameters of the GP. Then, we use the marginal posterior distribution of the hyperparameter related to the periodicity in order to construct a prior distribution for the period of the parametric model. This workflow is empirical Bayes, implemented as a modular (cut) transfer of a GP posterior for the period to the parametric model. We applied the proposed methodology to both synthetic and real data. We approximated the posterior distribution of the period of the GP kernel and then passed it forward as a posterior-as-prior with no feedback. Finally, we analyzed its impact on the marginal posterior distribution.
Similar Papers
Influence of Prior Distributions on Gaussian Process Hyperparameter Inference
Computation
Improves computer predictions by choosing better settings.
Principled priors for Bayesian inference of circular models
Methodology
Helps understand weather and people's habits.
Practical considerations for Gaussian Process modeling for causal inference quasi-experimental studies with panel data
Methodology
Finds what really caused something over time.