Towards Adaptive Self-Normalized Importance Samplers
By: Nicola Branchini, Víctor Elvira
Potential Business Impact:
Improves computer learning by finding better ways.
The self-normalized importance sampling (SNIS) estimator is a Monte Carlo estimator widely used to approximate expectations in statistical signal processing and machine learning. The efficiency of SNIS depends on the choice of proposal, but selecting a good proposal is typically unfeasible. In particular, most of the existing adaptive IS (AIS) literature overlooks the optimal SNIS proposal. In this paper, we introduce an AIS framework that uses MCMC to approximate the optimal SNIS proposal within an iterative scheme. This is, to the best of our knowledge, the first AIS framework targeting specifically the SNIS optimal proposal. We find a close connection with adaptive schemes used in ratio importance sampling (RIS), which also brings a new perspective and paves the way for combining techniques from AIS and adaptive RIS. We outline possible extensions, connections with existing MCMC-driven AIS algorithms, theoretical directions, and demonstrate performance in numerical examples.
Similar Papers
Stochastic Optimization with Optimal Importance Sampling
Optimization and Control
Improves computer guessing for better results.
Efficient rare event estimation for multimodal and high-dimensional system reliability via subset adaptive importance sampling
Computation
Finds rare problems in complicated machines.
Iterated sampling importance resampling with adaptive number of proposals
Computation
Makes computer guesses more accurate and faster.