Importance Nested Sampling paper submitted …

I’m pleased to announce that my paper on Importance Nested Sampling in collaboration with Farhan Feroz & Mike Hobson (&, of course, Tony Pettitt) has at last been submitted to JCGS, and is available on the astro-ph preprint server: .  As it stands, I believe that MultiNest with INS must be one of the most efficient out-of-the-box routines for marginal likelihood computation available these days.  Looking ahead to future work I have the suspicion that nested sampling may well prove rather effective for marginal likelihood computation in Wiener measure spaces (where direct importance sampling, for instance, seems unfeasible); though obviously with MCMC moves to find each constrained likelihood point rather than ellipse-based sampling (which doesn’t make sense in this context).  I will need to extend much further the measure-theoretic work we present in Appendix C of the INS paper to make progress with this idea though …

This entry was posted in Astronomy, Astrostatistics, Marginal Likelihood Estimation, Statistics. Bookmark the permalink.

5 Responses to Importance Nested Sampling paper submitted …

  1. This is pretty much the same idea as Diffusive Nested Sampling. Would appreciate a citation. Thanks!

    • I really don’t think it is, Brendan! Diffusive NS (which I have indeed been aware of for some time) still estimates X_i’s (sampled via MCMC) to sum up the likelihoods via the one-dimensional integration of ordinary nested sampling, whereas INS uses a losing the labels strategy to combine our Li’s (sampled uniformly within ellipses; and thereby being nested sampling only in its exploration of the posterior, not its marginal likelihood estimation technique given those samples). If INS and DNS were so similar then I imagine your paper would include citations to Geyer et al. 1994, Vardi 1985, Kong et al. 1994, Veach & Guibas 1995 and so on! 🙂

  2. I’ll give this paper a proper read now. 🙂

  3. We have an appendix (A) where I’ve tried to reconstruct the heritage of INS. Appendix C is probably needs some clarification, but is potentially the most interesting as I suspect NS [or DNS] (rather than INS, which isn’t applicable in the following) could be quite useful for marginal likelihood estimation in infinite-dimensional MCMC problems (like those of Beksos & Stuart 2010 for Wiener measure; but [to clarify] not for those concerning the Dirichlet process where it’s easier to integrate out the infinite-dimensional aspects of the problem via the Polya urn Gibbs sampling construction and compute marginal likelihoods via reverse logistic regression; e.g. Doss 2010).

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s