Document details for 'Discretisation for inference on Bayesian mixture models'

Authors Brewer, M.J.
Publication details Statistics and Computing 13, 209-219.
Keywords mixture models; discretisation; Bayesian inference
Abstract The problem of inference in Bayesian Normal mixture models is known to be difficult. In particular, direct Bayesian inference (via quadrature) suffers from a combinatorial explosion in having to consider every possible partition of n observations into k mixture components, resulting in a computation time which is O(kn). This paper explores the use of discretised parameters and shows that for equal-variance mixture models, direct computation time can be reduced to O(Dknk), where relevant continuous parameters are each divided into D regions. As a consequence, direct inference is now possible on genuine data sets for small k, where the quality of approximation is determined by the level of discretisation. For large problems, where the computational complexity is still too great in O(Dknk) time, discretisation can provide a convergence diagnostic for a Markov chain Monte Carlo analysis.
Last updated 2005-09-01
Links
  1. Software and information on paper
    http://www.bioss.sari.ac.uk/~markb/mixtures/index.html

Unless explicitly stated otherwise, all material is copyright © Biomathematics and Statistics Scotland.

Biomathematics and Statistics Scotland (BioSS) is formally part of The James Hutton Institute (JHI), a registered Scottish charity No. SC041796 and a company limited by guarantee No. SC374831. Registered Office: JHI, Invergowrie, Dundee, DD2 5DA, Scotland