© 2006 Society of Systematic Biologists
Comparative Performance of Bayesian and AIC-Based Measures of Phylogenetic Model Uncertainty
1 School of Biological Sciences P.O. Box 644236, Pullman, Washington, 99164–4236, USA; E-mail: alfaro{at}wsu.edu
2 Section Ecology, Evolution, and Behavior 9500 Gilman Drive, Muir Biology 0116, La Jolla, California, 92093, USA; E-mail: johnh{at}biomail.ucsd.edu
Edited by Thomas Buckley: Associate Editor
 |
Abstract |
|---|
Reversible-jump Markov chain Monte Carlo (RJ-MCMC) is a technique for simultaneously evaluating multiple related (but not necessarily nested) statistical models that has recently been applied to the problem of phylogenetic model selection. Here we use a simulation approach to assess the performance of this method and compare it to Akaike weights, a measure of model uncertainty that is based on the Akaike information criterion. Under conditions where the assumptions of the candidate models matched the generating conditions, both Bayesian and AIC-based methods perform well. The 95% credible interval contained the generating model close to 95% of the time. However, the size of the credible interval differed with the Bayesian credible set containing approximately 25% to 50% fewer models than an AIC-based credible interval. The posterior probability was a better indicator of the correct model than the Akaike weight when all assumptions were met but both measures performed similarly when some model assumptions were violated. Models in the Bayesian posterior distribution were also more similar to the generating model in their number of parameters and were less biased in their complexity. In contrast, Akaike-weighted models were more distant from the generating model and biased towards slightly greater complexity. The AIC–based credible interval appeared to be more robust to the violation of the rate homogeneity assumption. Both AIC and Bayesian approaches suggest that substantial uncertainty can accompany the choice of model for phylogenetic analyses, suggesting that alternative candidate models should be examined in analysis of phylogenetic data.
Keywords: AIC; Akaike weights; Bayesian phylogenetics; model averaging; model selection; model uncertainty; posterior probability; reversible jump
Received January 11, 2005; Revised May 3, 2005; Accepted August 8, 2005
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  A. Dornburg, F. Santini, and M. E. Alfaro The Influence of Model Averaging on Clade Posteriors: An Example Using the Triggerfishes (Family Balistidae) Syst Biol, December 1, 2008; 57(6): 905 - 919. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. Ripplinger and J. Sullivan Does Choice in Model Selection Affect Maximum Likelihood Analysis? Syst Biol, February 1, 2008; 57(1): 76 - 85. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
N. Rodrigue, H. Philippe, and N. Lartillot Exploring Fast Computational Strategies for Probabilistic Phylogenetic Analysis Syst Biol, October 1, 2007; 56(5): 711 - 726. [Abstract] [Full Text] [PDF]
|
|