Skip to main content

[]

Intended for healthcare professionals
Skip to main content
Restricted access
Other
First published online September 14, 2017

Fixed or Random? A Resolution Through Model Averaging: Reply to Carlsson, Schimmack, Williams, and Bürkner (2017)

Benjamin Scheibehenne [email protected], Quentin F. Gronau, […], Tahira Jamil, and Eric-Jan Wagenmakers+1View all authors and affiliations
Volume 28, Issue 11
https://doi.org/10.1177/0956797617724426
First page of PDF

Get full access to this article

View all access and purchase options for this article.

Get Access

Open practices

  • Open Data
  • Open Materials
All data and materials have been made publicly available via the Open Science Framework and can be accessed at https://osf.io/hjt65/. The complete Open Practices Disclosure for this article can be found at Supplementary Material. This article has received the badges for Open Data and Open Materials. More information about the Open Practices badges can be found at http://www.psychologicalscience.org/publications/badges.

References

Albert J., Chib S. (1997). Bayesian tests and model diagnostics in conditionally independent hierarchical models. Journal of the American Statistical Association, 92, 916–925.
Crossref
Web of Science
Google Scholar
Arah O. A. (2008). The role of causal reasoning in understanding Simpson’s paradox, Lord’s paradox, and the suppression effect: Covariate selection in the analysis of observational studies. Emerging Themes in Epidemiology, 5, Article 5.
Crossref
PubMed
Google Scholar
Borenstein M., Hedges L. V., Higgins J. P. T., Rothstein H. R. (2010). A basic introduction to fixed-effect and random-effects models for meta-analysis. Research Synthesis Methods, 1, 97–111.
Crossref
PubMed
Web of Science
Google Scholar
Carlsson R., Schimmack U., Williams D. R., Bürkner P.-C. (2017). Bayes factors from pooled data are no substitute for Bayesian meta-analysis: Commentary on Scheibehenne, Jamil, and Wagenmakers (2016). Psychological Science, 28, 1694–1697.
Crossref
PubMed
Web of Science
Google Scholar
Fragoso T. M., Neto F. L. (2015). Bayesian model averaging: A systematic review and conceptual classification. Cornell University Library arXiv.org. Retrieved from https://arxiv.org/abs/1509.08864
Google Scholar
Gronau Q. F., van Erp S., Heck D. W., Cesario J., Jonas K., Wagenmakers E.-J. (2017). A Bayesian model-averaged meta-analysis of the power pose effect with informed and default priors: The case of felt power. Comprehensive Results in Social Psychology, 2, 123–138.
Crossref
Google Scholar
Grünwald P. D., Myung I. J., Pitt M. A. (2005). Advances in minimum description length: Theory and applications. Cambridge, MA: MIT Press.
Crossref
Google Scholar
Hoeting J. A., Madigan D., Raftery A. E., Volinsky C. T. (1999). Bayesian model averaging: A tutorial. Statistical Science, 14, 382–417.
Crossref
Web of Science
Google Scholar
Jeffreys H. (1961). Theory of probability (3rd ed.). Oxford, England: Oxford University Press.
Google Scholar
Meng X.-L., Wong W. H. (1996). Simulating ratios of normalizing constants via a simple identity: A theoretical exploration. Statistica Sinica, 6, 831–860.
Web of Science
Google Scholar
Moreno E., Vázquez-Polo F. J., Negrín M. A. (2017). Bayesian meta-analysis: The role of the between-sample heterogeneity. Statistical Methods in Medical Research. Advance online publication.
Crossref
PubMed
Web of Science
Google Scholar
Myung I. J. (2000). The importance of complexity in model selection. Journal of Mathematical Psychology, 44, 190–204.
Crossref
PubMed
Web of Science
Google Scholar
Pearl J. (2009). Causality: Models, reasoning, and inference (2nd ed.). Cambridge, England: Cambridge University Press.
Crossref
Google Scholar
Pearl J. (2014). Comment: Understanding Simpson’s paradox. The American Statistician, 68, 8–13.
Crossref
Web of Science
Google Scholar
Rice K., Higgins J. P. T., Lumley T. (2017). A re-evaluation of fixed effect(s) meta-analysis. Journal of the Royal Statistical Society A: Statistics in Society. Advance online publication.
Crossref
PubMed
Web of Science
Google Scholar
Scheibehenne B., Jamil T., Wagenmakers E.-J. (2016). Bayesian evidence synthesis can reconcile seemingly inconsistent results: The case of hotel towel reuse. Psychological Science, 27, 1043–1046.
Crossref
PubMed
Web of Science
Google Scholar
Silberzahn R., Uhlmann E. L. (2015). Crowdsourced research: Many hands make tight work. Nature, 526, 189–191.
Crossref
PubMed
Web of Science
Google Scholar
Sutton A. J., Abrams K. R. (2001). Bayesian methods in meta-analysis and evidence synthesis. Statistical Methods in Medical Research, 10, 277–303.
Crossref
PubMed
Web of Science
Google Scholar

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

Cite article

Cite article

Cite article

OR

Download to reference manager

If you have citation software installed, you can download article citation data to the citation manager of your choice

Share options

Share

Share this article

Share with email
Email Article Link
Share on social media

Share access to this article

Sharing links are not relevant where the article is open access and not available if you do not have a subscription.

For more information view the Sage Journals article sharing page.

Information, rights and permissions

Information

Published In

Volume 28, Issue 11
Pages: 1698 - 1701
Article first published online: September 14, 2017
Issue published: November 2017

Rights and permissions

© The Author(s) 2017.
Request permissions for this article.

Open practices

  • Open Data
  • Open Materials
PubMed: 28910199

Authors

Affiliations

Benjamin Scheibehenne
Geneva School of Economics and Management, University of Geneva
[email protected]
View all articles by this author
Quentin F. Gronau
Department of Psychological Methods, University of Amsterdam
View all articles by this author
Tahira Jamil
Department of Psychological Methods, University of Amsterdam
View all articles by this author
Eric-Jan Wagenmakers
Department of Psychological Methods, University of Amsterdam
View all articles by this author

Notes

Benjamin Scheibehenne, University of Geneva, Geneva School of Economics and Management, 40 Boulevard du Pont d’Arve, CH-1211 Geneva, Switzerland E-mail: [email protected]
Author Contributions
All the authors contributed to the statistical analyses, the interpretation of the data, and the writing of the manuscript.

Metrics and citations

Metrics

Journals metrics

This article was published in Psychological Science.

View All Journal Metrics

Article usage*

Total views and downloads: 1018

*Article usage tracking started in December 2016

Altmetric

See the impact this article is making through the number of times it’s been read, and the Altmetric Score.
Learn more about the Altmetric Scores


Articles citing this one

Receive email alerts when this article is cited

Web of Science: 12 view articles Opens in new tab

Crossref: 12

  1. Improving Statistical Analysis in Team Science: The Case of a Bayesian Multiverse of Many Labs 4
    Go to citationCrossrefGoogle Scholar
  2. A tutorial on Bayesian model-averaged meta-analysis in JASP
    Go to citationCrossrefGoogle Scholar
  3. Bayesian model‐averaged meta‐analysis in medicine
    Go to citationCrossrefGoogle Scholar
  4. A Multisite Preregistered Paradigmatic Test of the Ego-Depletion Effect
    Go to citationCrossrefGoogle ScholarPub Med
  5. A Primer on Bayesian Model-Averaged Meta-Analysis
    Go to citationCrossrefGoogle Scholar
  6. Bayesian hypothesis testing and estimation under the marginalized random-effects meta-analysis model
    Go to citationCrossrefGoogle Scholar
  7. Meta-Analysis with Few Studies and Binary Data: A Bayesian Model Averaging Approach
    Go to citationCrossrefGoogle Scholar
  8. A Conceptual Introduction to Bayesian Model Averaging
    Go to citationCrossrefGoogle Scholar
  9. Compensatory control and religious beliefs: a registered replication report across two countries
    Go to citationCrossrefGoogle Scholar
  10. A Bayesian nonlinear mixed-effects location scale model for learning
    Go to citationCrossrefGoogle Scholar
  11. View More

Figures and tables

Figures & Media

Tables

View Options

Access options

If you have access to journal content via a personal subscription, university, library, employer or society, select from the options below:

APS members can access this journal content using society membership credentials.

Membership Login

APS members can access this journal content using society membership credentials.

Membership Login

Alternatively, view purchase options below:

Purchase 24 hour online access to view and download content.

Subscribe to this journal

Access journal content via a DeepDyve subscription or find out more about this option.

Start 2 week free trial
Need help?

View options

PDF/EPUB

View PDF/EPUB

Full Text

View Full Text
View full text|Download PDF

Also from Sage