![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
It is a widely held belief that bilinguals have an advantage over monolinguals in executive-control tasks, but is this what all studies actually demonstrate? The idea of a bilingual advantage may result from a publication bias favoring studies with positive results over studies with null or negative effects. To test this hypothesis, we looked at conference abstracts from 1999 to 2012 on the topic of bilingualism and executive control. We then determined which of the studies they reported were subsequently published. Studies with results fully supporting the bilingual-advantage theory were most likely to be published, followed by studies with mixed results. Studies challenging the bilingual advantage were published the least. This discrepancy was not due to differences in sample size, tests used, or statistical power. A test for funnel-plot asymmetry provided further evidence for the existence of a publication bias.
Keywords bilingualism, executive functions, inhibition, publication bias
References
Section:
| Adesope, O. O., Lavin, T., Thompson, T., Ungerleider, C. (2010). A systematic review and meta-analysis of the cognitive correlates of bilingualism. Review of Educational Research, 80, 207–245. Google Scholar, SAGE Journals, ISI | |
| Barendregt, J. J. (2014). MetaXL (Version 2.0) [Computer software]. Retrieved from http://www.epigear.com/index_files/metaxl.html Google Scholar | |
| Bhattacharjee, Y. (2012, March 17). Why bilinguals are smarter. The New York Times. Retrieved from http://www.nytimes.com/2012/03/18/opinion/sunday/the-benefits-of-bilingualism.html Google Scholar | |
| Bialystok, E., Barac, R. (2013). Cognitive effects. In Grosjean, F., Li, P. (Eds.), The psycholinguistics of bilingualism (pp. 192–213). Chichester, England: Wiley-Blackwell. Google Scholar | |
| Bialystok, E., Craik, F. I., Klein, R., Viswanathan, M. (2004). Bilingualism, aging, and cognitive control: Evidence from the Simon task. Psychology and Aging, 19, 290–303. Google Scholar, Crossref, Medline, ISI | |
| Bialystok, E., Craik, F., Luk, G. (2008). Cognitive control and lexical access in younger and older bilinguals. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, 859–873. Google Scholar, Crossref, Medline, ISI | |
| Bialystok, E., Martin, M. M. (2004). Attention and inhibition in bilingual children: Evidence from the dimensional change card sort task. Developmental Science, 7, 325–339. Google Scholar, Crossref, Medline, ISI | |
| Bobb, S., Wodniecka, Z., Kroll, J. (Eds.). (2013). What bilinguals tell us about cognitive control [Special issue]. Journal of Cognitive Psychology, 25(5). Google Scholar, Crossref | |
| Chambers, C. D. (2013). Registered Reports: A new publishing initiative at Cortex. Cortex, 49, 609–610. Google Scholar, Crossref, Medline, ISI | |
| Costa, A., Hernández, M., Costa-Faidella, J., Sebastián-Gallés, N. (2009). On the bilingual advantage in conflict processing: Now you see it, now you don’t. Cognition, 113, 135–149. Google Scholar, Crossref, Medline, ISI | |
| Costa, A., Hernández, M., Sebastián-Gallés, N. (2008). Bilingualism aids conflict resolution: Evidence from the ANT task. Cognition, 106, 59–86. Google Scholar, Crossref, Medline, ISI | |
| Cumming, G. (2014). The new statistics: Why and how. Psychological Science, 25, 7–29. doi:10.1177/0956797613504966 Google Scholar, SAGE Journals, ISI | |
| Easterbrook, P. J., Gopalan, R., Berlin, J. A., Matthews, D. R. (1991). Publication bias in clinical research. The Lancet, 337, 867–872. Google Scholar, Crossref, Medline, ISI | |
| Fanelli, D. (2010). “Positive” results increase down the hierarchy of the sciences. PLoS ONE, 5(4), Article e10068. Retrieved from http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0010068 Google Scholar | |
| Faul, F., Erdfelder, E., Lang, A.-G., Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39, 175–191. Google Scholar, Crossref, Medline, ISI | |
| Ferguson, C. J., Heene, M. (2012). A vast graveyard of undead theories: Publication bias and psychological science’s aversion to the null. Perspectives on Psychological Science, 7, 555–561. Google Scholar, SAGE Journals, ISI | |
| Fox, K. (2011, June 11). Ellen Bialystok: Bilingual brains are more healthy. The Guardian. Retrieved from http://www.theguardian.com/technology/2011/jun/12/ellen-bialystok-bilingual-brains-more-healthy Google Scholar | |
| Francis, G. (2012). Too good to be true: Publication bias in two prominent studies from experimental psychology. Psychonomic Bulletin & Review, 19, 151–156. Google Scholar, Crossref, Medline, ISI | |
| Gathercole, V. C., Thomas, E. M., Kennedy, I., Prys, C., Young, N., Viñas Guasch, N., . . . Jones, L. (2014). Does language dominance affect cognitive performance in bilinguals? Lifespan evidence from preschoolers through older adults on card sorting, Simon, and metalinguistic tasks. Frontiers in Psychology, 5(11). Retrieved from http://journal.frontiersin.org/Journal/10.3389/fpsyg.2014.00011/full Google Scholar | |
| Gold, B. T., Kim, C., Johnson, N. F., Kryscio, R. J., Smith, C. D. (2013). Lifelong bilingualism maintains neural efficiency for cognitive control in aging. The Journal of Neuroscience, 33, 387–396. Google Scholar, Crossref, Medline, ISI | |
| Hilchey, M. D., Klein, R. M. (2011). Are there bilingual advantages on nonlinguistic interference tasks? Implications for the plasticity of executive control processes. Psychonomic Bulletin & Review, 18, 625–658. Google Scholar, Crossref, Medline, ISI | |
| John, L. K., Loewenstein, G., Prelec, D. (2012). Measuring the prevalence of questionable research practices with incentives for truth telling. Psychological Science, 23, 524–532. Google Scholar, SAGE Journals, ISI | |
| Kroll, J. F., Bialystok, E. (2013). Understanding the consequences of bilingualism for language processing and cognition. Journal of Cognitive Psychology, 25, 497–514. Google Scholar, Crossref, ISI | |
| Kroll, J. F., Christoffels, I., Bajo, T. (Eds.). (2013). Bilingualism and cognitive control. Lausanne, Switzerland: Frontiers Media SA. Retrieved from http://flashbook.frontiersin.org//clients/Frontiers/Bilingualism%20and%20cognitive%20control/EBook.html Google Scholar | |
| Lehrer, J. (2010, December 13). The truth wears off. The New Yorker. Retrieved from http://www.newyorker.com/reporting/2010/12/13/101213fa_fact_lehrer?currentPage=all Google Scholar | |
| Luk, G., Anderson, J., Bialystok, E., Craik, F. I. M., Grady, C. (2009, October). Distinct neural correlates for cognitive control and motor inhibition in bilinguals. Poster presented at the annual meeting of the Society for Neuroscience, Chicago, IL. Google Scholar | |
| Luk, G., Anderson, J. A., Craik, F. I., Grady, C., Bialystok, E. (2010). Distinct neural correlates for two types of inhibition in bilinguals: Response inhibition versus interference suppression. Brain and Cognition, 74, 347–357. Google Scholar, Crossref, Medline, ISI | |
| Mahoney, M. J. (1977). Publication prejudices: An experimental study of confirmatory bias in the peer review system. Cognitive Therapy and Research, 1, 161–175. Google Scholar, Crossref | |
| Paap, K. R. (2014). The role of componential analysis, categorical hypothesising, replicability and confirmation bias in testing for bilingual advantages in executive functioning. Journal of Cognitive Psychology, 26, 242–255. doi:10.1080/20445911.2014.891597 Google Scholar, Crossref, ISI | |
| Paap, K. R., Greenberg, Z. I. (2013). There is no coherent evidence for a bilingual advantage in executive processing. Cognitive Psychology, 66, 232–258. Google Scholar, Crossref, Medline, ISI | |
| Paap, K. R., Greenberg, Z., Guerrero, D., Mejia, B. (2010, November). I left my bilingual advantage in San Francisco. Poster presented at the annual meeting of the Psychonomic Society, St. Louis, MO. Google Scholar | |
| Paap, K. R., Greenberg, Z. I., Liu, Y. (2012, November). Bilinguals show no enhanced executive control for linguistic processing involving conflict. Poster presented at the annual meeting of the Psychonomic Society, Minneapolis, MN. Google Scholar | |
| Paap, K. R., Liu, Y. (2014). Conflict resolution in sentence processing is the same for bilinguals and monolinguals: The role of confirmation bias in testing for bilingual advantages. Journal of Neurolinguistics, 27, 50–74. Google Scholar, Crossref, ISI | |
| Pashler, H., Harris, C. R. (2012). Is the replicability crisis overblown? Three arguments examined. Perspectives on Psychological Science, 7, 531–536. Google Scholar, SAGE Journals, ISI | |
| Prior, A., MacWhinney, B. (2010). A bilingual advantage in task switching. Bilingualism: Language and Cognition, 13, 253–262. Google Scholar, Crossref, ISI | |
| Salvatierra, J. L., Rosselli, M. (2011). The effect of bilingualism and age on inhibitory control. International Journal of Bilingualism, 15, 26–37. Google Scholar, SAGE Journals, ISI | |
| Schooler, J. (2011). Unpublished results hide the decline effect. Nature, 470, 437. Google Scholar | |
| Spellman, B. A. (2012). Introduction to the special section: Data, data, everywhere . . . especially in my file drawer. Perspectives on Psychological Science, 7, 58–59. Google Scholar, SAGE Journals, ISI | |
| Sterne, J. A. C., Becker, B. J., Egger, M. (2005). The funnel plot. In Rothstein, H., Sutton, A., Borenstein, M. (Eds.), Publication bias in meta-analysis: Prevention, assessment, and adjustments (pp. 75–98). West Sussex, England: John Wiley & Sons. Google Scholar, Crossref | |
| Treccani, B., Argyri, E., Sorace, A., Della Sala, S. (2009). Spatial negative priming in bilingualism. Psychonomic Bulletin & Review, 16, 320–327. Google Scholar, Crossref, Medline, ISI | |
| Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1–48. Google Scholar, Crossref, ISI |
