Statistical Evidence in Experimental Psychology: An Empirical Comparison Using 855 t Tests
Abstract
Statistical inference in psychology has traditionally relied heavily on p-value significance testing. This approach to drawing conclusions from data, however, has been widely criticized, and two types of remedies have been advocated. The first proposal is to supplement p values with complementary measures of evidence, such as effect sizes. The second is to replace inference with Bayesian measures of evidence, such as the Bayes factor. The authors provide a practical comparison of p values, effect sizes, and default Bayes factors as measures of statistical evidence, using 855 recently published t tests in psychology. The comparison yields two main results. First, although p values and default Bayes factors almost always agree about what hypothesis is better supported by the data, the measures often disagree about the strength of this support; for 70% of the data sets for which the p value falls between .01 and .05, the default Bayes factor indicates that the evidence is only anecdotal. Second, effect sizes can provide additional evidence to p values and default Bayes factors. The authors conclude that the Bayesian approach is comparatively prudent, preventing researchers from overestimating the evidence in favor of an effect.
Get full access to this article
View all access and purchase options for this article.
References
American Psychological Association. (2010). Publication manual of the American Psychological Association (6th ed.). Washington, DC: Author.
Bem D.J. (2011). Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect. Journal of Personality and Social Psychology, 100, 407–425.
Berger J.O., Delampady M. (1987). Testing precise hypotheses. Statistical Science, 2, 317–352.
Berger J.O., Sellke T. (1987). Testing a point null hypothesis: The irreconcilability of p values and evidence. Journal of the American Statistical Association, 82, 112–139.
Berger J.O., Wolpert R.L. (1988). The likelihood principle (2nd ed.). Hayward, CA: Institute of Mathematical Statistics.
Cohen J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum.
Cohen J. (1994). The earth is round (p < .05). American Psychologist, 49, 997–1003.
Cortina J.M., Dunlap W.P. (1997). On the logic and purpose of significance testing. Psychological Methods, 2, 161–172.
Cumming G. (2008). Replication and p intervals: p values predict the future only vaguely, but confidence intervals do much better. Perspectives on Psychological Science, 3, 286–300.
Dennis S., Lee M., Kinnell A. (2008). Bayesian analysis of recognition memory: The case of the list-length effect. Journal of Memory and Language, 59, 361–376.
Dienes Z. (2008). Understanding psychology as a science: An introduction to scientific and statistical inference. New York: Palgrave Macmillan.
Dienes Z. (2011). Bayesian versus orthodox statistics: Which side are you on? Perspectives on Psychological Science, 6, 274–290.
Dixon P. (2003). The p-value fallacy and how to avoid it. Canadian Journal of Experimental Psychology, 57, 189–202.
Edwards W., Lindman H., Savage L.J. (1963). Bayesian statistical inference for psychological research. Psychological Review, 70, 193–242.
Erdfelder E. (2010). A note on statistical analysis. Experimental Psychology, 57, 1–4.
Fisher R.A. (1935). The design of experiments. Edinburgh: Oliver and Boyd.
Frick R.W. (1996). The appropriate use of null hypothesis testing. Psychological Methods, 1, 379–390.
Gallistel C. (2009). The importance of proving the null. Psychological Review, 116, 439–453.
Gelman A., Hill J. (2007). Data analysis using regression and multilevel/hierarchical models. Cambridge, England: Cambridge University Press.
Gigerenzer G. (1993). The Superego, the ego, and the id in statistical reasoning. In Keren G., Lewis C. (Eds.), A handbook for data analysis in the behavioral sciences: Methodological issues (pp. 311–339). Hillsdale, NJ: Erlbaum.
Gigerenzer G. (1998). We need statistical thinking, not statistical rituals. Behavioral and Brain Sciences, 21, 199–200.
Gönen M., Johnson W.O., Lu Y., Westfall P.H. (2005). The Bayesian two-sample t test. American Statistician, 59, 252–257.
Good I.J. (1983). Good thinking: The foundations of probability and its applications. Minneapolis: University of Minnesota Press.
Good I.J. (1985). Weight of evidence: A brief survey. In Bernardo J.M., DeGroot M.H., Lindley D.V., Smith A.F.M. (Eds.), Bayesian statistics 2 (pp. 249–269). New York: Elsevier.
Hagen R.L. (1997). In praise of the null hypothesis statistical test. American Psychologist, 52, 15–24.
Howard G., Maxwell S., Fleming K. (2000). The proof of the pudding: An illustration of the relative strengths of null hypothesis, meta-analysis, and Bayesian analysis. Psychological Methods, 5, 315–332.
Ioannidis J.P.A. (2005). Why most published research findings are false. PLoS Medicine, 2, 696–701.
Jaynes E.T. (2003). Probability theory: The logic of science. Cambridge, UK: Cambridge University Press.
Jeffreys H. (1961). Theory of probability. Oxford, UK: Oxford University Press.
Kass R.E., Raftery A.E. (1995). Bayes factors. Journal of the American Statistical Association, 90, 377–395.
Killeen P.R. (2005). An alternative to null-hypothesis significance tests. Psychological Science, 16, 345–353.
Killeen P.R. (2006). Beyond statistical inference: A decision theory for science. Psychonomic Bulletin & Review, 13, 549–562.
Kruschke J.K. (2010a). Bayesian data analysis. Wiley Interdisciplinary Reviews: Cognitive Science, 1, 658–676.
Kruschke J.K. (2010b). Doing Bayesian data analysis: A tutorial introduction with R and BUGS. Burlington, MA: Academic Press.
Kruschke J.K. (2010c). What to believe: Bayesian methods for data analysis. Trends in Cognitive Sciences, 14, 293–300.
Kruschke J.K. (2011). Bayesian assessment of null values via parameter estimation and model comparison. Perspectives on Psychological Science, 6, 299–312.
Lee M.D. (2008). Three case studies in the Bayesian analysis of cognitive models. Psychonomic Bulletin & Review, 15, 1–15.
Lee M.D. (in press). How cognitive modeling can benefit from hierarchical Bayesian models. Journal of Mathematical Psychology.
Lee M.D., Wagenmakers E.-J. (2005). Bayesian statistical inference in psychology: Comment on Trafimow (2003). Psychological Review, 112, 662–668.
Liang F., Paulo R., Molina G., Clyde M., Berger J. (2008). Mixtures of g priors for Bayesian variable selection. Journal of the American Statistical Association, 103, 410.
Lindley D.V. (1972). Bayesian statistics; a review. Philadelphia: Society for Industrial and Applied Mathematics.
Loftus G.R. (1996). Psychology will be a much better science when we change the way we analyze data. Current Directions in Psychological Science, 5, 161–171.
Lunn D.J., Thomas A., Best N., Spiegelhalter D. (2000). WinBUGS—a Bayesian modelling framework: Concepts, structure, and extensibility. Statistics and Computing, 10, 325–337.
Mussweiler T. (2006). Doing is for thinking! Psychological Science, 17, 17–21.
Myung I.J., Forster M.R., Browne M.W. (2000). A special issue on model selection. Journal of Mathematical Psychology, 44.
Nickerson R.S. (2000). Null hypothesis statistical testing: A review of an old and continuing controversy. Psychological Methods, 5, 241–301.
Pitt M.A., Myung I.J., Zhang S. (2002). Toward a method of selecting among computational models of cognition. Psychological Review, 109, 472–491.
Press S., Chib S., Clyde M., Woodworth G., Zaslavsky A. (2003). Subjective and objective Bayesian statistics: Principles, models, and applications. Hoboken, NJ: Wiley-Interscience.
Richard F.D., Bond C.F.J., Stokes-Zoota J.J. (2003). One hundred years of social psychology quantitatively described. Review of General Psychology, 7, 331–363.
Rosenthal R. (1990). How are we doing in soft psychology? American Psychologist, 45, 775–777.
Rosenthal R., Rubin D. (1982). A simple, general purpose display of magnitude of experimental effect. Journal of Educational Psychology, 74, 166–169.
Rouder J.N., Lu J. (2005). An introduction to Bayesian hierarchical models with an application in the theory of signal detection. Psychonomic Bulletin & Review, 12, 573–604.
Rouder J.N., Speckman P.L., Sun D., Morey R.D., Iverson G. (2009). Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin & Review, 16, 225–237.
Schmidt F.L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers. Psychological Methods, 1, 115–129.
Scott J., Berger J. (2006). An exploration of aspects of Bayesian multiple testing. Journal of Statistical Planning and Inference, 136, 2144–2162.
Thompson B. (2002). What future quantitative social science research could look like: Confidence intervals for effect sizes. Educational Researcher, 31, 25–32.
Wagenmakers E.-J. (2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review, 14, 779–804.
Wagenmakers E.-J., Grünwald P. (2006). A Bayesian perspective on hypothesis testing. Psychological Science, 17, 641–642.
Wagenmakers E.-J., Lodewyckx T., Kuriyal H., Grasman R. (2010). Bayesian hypothesis testing for psychologists: A tutorial on the Savage-Dickey method. Cognitive Psychology, 60, 158–189.
Wagenmakers E.-J., Wetzels R., Borsboom D., van der Maas H.L.J. (2011). Why psychologists must change the way they analyze their data: The case of psi: Comment on Bem (2011). Journal of Personality and Social Psychology, 100, 426–432.
Wainer H. (1999). One cheer for null hypothesis significance testing. Psychological Methods, 4, 212–213.
Wasserman L. (2004). All of statistics: A concise course in statistical inference. New York: Springer.
Wetzels R., Lee M., Wagenmakers E.-J. (2010). Bayesian inference using WBDev: A tutorial for social scientists. Behavior Research Methods, 42, 884–897.
Wetzels R., Raaijmakers J., Jakab E., Wagenmakers E.-J. (2009). How to quantify support for and against the null hypothesis: A flexible WinBUGS implementation of a default Bayesian t test. Psychonomic Bulletin & Review, 16, 752–760.
Wilkinson L. the Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594–604.
Cite article
Cite article
Cite article
OR
Download to reference manager
If you have citation software installed, you can download article citation data to the citation manager of your choice
Information, rights and permissions
Information
Published In
Article first published online: May 18, 2011
Issue published: May 2011
Keywords
PubMed: 26168519
Authors
Metrics and citations
Metrics
Journals metrics
This article was published in Perspectives on Psychological Science.
VIEW ALL JOURNAL METRICSArticle usage*
Total views and downloads: 5600
*Article usage tracking started in December 2016
Altmetric
See the impact this article is making through the number of times it’s been read, and the Altmetric Score.
Learn more about the Altmetric Scores
Articles citing this one
Receive email alerts when this article is cited
Web of Science: 595 view articles Opens in new tab
Crossref: 559
- Oscillatory and non-oscillatory features of the magnetoencephalic sens...
- Assessing mental demand in consecutive interpreting: Insights from an ...
- Identifying Links Between Latent Memory and Speech Recognition Factors
- Developing digital competencies of controllers: Evidence from the Neth...
- Ensemble coding of facial identity is robust, but may not contribute t...
- The orthographic/phonological neighbourhood size effect and set size
- The Post Office Scandal in the United Kingdom: Mental health and socia...
- Causal learning with delays up to 21 hours
- Does Ipsilateral Remapping Following Hand Loss Impact Motor Control of...
- Dorsomedial frontal cortex damage impairs error-based, but not reinfor...
- Regulation of craving training to support healthy food choices under s...
- Bilingualism, like other types of brain training, does not produce far...
- Give me enough time to rehearse: presentation rate modulates the produ...
- A Case Study of the Validity of Web-based Visuomotor Rotation Experime...
- Behavioral and psychiatric correlates of brain responses to social fee...
- Attentional blur and blink: Effects of adaptive attentional scaling on...
- Limitations on flexible allocation of visual short-term memory resourc...
- Dopamine Increases Accuracy and Lengthens Deliberation Time in Explici...
- Belief bias, conflict detection, and logical complexity
- Should we stop referring to the pandemic of antimicrobial resistance a...
- Valence and concreteness in item recognition: Evidence against the aff...
- Different neural mechanisms for nonsalient trained stimuli and physica...
- Top-down effect of dialogue coherence on perceived speaker identity
- Agreement test of P value versus Bayes factor for sample means compari...
- No effect of hunger on attentional capture by food cues: Two replicati...
- Outcome Expectations in Psychotherapy: Validation of the Therapy Singl...
- Unexpected sounds inhibit the movement of the eyes during reading and ...
- baymedr: an R package and web application for the calculation of Bayes...
- Deception aversion, communal norm violation and consumer responses to ...
- More than visual-spatial skills: The important role of phonological aw...
- Interpretation of empirical results in intervention studies: a comment...
- A nervous wait: Instagram’s sensitive-content screens cause anticipato...
- Characterising the covariance pattern between lifestyle factors and st...
- Instant habits versus flexible tenacity: Do implementation intentions ...
- Psychometric curves reveal changes in bias, lapse rate, and guess rate...
- Insula Connectivity Abnormalities Predict Impulsivity in Chronic Heroi...
- “Leader–Follower” Dynamic Perturbation Manipulates Multi-Item Working ...
- The connection still matters: Therapeutic alliance with digital treatm...
- Multifractality in stride-to-stride variations reveals that walking in...
- A conceptual–perceptual distinctiveness processing account of the supe...
- Long-range and cross-frequency neural modulation of gamma flicker on v...
- Investigating the relationship between the Bayes factor and the separa...
- Binding time: Investigations on the integration of visual stimulus dur...
- Emotional Dysregulation, Shame and Guilt Predict Severity of Gambling ...
- Simple manipulations of anthropomorphism fail to induce perceptions of...
- Model selection with baryonic acoustic oscillations in the Lyman-α for...
- Vicarious touch: Overlapping neural patterns between seeing and feelin...
- Intact procedural memory and impaired auditory statistical learning in...
- Diseño y validación de un instrumento para conocer motivaciones y caus...
- Comparison of self-administered versus read-aloud questionnaires for p...
- Cognitive behavioral therapy (CBT) plus attention bias modification (A...
- Localization and Diagnostic Specificity of Glutamic Acid Decarboxylase...
- Enabling Human‐Aware Autonomy Through Cognitive Modeling and Feedback ...
- Object-based visual working memory: an object benefit for equidistant ...
- Conflict detection and base-rate extremity
- Who is Flexible and Adaptive in Everyday Life?
- Distinct dynamic behavioural response to social exclusion in male pati...
- Selective Hypothesis Reporting in Psychology: Comparing Preregistratio...
- Cognitive load at encoding hurts memory selectivity
- Similar somatotopy for active and passive digit representation in prim...
- Dynamics of Social Experiences in the Context of Extended Lockdown
- Expanding risk predictions of pesticide resistance evolution in arthro...
- Can the Brain Strategically Go on Automatic Pilot? The Effect of If–Th...
- Emotional stimuli similarly disrupt attention in both visual fields
- What makes background music distracting? Investigating the role of son...
- Eye movements disrupt EEG alpha-band coding of behaviorally relevant a...
- The influence of vestibular system and fetal presentation on handednes...
- No training effects of top-down controlled response inhibition by prac...
- Assessing cognitive changes in multiple sclerosis: criteria for a reli...
- Preregistration and Registered Reports in Sociology: Strengths, Weakne...
- Longitudinal stability and change in time–frequency measures from an o...
- A meeting of positive behaviors: The relations of three aspects of fle...
- Task priority reduces an adverse effect of task load on automation tru...
- Big little lies: a compendium and simulation of p ...
- Chloride-dependent mechanisms of multimodal sensory discrimination and...
- A gaze-contingent saccadic re-referencing training with simulated cent...
- Blue-blocking filters do not alleviate signs and symptoms of digital e...
- How to Change Negative Outcome Expectations in Psychotherapy? The Role...
- Stride-to-stride time intervals are independently affected by the temp...
- Bayesian Alternatives
- Complex pattern of facial remapping in somatosensory cortex following ...
- Likelihoodism and Guidance for Belief
- A New Bayesian Two-Sample t Test and Solution to the Behrens–Fisher Pr...
- Blinded by and Stuck in Negative Emotions: Is Psychological Inflexibil...
- A comparison of ‘pruning’ during multi-step planning in depressed and ...
- Altered predictive control during memory suppression in PTSD
- The time-course of feature-based attention effects dissociated from te...
- The role of personality traits and leisure activities in predicting we...
- Statistical feature training improves fingerprint-matching accuracy in...
- Efficiency in sequential testing: Comparing the sequential probability...
- Slowed reaction times in cognitive fatigue are not attributable to dec...
- The evidence interval and the Bayesian evidence value: On a unified th...
- Word prediction using closely and moderately related verbs in Down syn...
- Do medium and Context Matter when learning from multiple complementary...
- On the Effect of Bilateral Eye Movements on Memory Retrieval in Ageing...
- The effect of proportion manipulation on the size-congruency and dista...
- Expert agreement in prior elicitation and its effects on Bayesian infe...
- Predicting visual memory across images and within individuals
- Measuring the Efficiency of Automation-Aided Performance in a Simulate...
- Gamification of cognitive bias modification for interpretations in anx...
- The nature of neural object representations during dynamic occlusion
- Conflict-based speech error monitoring in bilinguals: Differences betw...
- Unique contributions of perceptual and conceptual humanness to object ...
- A longitudinal study of boys’ and girls’ injury-risk behaviors and par...
- Reproducibility in the Social Sciences
- An open-access accelerated adult equivalent of the ABCD Study neuroima...
- Interactions among endogenous, exogenous, and agency-driven attentiona...
- Perception Over Personality in Lethal Force: Aggression, Impulsivity, ...
- Primacy biases endure the addition of frequency variability
- Motor Imagery Combined With Physical Training Improves Response Inhibi...
- Sex Differences in the Relation Between Supervision and Injury Risk Ac...
- Video Game Play Does Not Improve Spatial Skills When Controlling for S...
- The influence of pupil responses on subjective brightness perception
- Multiverse analyses in fear conditioning research
- Match me if you can: Evidence for a domain-general visual comparison a...
- Do People Actually “Listen to the Experts”? A Cautionary Note on Assum...
- Determining an Evidence Base for Particular Fields of Educational Prac...
- Malleability of the cortical hand map following a finger nerve block
- Perception of semantic relations in scenes: A registered report study ...
- The Assessment of Chinese Children’s English Vocabulary—A Culturally A...
- B ‐value and empirical equivalence bound: A new procedur...
- Linking the Brain with Behavior: The Neural Dynamics of Success and Fa...
- Beyond p < .05: a critical review of new B...
- Magic Hats and Teddy Bear picnics: Language and visuospatial lateralis...
- Right fronto-parietal networks mediate the neurocognitive benefits of ...
- The exploration–exploitation dilemma in pain: an experimental investig...
- A Randomized Controlled Trial on the Effects of a 12-Week High- vs. Lo...
- Second Chances in Learning: Does a Resit Prospect Lower Study-Time Inv...
- Controversies Regarding Null Hypothesis Significance Testing
- Evaluating the Strength of Evidence in Favor of Rehabilitation Effects...
- Bayes factor benefits for clinical psychology: review of child and ado...
- Tainted Nudge
- Perceived physical activity during stay-at-home COVID-19 pandemic lock...
- Microstructural white matter abnormalities in Lesch–Nyhan disease
- The technology acceptance scale: Its Bayesian psychometrics assessed i...
- Dorsal visual stream activity during coherent motion processing is not...
- Bayes factor benefits for clinical psychology: review of child and ado...
- Exploring the Effects of Perceptual Separability on Human-Automation T...
- More green than gray? Toward a sustainable overview of environmental s...
- Learning a reach trajectory based on binary reward feedback
- Evidence toward the potential absence of relationship between temporal...
- Bayesian Hodges-Lehmann tests for statistical equivalence in the two-s...
- Lack of drug-induced post-retrieval amnesia for auditory fear memories...
- P value and Bayesian analysis in randomized-controlled trials in child...
- Testing an online measure of portion size selection: a pilot study con...
- Does task-irrelevant music affect gaze allocation during real-world sc...
- No relation of Need for Cognition to basic executive functions
- Learning and recognizing facial identity in variable images: New insig...
- The Impact of Parenting Style on Attitudes toward Masturbation: A Late...
- Assessing optimal colour and illumination to facilitate reading: an an...
- Functional neuroanatomy of arithmetic in monolingual and bilingual adu...
- Type I and II error rates of Bayesian two-sample tests under prelimina...
- The influence of ethnicity and other socio-demographic characteristics...
- Sleep and incubation: using problem reactivation during sleep to study...
- The temporal pattern and the probability distribution of visual cueing...
- Right-left asymmetry in corticospinal tract microstructure and dexteri...
- Processing Verb Meanings and the Declarative/Procedural Model: A Devel...
- Effects of Non-First-Person Self-Talk on Self-Regulation:
- Může Bayesův faktor nahradit P hodnotu?
- Revisiting human-machine trust: a replication study of Muir and Moray ...
- Strategy Use in Automation-Aided Decision Making
- No Evidence for Expectation Effects in Cognitive Training Tasks
- Event-related brain potentials reveal strategy selection in younger an...
- Using space to remember: Short-term spatial structure spontaneously im...
- Ability and non-ability traits in chess skill
- The missing N1 or jittered P2: Electrophysiological correlates of patt...
- Research Design in Clinical Psychology
- How Task Set and Task Switching Modulate Perceptual Processes: Is Reco...
- Cortical Auditory Processing of Simple Stimuli Is Altered in Autism: A...
- Learning to code and the acquisition of computational thinking by youn...
- Developing human-machine trust: Impacts of prior instruction and autom...
- Validation of the International Reading Speed Texts in a Sample of Old...
- Acoustic stimulation increases implicit adaptation in sensorimotor ada...
- Effect of information on reducing inappropriate expectations and reque...
- Disruptions of Sustained Spatial Attention Can Be Resistant to the Dis...
- Null effects of levodopa on reward- and error-based motor adaptation, ...
- Daily and intermittent smoking are associated with low prefrontal volu...
- Sequential Bayes Factor designs in developmental research: Studies on ...
- Analysis of type I and II error rates of Bayesian and frequentist para...
- Identification of a neural basis for cold acclimation in Drosophila la...
- Effect of Lowering V t on Mortality in Acu...
- Task-Irrelevant Context Learned Under Rapid Display Presentation: Sele...
- The effect of navigation method and visual display on distance percept...
- The cognitive and perceptual correlates of ideological attitudes: a da...
- Coordination effort in joint action is reflected in pupil size
- How Reliably Do Eye Parameters Indicate Internal Versus External Atten...
- Investigating Arousal, Saccade Preparation, and Global Luminance Effec...
- Importance of domain-specific metacognition for explaining beliefs abo...
- Transcutaneous vagus nerve stimulation via tragus or cymba conchae: Ar...
- Variability of Bayes Factor estimates in Bayesian Analysis of Variance
- Assessing optimal colour and illumination to facilitate reading
- Effects of think‐aloud on students' ...
- Using Day and Night – Scheduling Retrieval Practice and Sleep
- Coronavirus Disease 2019: Exploring Media Portrayals of Public Sentime...
- Levels of Processing Affect Perceptual Features in Visual Associative ...
- The Role of Perceived Energy and Self-Beliefs for Physical Activity an...
- Ironic efficiency in automation-aided signal detection
- Age-related differences in adults’ ability to follow spoken instructio...
- Right Hemisphere Memory Bias Does Not Extend to Involuntary Memories f...
- Heart Rate, Heart Rate Variability and Subjective Workload of Commerci...
- Variability in subthalamic nucleus targeting for deep brain stimulatio...
- Inhibitory effect of positional syllable frequency in Spanish 2nd and ...
- The effect of need-supporting behaviors combined with regulatory focus...
- The psychological and socio-political consequences of infectious disea...
- Contextual Cueing Effect Under Rapid Presentation
- It matters how to recall – task differences in retrieval practice
- Effects of nicotine on pupil size and performance during multiple-obje...
- Instability Resistance Training improves Working Memory, Processing Sp...
- Intact corticostriatal control of goal-directed action in Alcohol Use ...
- Behavioral and EEG Measures Show no Amplifying Effects of Shared Atten...
- Task-based memory systems in contextual-cueing of visual search and ex...
- Analysis of Bayesian posterior significance and effect size indices fo...
- Statistical significance: p value, 0.05 threshold, and applications to...
- The multi-faceted nature of visual statistical learning: Individual di...
- 3 versus 7 Tesla magnetic resonance imaging for parcellations of subco...
- Identification of a Novel Retrieval-dependent Memory Process in the Cr...
- There is Nothing Magical about Bayesian Statistics: An Introduction to...
- The effects of bilingualism on executive functions: an updated quantit...
- Unconscious perception of one's own name modulates amplitude of the P3...
- Sensory stimulation enhances phantom limb perception and movement deco...
- Replicability in psychological research: a reflection
- Right Lateralized Brain Reserve Offsets Age-Related Deficits in Ignori...
- Reanalysis Suggests Evidence for Motor Simulation in Naming Tools Is L...
- TechCheck: Development and Validation of an Unplugged Assessment of Co...
- Preventing the return of fear in humans using reconsolidation update m...
- How is intuitive eating related to self-reported and laboratory food i...
- How much do college students with ADHD benefit from retrieval practice...
- Structural connections support emotional connections: Uncinate Fascicu...
- Recommendations in pre-registrations and internal review board proposa...
- Detecting test fraud using Bayes factors
- Bayes factor: A useful tool to quantitatively evaluate and compare per...
- Validation of the International Reading Speed Texts in a Canadian Samp...
- Pain modulation by illusory body rotation: A new way to disclose the i...
- Spatial frequency tuning of motor responses reveals differential contr...
- Is an artificial limb embodied as a hand? Brain decoding in prosthetic...
- Recycling in Babel: The Impact of Foreign Languages in Rule Learning
- Examining the Role of Familiarity in the Perception of Depth
- Transcutaneous Vagus Nerve Stimulation May Enhance Only Specific Aspec...
- Using the landmark task to test the underlying assumptions of unilater...
- Adaptive event integration in the missing element task
- Interactions between givenness and clause order in children’s processi...
- The persisting influence of unattended auditory information: Negative ...
- Informed Bayesian t -Tests
- Raised visual contrast thresholds with intact attention and metacognit...
- Do Nurses Use Discourse Markers Differently when Using Their Second La...
- Effects of Blood Flow Restriction at Different Intensities on IOP and ...
- Children with Attention-deficit/Hyperactivity Disorder Show an Altered...
- A dilution effect without dilution: When missing evidence, not non-dia...
- Resilience after trauma: The role of memory suppression
- Adaptation to the Speed of Biological Motion in Autism
- Best uses of p -values and complementary m...
- Statistics for HCI
- Reduction of spontaneous cortical beta bursts in Parkinson’s disease i...
- A Bayesian Analysis of Evidence in Support of the Null Hypothesis in G...
- The Effects of a TMS Double Perturbation to a Cortical Network
- Does Prevention-Focused Orientation Affect Poor Creative Performance?
- Flash floods versus river floods – a comparison of psychological impac...
- Influences of complexity on decision making in young and older adults
- The Role of Deception in Stimulating Negative Evaluations of Win-Win C...
- Effect Declines Are Systematic, Strong, and Ubiquitous: A Meta-Meta-An...
- An Analysis of Nonsignificant Results in Audiology Using Bayes Factors
- An Introduction to Calculating Bayes Factors in JASP for Speech, Langu...
- Exploring Bayesian analyses of a small-sample-size factorial design in...
- On the priming of risk preferences: The role of fear and general affec...
- Limited replicability of drug-induced amnesia after contextual fear me...
- Attenuated beta rebound to proprioceptive afferent feedback in Parkins...
- What Determines Visual Statistical Learning Performance? Insights From...
- Untangling featural and conceptual object representations
- Can you have multiple attentional templates? Large-scale replications ...
- Detection of brake lights while distracted: Separating peripheral visi...
- The contribution of spatial position and rotated global configuration ...
- Endogenous pain modulation assessed with offset analgesia is not impai...
- Exposing an “Intangible” Cognitive Skill Among Collegiate Football Pla...
- On the sensitivity of event-related potentials to retrieval mode
- Illusory contour perception in domestic dogs
- Bayes factor in one-sample tests of means with a sensitivity analysis:...
- Reducing the Emotionality of Auditory Hallucination Memories in Patien...
- Tests improve memory – no matter if you feel good or bad while taking ...
- Does it hurt to ask? An analysis of iatrogenic risk during suicide ris...
- Visual Perceptual Skills in Attention-deficit/Hyperactivity Disorder C...
- Cortico-basal white matter alterations occurring in Parkinson’s diseas...
- Putting a stereotype to the test: The case of gender differences in mu...
- Language Without Speech: Segregating Distinct Circuits in the Human Br...
- Response repetitions in auditory task switching: The influence of spat...
- Phonological versus semantic prediction in focus and repair constructi...
- Development of synaesthetic consistency: Repeated autonomous engagemen...
- The influence of image masking on object representations during rapid ...
- Gazing at facial features increases dissociation and decreases attract...
- Resting-state functional connectivity and cortical thickness character...
- Answers to 18 Questions About Open Science Practices
- Reaching for the stars: attention to multiple testing problems and met...
- Detecting Strategies in Developmental Psychology
- Effects of "Visual Schema Displacement Therapy" (VSDT), an abbreviated...
- In search of consciousness: Examining the temporal dynamics of conscio...
- Task‐dependent responses to muscle vibration during reaching
- The contributions of central and peripheral vision to scene-gist recog...
- Discrimination of Small Forms in a Deviant-Detection Paradigm by 10-mo...
- Investigating the Immediate and Cumulative Effects of Isometric Squat ...
- Unconscious versus conscious thought in creative science problem findi...
- Memory-based attentional biases survive spatial suppression driven by ...
- Large-scale intrinsic connectivity is consistent across varying task d...
- The nature of inhibition in a working memory search task
- Beyond p values: utilizing multiple methods to evaluate evidence
- Current PTSD symptomatology distorts memory for past symptoms
- A neural correlate for common trait dissociation: Decreased EEG connec...
- A signal-detection approach to individual differences in negative feel...
- A Proposed Hybrid Effect Size Plus p -Valu...
- The role of arousal in boundary judgement errors
- Cerebellar Transcranial Direct Current Stimulation (tDCS), Leaves Virt...
- No Effect of Cue Format on Automation Dependence in an Aided Signal De...
- The representational dynamics of visual objects in rapid serial visual...
- No Evidence That Experiencing Physical Warmth Promotes Interpersonal ...
- Instability Resistance Training Decreases Motor Noise During Challengi...
- The impact of bilingualism on executive functions and working memory i...
- Obtaining and maintaining cortical hand representation as evidenced fr...
- Enumeration and Alertness in Developmental Dyscalculia
- Biological Bases of Beauty Revisited: The Effect of Symmetry, Averagen...
- Substance use is associated with reduced devaluation sensitivity
- Insights into Criteria for Statistical Significance from Signal Detect...
- Comparing Objective and Subjective Bayes Factors for the Two-Sample Co...
- Pedal and haptic estimates of slant suggest a common underlying repres...
- Perceptual size discrimination requires awareness and late visual area...
- When and Why to Replicate: As Easy as 1, 2, 3?
- Do prevention-focused orientations conserve cognitive resources?
- Spatial Presentations, but Not Response Formats Influence Spatial-Nume...
- Assessing the Functional Role of Frontal Eye Fields in Voluntary and R...
- Healthy aging does not impair lower extremity motor flexibility while ...
- Can selective attention and inhibition (interactively) predict future ...
- Cultural effects on computational metrics of spatial and temporal cont...
- Bayesian alternatives for common null-hypothesis significance tests in...
- Hand proximity effects are fragile: a useful null result
- Egocentrism in the Volunteer’s Dilemma
- Reduced Motor Interference in Preschoolers with Autism Spectrum Disord...
- Selective map-following navigation deficit: A new case of developmenta...
- Violence-Related Traumatic Brain Injury in Justice-Involved Women
- Conscious awareness is required for the perceptual discrimination of t...
- Beyond time and space: The effect of a lateralized sustained attention...
- Leave everything to the imagination: Cognitive functioning of individu...
- Learned predictiveness acquired through experience prevails over the i...
- Bayesian Reanalyses From Summary Statistics: A Guide for Academic Cons...
- Effectiveness of the Apple iPad as a Spot-reading Magnifier
- The first direct replication on using verbal credibility assessment fo...
- Exposing an “Intangible” Cognitive Skill Among Collegiate Football Pla...
- Failure to exploit learned spatial value information during visual sea...
- Learning facts during aging: the benefits of curiosity
- Children's Strategy Choices on Complex Subtraction Problems: Individua...
- The Influence of Conscious and Unconscious Body Threat Expressions on ...
- Controlling the Resit Effect by Means of Investment Depreciation
- Intellectual Investment, Dopaminergic Gene Variation, and Life Events:...
- Do Bilingual Children Have an Executive Function Advantage? Results Fr...
- The effect of sadness on global-local processing
- The nature of shape constancy mechanisms as revealed by shape priming
- Effects of Task Difficulty and Display Format on Automation Usage Stra...
- Polarity-dependent Effects of Biparietal Transcranial Direct Current S...
- 贝叶斯因子及其在JASP中的实现
- Bayesian techniques for analyzing group differences in the Iowa Gambli...
- Can training change attentional breadth? Failure to find transfer effe...
- Explaining response-repetition effects in task switching: evidence fro...
- From cookies to carrots; the effect of inhibitory control training on ...
- Fact or fiction: reducing the proportion and impact of false positives
- Do metacognitive judgments alter memory performance beyond the benefit...
- Improving quit rates of web‐delivered interventions for smoking cessat...
- Hypothesis-Testing Demands Trustworthy Data—A Simulation Approach to I...
- Automatic Diagnosis of Students' Misconceptions in K-8 Mathematics
- Perceptual Discrimination of Basic Object Features Is Not Facilitated ...
- Using Bayesian Correspondence Criteria to Compare Results From a Rando...
- Transfer of learned category-response associations is modulated by ins...
- Patterns of altered neural synchrony in the default mode network in au...
- Conflict Detection and Logical Complexity
- Iconicity affects children’s comprehension of complex sentences: The r...
- What counts in preschool number knowledge? A Bayes factor analytic app...
- The Bayesian New Statistics: Hypothesis testing, estimation, meta-anal...
- Four reasons to prefer Bayesian analyses over significance testing
- Bayesian data analysis for newcomers
- How to become a Bayesian in eight easy steps: An annotated reading lis...
- Bayesian inference for psychology. Part II: Example applications with ...
- Bayesian inference for psychology. Part I: Theoretical advantages and ...
- Can Lineup Administrators Blind to the Suspect's Identity Influence Wi...
- Transient Signals and Inattentional Blindness in a Multi-object Tracki...
- The Infamous Relationship Between Violent Video Game Use and Aggressio...
- Contextual cueing of visual search is associated with greater subjecti...
- Testing Significance Testing
- Credible Confidence: A Pragmatic View on the Frequentist vs Bayesian D...
- BIG DATA IN CONSTRUCTION WASTE MANAGEMENT: PROSPECTS AND CHALLENGES
- Close interpersonal proximity modulates visuomotor processing of objec...
- Confidence in masked orientation judgments is informed by both evidenc...
- Directionality in Aesthetic Judgments and Performance Evaluation: Spor...
- Cognitive bias modification for facial interpretation: a randomized co...
- Differences in basic digital competences between male and female unive...
- Bayesian hypothesis testing for human threat conditioning research: an...
- Bayesian Hypothesis Testing: An Alternative to Null Hypothesis Signifi...
- Sample-Size Planning for More Accurate Statistical Power: A Method Adj...
- No Substantial Evidence for Sexual Transmission of Minority HIV Drug R...
- Cognitive control in media multitaskers: Two replication studies and a...
- From Discovery to Justification: Outline of an Ideal Research Program ...
- Using Bayes Factors to Test Hypotheses in Developmental Research
- Serial reconstruction of order and serial recall in verbal short-term ...
- Size Aftereffects Are Eliminated When Adaptor Stimuli Are Prevented fr...
- Benchmarking Aided Decision Making in a Signal Detection Task
- Collaborative Metacognition in a Signal Detection Task
- Gaze Linking in Visual Search: A Help or a Hindrance?
- The light-from-above prior is intact in autistic children
- Estimating the evidential value of significant results in psychologica...
- Thou Shalt Not Bear False Witness Against Null Hypothesis Significance...
- Performing Contrast Analysis in Factorial Designs: From NHST to Confid...
- Using the Bayes Factors to Evaluate Person Fit in the Item Response Th...
- Hemispheric organization in disorders of development
- Split-Second Trustworthiness Detection From Faces in an Economic ...
- How are age-related differences in sleep quality associated with healt...
- The Heuristic Value of p in Inductive Statistical Inference
- Reproducibility in Psychological Science: When Do Psychological Phenom...
- Three Insights from a Bayesian Interpretation of the One-Sided P Value
- Testing the controllability of contextual cuing of visual search
- Mice optimize timed decisions about probabilistic outcomes under deadl...
- Internet Filtering Technology and Aversive Online Experiences in Adole...
- Improving working memory performance in brain-injured patients using h...
- Researchers’ choice of the number and range of levels in experiments a...
- Local item density modulates adaptation of learned contextual cues
- Goal-Directed and Habit-Like Modulations of Stimulus Processing during...
- Olfactory Functions in Adults With Autism Spectrum Disorders
- Dual processes and moral conflict: Evidence for deontological reasoner...
- Effect of diet quality and ambient temperature on the use of torpor by...
- The Need for Bayesian Hypothesis Testing in Psychological Science
- Investigating Event Memory in Children with Autism Spectrum Disorder: ...
- How to withhold or replace a prepotent response: An analysis of the un...
- Independence of long-term contextual memory and short-term perceptual ...
- Replicability Crisis in Social Psychology: Looking at the Past to Find...
- An Appeal for a Methodological Fusion of Conversation Analysis and Exp...
- Does a Working Memory Load Really Influenc...
- The Effect of Object Distinctiveness on Object-Location Binding in Vis...
- Can regulatory fit improve performance? Effect of types of regulatory ...
- Regulatory Focus Moderates Process Feedback and Motivation
- On the Antecedents of an Electrophysiological Signature of Retrieval M...
- Toward evidence-based medical statistics: a Bayesian analysis of doubl...
- Bayesian change-point analysis reveals developmental change in a class...
- Increased productivity efforts yield few rewards in the knowledge econ...
- The effects of eye movements on emotional memories: using an objective...
- Transgenerational aspects of former Swiss child laborers: do second ge...
- Control of information in working memory: Encoding and removal of dist...
- Trauma-related versus positive involuntary thoughts with and without m...
- Four Requirements for an Acceptable Research Program
- A Multicriteria Weighted Vote‐Based Classifier Ensemble for Heart Dise...
- A few simple steps to improve the description of group results in neur...
- The Sense of Agency as Tracking Control
- The effects of payoff manipulations on temporal bisection performance
- Does bilingualism shape inhibitory control in the elderly?
- Error-Related Negativity and the Misattribution of State-Anxiety Follo...
- Training and transfer effects of N -back t...
- How Strong is the Confirmation of a Hypothesis by Significant Data?
- Testing Bilingual Educational Methods: A Plea to End the Language‐Mixi...
- Automaticity of Conceptual Magnitude
- The Temporal Courses of Phonological and Orthographic Encoding in Hand...
- Revealing the neural fingerprints of a missing hand
- It Is Not Necessary to Retrieve the Phonological Nodes of Context Obje...
- Researchers’ Intuitions About Power in Psychological Research
- Mothers' Impact on Daughters' Cardiovascular Reactivity in a High-Thre...
- External validity of Concealed Information Test experiment: Comparison...
- Harold Jeffreys’s default Bayes factor hypothesis tests: Explanation, ...
- Incorrect results in software engineering experiments: How to improve ...
- Workload Capacity...
- Can Medical Diagnosis Benefit from “Unconscious Thought”?
- Limits of Executive Control...
- Preschoolers, adolescents, and adults visually anticipate an agent's e...
- The Meal Pattern Questionnaire: A psychometric evaluation using the Ea...
- Magnitude-based inference and its application in user research
- How to improve people's interpretation of probabilities of precipitati...
- Reproducible research in sport and exercise psychology: The role of sa...
- A Bayesian Perspective on the Reproducibility Project: Psychology
- What Klein’s “Semantic Gradient” Does and Does Not Really Show: Decomp...
- Association Between Executive Functions, Working Memory, and Manual De...
- The Doubting System 1: Evidence for automatic substitution sensitivity
- Reevaluating the effectiveness of n-back training on transfer through ...
- Underpowered samples, false negatives, and unconscious learning
- Mice plan decision strategies based on previously learned time interva...
- Object Affordances Potentiate Responses but Do Not Guide Attentional P...
- Why Bayesian Psychologists Should Change the Way They Use the Bayes Fa...
- Preschool children’s attachment security is associated with their shar...
- Qualitative and Quantitative Evidence in Health: The Critics’ View
- Bayesian Testing of Constrained Hypotheses
- Review of null hypothesis significance testing in the ophthalmic liter...
- The assessment of mathematical literacy of linguistic minority student...
- The effect of plausibility on eye movements in reading: Testing E-Z Re...
- FPGA-based chlorophyll fluorescence measurement system with arbitrary ...
- Inducing Expectations for Health: Effects of Verbal Suggestion and Ima...
- The relationships between food and energy intakes, salt content and su...
- Quantifying the time for accurate EEG decoding of single value-based d...
- The Replication Paradox: Combining Studies can Decrease Accuracy of Ef...
- A purely confirmatory replication study of structural brain-behavior c...
- Memory Detection 2.0: The First Web-Based Memory Detection Test
- On the automatic link between affect and tendencies to approach and av...
- Location-based errors in change detection: A challenge for the slots m...
- Is the call to abandon p-values the red herring of the replicability c...
- A Concise Set of Core Recommendations to Improve the Dependability of ...
- The Effects of “Green Chemistry” on Secondary School Students’ Underst...
- A default Bayesian hypothesis test for mediation
- Peer Assessment of Aviation Performance: Inconsistent for Good Reasons
- The emergence of scalar meanings
- Anticipation in turn-taking: mechanisms and information sources
- An Introduction to Bayesian Hypothesis Testing for Management Research
- A Bayesian Primer for the Organizational Sciences...
- Beyond Theory and Data in Preference Modeling: Bringing Humans into th...
- Null hypothesis significance tests. A mix-up of two different theories...
- Model Comparison and Hierarchical Modeling
- Goals, Power, and Sample Size
- Bibliography
- Are We Wasting a Good Crisis? The Availability of Psychological Resear...
- Predictors of Response to Web-Based Cognitive Behavioral Therapy With ...
- Differences in Interpretation of p Values and Effect Size in Japanese ...
- Statistical Reporting Errors and Collaboration on Statistical Analyses...
- How significant ( p < 0.05) is geomorphic...
- Statistically Lay Decision Makers Ignore Error Bars in Two-Point Compa...
- Are bilingual advantages dependent upon specific tasks or specific bil...
- Frequent Words Do Not Break Continuous Flash Suppression Differently f...
- Using Bayes to get the most out of non-significant results
- Structural connectivity in a single case of progressive prosopagnosia:...
- What counts as evidence for working memory training? Problems with cor...
- What can the Thatcher illusion tell us about face processing in the br...
- Decisive Evidence on a Smaller-Than-You-Think Phenomenon...
- Continuously Cumulating Meta-Analysis and Replicability
- Intuitive Logic Revisited: New Data and a Bayesian Mixed Model Meta-An...
- When decision heuristics and science collide
- The frequentist implications of optional stopping on Bayesian hypothes...
- Distinct electrophysiological potentials for intention in action and p...
- Posterior-Hacking: Selective Reporting Invalidates Bayesian Results Al...
- Publication Bias in Recent Empirical Accounting Research
- Out of Body Experience Induced by Hypnotic Suggestion. Part 1: Phenome...
- A reinvestigation of the reference frame of the tilt-adaptation aftere...
- Revised standards for statistical evidence
- The consistency test does not–and cannot–deliver what is advertised: A...
- Reading therapy strengthens top–down connectivity in patients with pur...
- Are the Effects of Response Inhibition on Gambling Long-Lasting?
- The Critical Period Hypothesis in Second Language Acquisition: A Stati...
- Lack of reliable evidence for a distinctive ε4−related cognitive pheno...
- What is Overt and what is Covert in Congenital Prosopagnosia?
- Priming Intelligent Behavior: An Elusive Phenomenon
- Treatment for Adult Sex Offenders
- A default Bayesian hypothesis test for correlations and partial correl...
- MorePower 6.0 for ANOVA with relational confidence intervals and Bayes...
- The Rules of the Game Called Psychological Science
- Psychologists Are Open to Change, yet Wary of Rules
- An Agenda for Purely Confirmatory Research
- Effects of generation on source memory: A test of the resource tradeof...
- Feeling the past: The absence of experimental evidence for anomalous r...
- Default Bayes factors for ANOVA designs
- Fostering Pre-service Teachers’ Self-Determined Environmental Motivati...
- Promoting pro-environmental attitudes and reported behaviors of Malays...
- Rethinking statistical analysis methods for CHI
- Testing theories of post-error slowing
- Editorial: Methodology in judgment and decision making research
- Revising Beliefs about the Merit of Unconscious Thought: Evidence in F...
- Comment: What constitutes evidence in science education research?
- A tutorial on Bayes factor estimation with the product space method
- What cognitive processes drive response biases? A diffusion model anal...
- Bayesian Versus Orthodox Statistics: Which Side Are You On?
- Bayesian Assessment of Null Values Via Parameter Estimation and Model ...
- Introduction to Special Section on Bayesian Data Analysis
Figures and tables
Figures & Media
Tables
View Options
Get access
Access options
If you have access to journal content via a personal subscription, university, library, employer or society, select from the options below:
loading institutional access options
APS members can access this journal content using society membership credentials.
APS members can access this journal content using society membership credentials.
Alternatively, view purchase options below:
Purchase 24 hour online access to view and download content.
Access journal content via a DeepDyve subscription or find out more about this option.
