Measurement Invariance of the Ruminative Responses Scale Across Gender
Abstract
Although women demonstrate higher levels of rumination than men, it is unknown whether instruments used to measure rumination have the same psychometric properties for women and men. To examine this question, we evaluated measurement invariance of the brooding and reflection subscales from the Ruminative Responses Scale (RRS) by gender, using data from four samples of undergraduates from three universities within the United States (N = 4,205). A multigroup confirmatory factor analysis revealed evidence for configural, metric, and scalar invariance of the covariance structure of the 10-item version of the RRS. There were statistically significant latent mean differences between women and men, with women scoring significantly higher than men on both brooding and reflection. These findings suggest that the 10-item version of the RRS provides an assessment of rumination that is psychometrically equivalent across gender. Consequently, gender differences in brooding and reflection likely reflect valid differences between women and men.
Get full access to this article
View all access and purchase options for this article.
References
References marked with an asterisk indicate studies providing data included in the current study.
Bentler P. M. (2005). EQS 6 structural equations program manual. Encino, CA: Multivariate Software.
Bentler P. M., Wu E. J. C. (2002). EQS for Windows user’s guide. Encino, CA: Multivariate Software.
Butler L. D., Nolen-Hoeksema S. (1994). Gender differences in responses to depressed mood in a college sample. Sex Roles, 30, 331-346.
Byrne B. M. (2006). Structural equation modeling with EQS: Basic concepts, applications, and programming (2nd ed.). Mahwah, NJ: Erlbaum.
Byrne B. M. (2008). Testing for multigroup equivalence of a measuring instrument: A walk through the process. Psicothema, 20, 872-882.
*Chan S., Miranda R., Surrence K. (2009). Subtypes of rumination in the relationship between negative life events and suicidal ideation. Archives of Suicide Research, 13, 123-135.
Chen F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464-504.
*Cheref S., Lane R., Polanco-Roman L., Gadol E., Miranda R. (2015). Suicidal ideation among racial/ethnic minorities: Moderating effects of rumination and depressive symptoms. Cultural Diversity & Ethnic Minority Psychology, 21, 31-40.
Cheung G. W., Rensvold R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255.
Cheung M. S. P., Gilbert P., Irons C. (2004). An exploration of shame, social rank and rumination in relation to depression. Personality and Individual Differences, 36, 1143-1153.
Cox S., Funasaki K., Smith L., Mezulis A. H. (2012). A prospective study of brooding and reflection as moderators of the relationship between stress and depressive symptoms in adolescence. Cognitive Therapy and Research, 36, 290-299.
Debeer E., Hermans D., Raes F. (2009). Associations between components of rumination and autobiographical memory specificity as measured by a Minimal Instructions Autobiographical Memory Test. Memory, 17, 892-903.
*Fresco D. M., Frankel A. N., Mennin D. S., Turk C. L., Heimberg R. G. (2002). Distinct and overlapping features of rumination and worry: The relationship of cognitive production to negative affective states. Cognitive Therapy and Research, 26, 179-188.
Girgus J. S., Yang K. (2015). Gender and depression. Current Opinion in Psychology, 4, 53-60.
Griffith J. W., Raes F. (2014). Factor structure of the Ruminative Responses Scale: A community-sample study. European Journal of Psychological Assessment, 31, 247-253.
Hu L. T., Bentler P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
Johnson D. P., Whisman M. A. (2013). Gender differences in rumination: A meta-analysis. Personality and Individual Differences, 55, 367-374.
Joormann J., Dkane M., Gotlib I. H. (2006). Adaptive and maladaptive components of rumination? Diagnostic specificity and relation to depressive biases. Behavior Therapy, 37, 269-280.
Kessler R. C. (2006). The epidemiology of depression among women. In Keyes C. L. M., Goodman S. H. (Eds.), Women and depression: A handbook for the social, behavioral, and biomedical sciences (pp. 22-37). New York, NY: Cambridge University Press.
Little R. J. A., Rubin D. B. (2002). Statistical analysis with missing data (2nd ed.). New York, NY: Wiley.
Little T. D. (1997). Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32, 53-76.
Lucena-Santos P., Pinto-Gouveia J., Carvalho S. A., Oliveira M. D. S. (2018). Is the widely used two-factor structure of the Ruminative Responses Scale invariant across different samples of women? Psychology and Psychotherapy: Theory, Research and Practice. Advance online publication.
Luminet O. (2004). Measurement of depressive rumination and associated constructs. In Papageorgiou C., Wells A. (Eds.), Depressive rumination: Nature, theory and treatment (pp. 187-215). New York, NY: Wiley.
Mardia K. V. (1970). Measures of multivariate skewness and kurtosis with applications. Biometrika, 57, 519-530.
Meade A. W., Johnson E. C., Braddy P. W. (2008). Power and sensitivity to alternative fit indices in tests of measurement invariance. Journal of Applied Psychology, 93, 568-592.
Meredith W., Teresi J. A. (2006). An essay on measurement and factorial invariance. Medical Care, 44, S69-S77.
Mezulis A., Simonson J., McCauley E., Vander Stoep A. (2011). The association between temperament and depressive symptoms in adolescence: Brooding and reflection as potential mediators. Cognition & Emotion, 25, 1460-1470.
Nolen-Hoeksema S. (1987). Sex differences in unipolar depression: Evidence and theory. Psychological Bulletin, 101, 259-282.
Nolen-Hoeksema S. (1991). Responses to depression and their effects on the duration of depressive episodes. Journal of Abnormal Psychology, 100, 569-582.
Nolen-Hoeksema S., Aldao A. (2011). Gender and age differences in emotion regulation strategies and their relationship to depressive symptoms. Personality and Individual Differences, 51, 704-708.
Nolen-Hoeksema S., Morrow J. (1991). A prospective study of depression and posttraumatic stress symptoms after a natural disaster: The 1989 Loma Prieta Earthquake. Journal of Personality and Social Psychology, 61, 115-121.
Nolen-Hoeksema S., Wisco B. E., Lyubomirsky S. (2008). Rethinking rumination. Perspectives on Psychological Science, 3, 400-424.
Olatunji B. O., Naragon-Gainey K., Wolitzky-Taylor K. B. (2013). Specificity of rumination in anxiety and depression: A multimodal meta-analysis. Clinical Psychology: Science and Practice, 20, 225-257.
Olson M. L., Kwon P. (2008). Brooding perfectionism: Refining the roles of rumination and perfectionism in the etiology of depression. Cognitive Therapy and Research, 32, 788-802.
Raes F., Hermans D. (2008). On the mediating role of subtypes of rumination in the relationship between childhood emotional abuse and depressed mood: Brooding versus reflection. Depression and Anxiety, 25, 1067-1070.
Roberts J. E., Gilboa E., Gotlib I. H. (1998). Ruminative response style and vulnerability to episodes of dysphoria: Gender‚ neuroticism‚ and episode duration. Cognitive Therapy and Research, 22, 401-423.
Rood L., Roelofs J., Bögels S. M., Nolen-Hoeksema S., Schouten E. (2009). The influence of emotion-focused rumination and distraction on depressive symptoms in non-clinical youth: A meta-analytic review. Clinical Psychology Review, 29, 607-616.
Satorra A., Bentler P. M. (1988). Scaling corrections for chi-square statistics in covariance structure analysis. In American Statistical Association 1988 Proceedings of the Business and Economic Sections (pp. 308-313). Alexandria, VA: American Statistical Association.
Satorra A., Bentler P. M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, 507-514.
Schoofs H., Hermans D., Raes F. (2010). Brooding and reflection as subtypes of rumination: Evidence from confirmatory factor analysis in nonclinical samples using the Dutch Ruminative Response Scale. Journal of Psychopathology and Behavioral Assessment, 32, 609-617.
Segerstrom S. C., Tsao J. C. I., Alden L. E., Craske M. G. (2000). Worry and rumination: Repetitive thought as a concomitant and predictor of negative mood. Cognitive Therapy and Research, 24, 671-688.
Tabachnick B. G., Fidell L. S. (2001). Using multivariate statistics (4th ed.). Boston, MA: Allyn & Bacon.
Tamres L. K., Janicki D., Helgeson V. S. (2002). Sex differences in coping behavior: A meta-analytic review and an examination of relative coping. Personality and Social Psychology Review, 6, 2-30.
Treynor W., Gonzalez R., Nolen-Hoeksema S. (2003). Rumination reconsidered: A psychometric analysis. Cognitive Therapy and Research, 27, 247-259.
*Valderrama J., Miranda R., Jeglic E. (2016). Ruminative subtypes and impulsivity in risk for suicidal behavior. Psychiatry Research, 236, 15-21.
Vandenberg R. J., Lance C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4-70.
Wang K., Lu H., Cheung E. F. C., Neumann D. L., Shum D. H. K., Chan R. C. K. (2016). “Female preponderance” of depression in non-clinical populations: A meta-analytic study. Frontiers in Psychology, 7, 1398.
Whisman M. A., Richardson E. D. (2015). Normative data on the Beck Depression Inventory—Second Edition (BDI-II) in college students. Journal of Clinical Psychology, 71, 898-907.
Widaman K. F., Grimm K. J. (2014). Advanced psychometrics: Confirmatory factor analysis, item response theory, and the study of measurement invariance. In Reiss H. T., Judd C. M. (Eds.), Handbook of research methods in social and personality psychology (2nd ed., pp. 534-570). New York, NY: Cambridge University Press.
Widaman K. F., Reise S. P. (1997). Exploring the measurement invariance of psychological instruments: Applications in the substance use domain. In Bryant K. J., Windle M., West S. G. (Eds.), The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 281-324). Washington, DC: American Psychological Association.
Wupperman P., Neumann C. S. (2006). Depressive symptoms as a function of sex-role, rumination, and neuroticism. Personality and Individual Differences, 40, 189-201.
Yuan K. H., Bentler P. M. (2000). Three likelihood-based methods for mean and covariance structure analysis with nonnormal missing data. Sociological Methodology, 30, 165-200.
Yuan K. H., Lambert P. L., Fouladi R. T. (2004). Mardia’s multivariate kurtosis with missing data. Multivariate Behavioral Research, 39, 413-437.
Cite article
Cite article
Cite article
OR
Download to reference manager
If you have citation software installed, you can download article citation data to the citation manager of your choice
Information, rights and permissions
Information
Published In
Article first published online: May 29, 2018
Issue published: April 2020
Keywords
PubMed: 29809071
Authors
Metrics and citations
Metrics
Article usage*
Total views and downloads: 867
*Article usage tracking started in December 2016
Articles citing this one
Receive email alerts when this article is cited
Web of Science: 12 view articles Opens in new tab
Crossref: 14
- Ruminative response scale for eating disorders: bifactor model and mea...
- Resilience Building Practices for Women Physicians
- Ruminative Response Scale (RRS)
- Associations between repetitive negative thinking and resting-state ne...
- Measurement Invariance of Disorder-Specific and Transdiagnostic Measur...
- Context, coping, and mental health in refugees living in protracted di...
- Revisiting the Factor Structure of the Ruminative Response Scale: a Bi...
- Measurement Invariance of Rumination Across Sex and Development from L...
- Sleep problems predict next-day suicidal thinking among adolescents: A...
- Cross-cultural and gender invariance of emotion regulation in the Unit...
- A Cross-Continent Analysis of the Invariance of Product Information in...
- Mathematical equivalence assessment: Measurement invariance across six...
- Psychometric Properties of the Chinese Version of the 10-Item Ruminati...
- Cross-Cultural and Gender Invariance of Transdiagnostic Processes in t...
Figures and tables
Figures & Media
Tables
View Options
Get access
Access options
If you have access to journal content via a personal subscription, university, library, employer or society, select from the options below:
loading institutional access options
Alternatively, view purchase options below:
Purchase 24 hour online access to view and download content.
Access journal content via a DeepDyve subscription or find out more about this option.
