Abstract
R. Goodman’s Strength and Difficulties Questionnaire (SDQ) is widely used to measure emotional and behavioral difficulties in childhood and adolescence. In the present study, we examined whether the SDQ measures the same construct across time, when used for longitudinal research. A nationally representative sample of parents (N = 3,375) provided data on their children at ages 4, 5, and 6 years. Using confirmatory factor analysis (CFA) for ordinal data, two competing models (three-factor model vs. five-factor model) were tested to establish equivalence across time. Results showed that the five-factor model had a superior fit to the data compared with the alternative three-factor model which only achieved an adequate fit at a configural level. Strong longitudinal factorial invariance was established for the five-factor parent version of the SDQ. Our findings support the use of the SDQ in longitudinal studies and provide the important psychometric information required for basing educational, clinical, and policy decisions on outcomes of the SDQ.
|
Asparouhov, T., Muthén, B. (2010). Weighted least squares estimation with missing data. Retrieved from http://www.statmodel.com/download/GstrucMissingRevision.pdf Google Scholar | |
|
Black, C., Martin, C. (2015). Mental health and wellbeing among adolescents in Scotland: Profile and trends. Edinburgh, UK: Scottish Government. Google Scholar | |
|
Borsboom, D. (2005). Measuring the mind: Conceptual issues in contemporary psychometrics. New York, NY: Cambridge University Press. Google Scholar | Crossref | |
|
Bradshaw, P., Lewis, G., Hughes, T. (2014). Growing Up in Scotland: Characteristics of pre-school provision and their association with child outcomes. Edinburgh, UK: Scottish Government. Google Scholar | |
|
Browne, M. W., Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21, 230-258. doi:10.1177/0049124192021002005 Google Scholar | SAGE Journals | ISI | |
|
Chauvin, B., Leonova, T. (2016). The Strength and Difficulties Questionnaire revisited in a French-speaking population: Propositions of a reduced version of the parent SDQ. Journal of Psychoeducational Assessment, 34, 389-396. doi:10.1177/0734282915604074 Google Scholar | SAGE Journals | ISI | |
|
Cheung, G. W., Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9, 233-255. doi:10.1207/S15328007SEM0902_5 Google Scholar | Crossref | ISI | |
|
Chiorri, C., Hall, J., Casely-Hayford, J., Malmberg, L. E. (2016). Evaluating measurement invariance between parents using the Strengths and Difficulties Questionnaire (SDQ). Assessment, 23, 63-74. doi:10.1177/1073191114568301 Google Scholar | SAGE Journals | ISI | |
|
Coertjens, L., Donche, V., De Maeyer, S., Vanthournout, G., Van Petegem, P. (2012). Longitudinal measurement invariance of Likert-type learning strategy scales: Are we using the same ruler at each wave? Journal of Psychoeducational Assessment, 30, 577-587. doi:10.1177/0734282912438844 Google Scholar | SAGE Journals | ISI | |
|
Croft, S., Stride, C., Maughan, B., Rowe, R. (2015). Validity of the Strengths and Difficulties Questionnaire in preschool-aged children. Pediatrics, 135(5), 1-10. doi:10.1542/peds.2014-2920 Google Scholar | Crossref | Medline | ISI | |
|
Davidov, E., Datler, G., Schmidt, P., Schwartz, S. H. (2011). Testing the invariance of values in the Benelux countries with the European social survey: Accounting for ordinality. In Davidov, E., Schmidt, P., Billiet, J. (Eds.), Cross cultural analysis: Methods and applications (pp. 149-172). New York, NY: Routledge. Google Scholar | |
|
Department for Education . (2012). Guidance on data collection on the emotional health of looked after children. Retrieved from https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/253566/ssda903_sdq_guidance_2012-13_version1-0.pdf Google Scholar | |
|
Department for Education . (2015). Mental health and behaviour in schools: Departmental advice for school staff. Retrieved from https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/416786/Mental_Health_and_Behaviour_-_Information_and_Tools_for_Schools_240515.pdf Google Scholar | |
|
Dickey, W. C., Blumberg, S. J. (2004). Revisiting the factor structure of the Strengths and Difficulties Questionnaire: United States, 2001. Journal of the American Academy of Child & Adolescent Psychiatry, 43, 1159-1167. Google Scholar | Crossref | Medline | ISI | |
|
Fergusson, D. M., Horwood, L. J., Ridder, E. M. (2005). Show me the child at seven: The consequences of conduct problems in childhood for psychosocial functioning in adulthood. Journal of Child Psychology and Psychiatry, 46, 837-849. doi:10.1111/j.1469-7610.2004.00387.x Google Scholar | Crossref | Medline | ISI | |
|
Goodman, A., Goodman, R. (2011). Population mean scores predict child mental disorder rates: Validating SDQ prevalence estimators in Britain. Journal of Child Psychology and Psychiatry and Allied Disciplines, 52, 100-108. doi:10.1111/j.1469-7610.2010.02278.x Google Scholar | Crossref | Medline | ISI | |
|
Goodman, A., Lamping, D. L., Ploubidis, G. B. (2010). When to use broader internalising and externalising subscales instead of the hypothesised five subscales on the Strengths and Difficulties Questionnaire (SDQ): Data from British parents, teachers and children. Journal of Abnormal Child Psychology, 38, 1179-1191. doi:10.1007/s10802-010-9434-x Google Scholar | Crossref | Medline | ISI | |
|
Goodman, R. (1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38, 581-586. doi:10.1111/j.1469-7610.1997.tb01545.x Google Scholar | Crossref | Medline | ISI | |
|
Hastings, R. P., Bham, M. S. (2003). The relationship between student behaviour patterns and teacher burnout. School Psychology International, 24, 115-127. doi:10.1177/0143034303024001905 Google Scholar | SAGE Journals | ISI | |
|
Hu, L., Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1-55. doi:10.1080/10705519909540118 Google Scholar | Crossref | ISI | |
|
Kersten, P., Czuba, K., McPherson, K., Dudley, M., Elder, H., Tauroa, R., Vandal, A. (2016). A systematic review of evidence for the psychometric properties of the Strengths and Difficulties Questionnaire. International Journal of Behavioral Development, 40, 64-75. doi:10.1177/0165025415570647 Google Scholar | SAGE Journals | ISI | |
|
Kline, R. B. (2005). Principles and practice of structural equation modeling. New York, NY: Guilford Press. Google Scholar | |
|
Little, T. D. (2013). Longitudinal structural equation modeling. New York, NY: Guilford Press. Google Scholar | |
|
Marsh, H. W., Hau, K., Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling: A Multidisciplinary Journal, 11, 320-341. Google Scholar | Crossref | ISI | |
|
Masten, A. S., Roisman, G. I., Long, J. D., Burt, K. B., Obradovic, J., Riley, J. R., . . . Tellegen, A. (2005). Developmental cascades: Linking academic achievement and externalizing and internalizing symptoms over 20 years. Developmental Psychology, 41, 733-746. doi:10.1207/s15328007sem1103_2 Google Scholar | Crossref | Medline | ISI | |
|
McCrory, C., Layte, R. (2012). Testing competing models of the Strengths and Difficulties Questionnaire’s (SDQ’s) factor structure for the parent-informant instrument. Personality and Individual Differences, 52, 882-887. doi:10.1016/j.paid.2012.02.011 Google Scholar | Crossref | ISI | |
|
Meade, A. W., Johnson, E. C., Braddy, P. W. (2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. Journal of Applied Psychology, 93, 568-592. doi:10.1037/0021-9010.93.3.568 Google Scholar | Crossref | Medline | ISI | |
|
Mejia, T. M., Hoglund, W. L. G. (2016). Do children’s adjustment problems contribute to teacher–child relationship quality? Support for a child-driven model. Early Childhood Research Quarterly, 34, 13-26. doi:10.1016/j.ecresq.2015.08.003 Google Scholar | Crossref | ISI | |
|
Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525-543. Google Scholar | Crossref | ISI | |
|
Millsap, R. E. (2011). Statistical approaches to measurement invariance. New York, NY: Routledge. Google Scholar | |
|
Millsap, R. E., Yun-Tein, J. (2004). Assessing factorial invariance in ordered-categorical measures. Multivariate Behavioral Research, 39, 479-515. doi:10.1207/S15327906MBR3903_4 Google Scholar | Crossref | ISI | |
|
Moffitt, T. E. (1993). Adolescence-limited and life-course-persistent antisocial behavior. Psychological Review, 100, 674-701. Google Scholar | Crossref | Medline | ISI | |
|
Muthén, L., Muthén, B. O. K. (2012). Mplus user’s guide (7th ed.). Los Angeles, CA: Author. Google Scholar | |
|
Neece, C. L., Green, S. A., Baker, B. L. (2012). Parenting stress and child behavior problems: A transactional relationship across time. American Journal on Intellectual and Developmental Disabilities, 117, 48-66. doi:10.1352/1944-7558-117.1.48 Google Scholar | Crossref | Medline | ISI | |
|
Newsom, J. T. (2015). Longitudinal structural equation modeling: A comprehensive introduction. New York, NY: Routledge. Google Scholar | |
|
Normandeau, S., Guay, F. (1998). Preschool behavior and first-grade school achievement: The mediational role of cognitive self-control. Journal of Educational Psychology, 90, 111-121. Google Scholar | Crossref | ISI | |
|
Oort, F. J. (2005). Using structural equation modeling to detect response shifts and true change. Quality of Life Research, 14, 587-598. Google Scholar | Crossref | Medline | ISI | |
|
Reynolds, S., MacKay, T., Kearney, M. (2009). Nurture groups: A large scale, controlled study of effects on development and academic attainment. British Journal of Special Education, 36, 204-212. doi:10.1111/j.1467-8578.2009.00445.x Google Scholar | Crossref | |
|
Schwartz, C. E., Sprangers, M. A. G. (1999). Methodological approaches for assessing response shift in longitudinal health related quality-of-life research. Social Science & Medicine, 48, 1531-1548. doi:10.1016/S0277-9536(99)00047-7 Google Scholar | Crossref | Medline | ISI | |
|
ScotCen Social Research . (2013). Growing Up in Scotland: Cohort 1, Sweeps 1-6, 2005-2011. [data collection]. 11th Edition. UK Data Service. SN: 5760, Retrieved from http://dx.doi.org/10.5255/UKDA-SN-5760-4 Google Scholar | |
|
Scott, S., Knapp, M., Henderson, J., Maughan, B. (2001). Financial cost of social exclusion: Follow up study of antisocial children into adulthood. British Medical Journal, 323, 1-5. doi:10.1136/bmj.323.7306.191 Google Scholar | Crossref | Medline | |
|
Scottish Government . (2008). The early years framework. Edinburgh, UK: Author. Google Scholar | |
|
Steinmetz, H., Frese, M., Schmidt, P. (2013). A longitudinal panel study on antecedents and outcomes of work–home interference. Journal of Vocational Behavior, 73, 231-241. doi:10.1016/j.jvb.2008.05.002 Google Scholar | Crossref | ISI | |
|
Stone, L. L., Janssens, J. M., Vermulst, A. A., Van Der Maten, M., Engels, R. C., Otten, R. (2015). The Strengths and Difficulties Questionnaire: psychometric properties of the parent and teacher version in children aged 4–7. BMC Psychology, 3, 1–12. doi: 10.1186/s40359-015-0061-8 Google Scholar | Crossref | Medline | |
|
Stone, L. L., Otten, R., Engels, R. C., Vermulst, A. A., Janssens, J. M. (2010). Psychometric properties of the parent and teacher versions of the Strengths and Difficulties Questionnaire for 4- to 12-year-olds: A review. Clinical Child and Family Psychology Review, 13, 254-274. doi:10.1007/s10567-010-0071-2 Google Scholar | Crossref | Medline | ISI | |
|
Van Sonsbeek, M. A., Hutschemaekers, G. G., Veerman, J. W., Tiemens, B. B. (2014). Effective components of feedback from Routine Outcome Monitoring (ROM) in youth mental health care: Study protocol of a three-arm parallel-group randomized controlled trial. BMC Psychiatry, 14, 1-11. doi:10.1186/1471-244X-14-3 Google Scholar | Crossref | ISI | |
|
West, S. G., Taylor, A. B., Wu, W. (2012). Model fit and model selection in structural equation modeling. In Hoyle, R. H. (Ed.), Handbook of structural equation modeling (pp. 209-231). New York, NY: Guilford Press. Google Scholar | |
|
White, J., Connelly, G., Thompson, L., Wilson, P. (2013). Assessing wellbeing at school entry using the Strengths and Difficulties Questionnaire: Professional perspectives. Educational Research, 55, 87-98. doi:10.1080/00131881.2013.767027 Google Scholar | Crossref | ISI | |
|
Widaman, K. F., Ferrer, E., Conger, R. D. (2010). Factorial invariance within longitudinal structural equation models: Measuring the same construct across time. Child Development Perspectives, 4, 10-18. doi:10.1111/j.1750-8606.2009.00110.x Google Scholar | Crossref | Medline | ISI | |
|
Wilson, P., Bradshaw, P., Tipping, S., Henderson, M., Der, G., Minnis, H. (2013). What predicts persistent early conduct problems? Evidence from the Growing Up in Scotland cohort. Journal of Epidemiology & Community Health, 67, 76-80. doi:10.1136/jech-2011-200856 Google Scholar | Crossref | Medline | ISI |

