![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
In this study, the authors examined the psychometric properties of the key cognitive strategies (KCS) within the CollegeCareerReady™ School Diagnostic, a self-report measure of critical thinking skills intended for high school students. Using a cross-validation approach, an exploratory factor analysis was conducted with a randomly selected portion of the sample (n = 516) and resulted in five reliable factors: (a) problem formulation, (b) research, (c) interpretation, (d) communication, and (e) precision/accuracy. A confirmatory factor analysis was conducted with the remaining sample (n = 808). Goodness-of-fit indices indicated acceptable model fit. The five-factor solution is consistent with earlier validity studies of the KCS framework. Implications for use by high school personnel in evaluation of instructional programs and as a value-added assessment are discussed.
Keywords cognition, critical thinking, college readiness, factor analysis, validity
References
Section:
|
Achieve, Inc . (2007). Aligned expectations? A closer look at college admissions and placement tests. Washington, DC: Author. Google Scholar | |
|
ACT, Inc . (2010). College readiness standards for EXPLORE, PLAN, and ACT. Iowa City, IA: Author. Google Scholar | |
|
Adelman, C. (1999). Answers in the tool box: Academic intensity, attendance patterns, and bachelor’s degree attainment. Washington, DC: U.S. Department of Education. Google Scholar | |
|
Allen, D. (1999). Desire to finish college: An empirical link between motivation and persistence. Research in Higher Education, 40, 461–485. Google Scholar | Crossref | ISI | |
|
Baldwin, M., Seburn, M., Conley, D. T. (2011). External validity of the College-Readiness Performance Assessment System (C-PAS). Paper presented at the 2011 annual conference of the American Educational Research Association, New Orleans, LA. Google Scholar | |
|
Baxter, G. P., Glaser, R. (1997). An approach to analyzing the cognitive complexity of science performance assessments. Los Angeles, CA: National Center for Research on Evaluation, Standards, and Student Testing and Center for the Study of Evaluation. Google Scholar | Crossref | |
|
Bedsworth, W., Colby, S., Doctor, J. (2006). Reclaiming the American dream. Boston, MA: Bridgespan. Google Scholar | |
|
Boekaerts, M. (1999). Self-regulated learning: Where we are today. International Journal of Educational Research, 31, 445–457. Google Scholar | Crossref | |
|
Boston, C. (2003). Cognitive science and assessment. College Park, MD: Office of Educational Research and Improvement. Google Scholar | |
|
Bransford, J. D., Brown, A. L., Cocking, R. R. (Eds.). (2000). How people learn: Brain, mind, experience, and school. Washington, DC: National Academy of Sciences, U.S. Department of Education. Google Scholar | |
|
Brown, R. S., Conley, D. T. (2007). Comparing state high school assessments to standards for success in entry-level university courses. Educational Assessment, 12, 137–160. Google Scholar | Crossref | |
|
Brown, R. S., Niemi, D. N. (2007). Investigating the alignment of high school and community college assessments in California (National Center Report No. 07-3). The National Center for Public Policy and Higher Education. Google Scholar | |
|
Browne, M. W., Cudeck, R. (1993). Alternative ways of assessing model fit. In Bollen, K. A., Long, J. S. (Eds.), Testing structural equation models (pp. 136–162). Newbury Park, CA: SAGE. Google Scholar | |
|
Camara, W. J., Echternacht, G. (2000). The SAT and high school grades: Utility in predicting success in college. College Entrance Examination Board, Office of Research and Development (Report CB-RN-10). New York, NY: College Board. Google Scholar | |
|
Chen, X. (2005). First generation students in postsecondary education: A look at their college transcripts (NCES 2005-171). U.S. Department of Education, National Center for Education Statistics . Washington, DC: U.S. Government Printing Office. Google Scholar | |
|
Choy, S. P. (2001). Students whose parents did not go to college: Postsecondary access, persistence, and attainment (NCES 2001-126). U.S. Department of Education, National Center for Education Statistics . Washington, DC: U.S. Government Printing Office. Google Scholar | |
|
Cimetta, A. D., D’Agostino, J. J., Levin, J. R. (2010). Can high school achievement tests serve to select college students? Educational Measurement: Issues and Practice, 29, 3–12. Google Scholar | Crossref | |
|
Coelen, S. P., Berger, J. B. (2006). First steps: An evaluation of the success of Connecticut students beyond high school. Quincy, MA: Nellie Mae Education Foundation. Google Scholar | |
|
Conley, D. T. (2003). Understanding university success. Eugene: Center for Educational Policy Research, University of Oregon. Google Scholar | |
|
Conley, D. T. (2005). College knowledge: What it really takes for students to succeed and what we can do to get them ready. San Francisco, CA: Jossey-Bass. Google Scholar | |
|
Conley, D. T. (2007a). Redefining college readiness (pp. 8–9). Eugene, OR: Center for Educational Policy Research. Google Scholar | |
|
Conley, D. T. (2007b). Toward a comprehensive conception of college readiness. Eugene, OR: Educational Policy Improvement Center. Google Scholar | |
|
Conley, D. T. (2010). College and career ready: Helping all students succeed beyond high school. San Francisco, CA: Jossey-Bass. Google Scholar | Crossref | |
|
Conley, D. T. (2011a). Building on the common core. Educational Leadership, 68, 16–20. Google Scholar | ISI | |
|
Conley, D. T. (2011b). Pathways to postsecondary and career readiness. Invited speaker at College and Career Readiness Regional Workshop, Wellington, NZ. Google Scholar | |
|
Conley, D. T., Lombardi, A., Seburn, M., McGaughy, C. (2009). Formative assessment for college readiness on five key cognitive strategies associated with postsecondary success. Paper presented at the 2009 annual conference of the American Educational Research Association, San Diego, CA. Google Scholar | |
|
Conley, D. T., McGaughy, C., Kirtner, J., Van Der Valk, A., Martinez-Wenzl, M. T. (2010). College readiness practices at 38 high schools and the development of the CollegeCareerReady School Diagnostic tool. Paper presented at the 2010 annual conference of the American Educational Research Association, Denver, CO. Google Scholar | |
|
Costa, A., Kallick, B. (2000). Discovering & exploring habits of mind. A developmental series (Book 1). Alexandria, VA: Association for Supervision and Curriculum Development. Google Scholar | |
|
Gandara, P., Bial, D. (2001). Paving the way to higher education: K-12 intervention programs for underrepresented youth. Washington, DC: U.S. Government Printing Office, U.S. Department of Education, National Center for Education Statistics. Google Scholar | |
|
Gore, P. (2006). Academic self-efficacy as a predictor of college outcomes: Two incremental validity studies. Journal of Career Assessment, 14, 92–115. Google Scholar | SAGE Journals | ISI | |
|
Hu, L. T., Bentler, P. M. (1995). Evaluating model fit. In Hoyle, R. H. (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 76–99). Thousand Oaks, CA: SAGE. Google Scholar | |
|
Kline, R. (1998). Principles and practice of structural equation modeling. New York, NY: Guilford. Google Scholar | |
|
Kuh, G. D. (2005). Student engagement in the first year of college. In Upcraft, L. M., Gardner, J. N., Barefoot, B. O. (Eds.), Challenging and supporting the first-year student (pp. 86–107). San Francisco, CA: Jossey-Bass. Google Scholar | |
|
Lombardi, A. R., Seburn, M., Conley, D. T. (2011a). Development and initial validation of a measure of academic behaviors associated with college and career readiness. Journal of Career Assessment, 19, 375–391. Google Scholar | SAGE Journals | ISI | |
|
Lombardi, A. R., Seburn, M., Conley, D. T. (2011b). Treatment of nonresponse items on scale validation: What “don’t know” responses indicate about college readiness. Paper presented at the 2011 annual conference of the American Educational Research Association, New Orleans, LA. Google Scholar | |
|
MacCallum, R. C., Brown, M. W., Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130–149. Google Scholar | Crossref | ISI | |
|
McDonough, P. M. (2004). Counseling matters: Knowledge, assistance, and organizational commitment to college preparation. In Tierney, W. G. (Ed.), Nine propositions relating to the effectiveness of college preparation programs (pp. 69-88). New York, NY: State University of New York Press. Google Scholar | |
|
McGee, D. (2003). The relationship between WASL scores and performance in the first year of university. Seattle: Office of Educational Assessment, University of Washington. Google Scholar | |
|
Muthen, L. K., Muthen, B. O. (2010). Mplus version 6.0 user’s guide. Los Angeles, CA: Muthen & Muthen. Google Scholar | |
|
National Center for Education Statistics . (2004). The condition of education 2004: Remediation and degree completion. Washington, DC: U.S. Department of Education. Google Scholar | Crossref | |
|
National Governor’s Association & Council of Chief State School Officers . (2010). Common Core State Standards initiative. Retrieved from http://www.corestandards.org/ Google Scholar | |
|
National Research Council . (2002). Learning and understanding: Improving advanced study of mathematics and science in U.S. high schools. Washington, DC: National Academy Press. Google Scholar | |
|
Noble, J. P., Camara, W. J. (2003). Issues in college admissions testing. In Wall, J. E., Walz, G. R. (Eds.), Measuring up: Assessment issues for teachers, counselors, and administrators (pp. 283-296). Greensboro, NC: ERIC Counseling and Student Services Clearinghouse. Google Scholar | |
|
Nunnally, J. C. (1975). Psychometric theory: 25 years ago and now. Educational Researcher, 4, 7–21. Google Scholar | Abstract | |
|
Pascarella, E. T., Pierson, C. T., Wolniak, G. C., Terenzini, P. T. (2004). First-generation college students: Additional evidence on college experiences and outcomes. Journal of Higher Education, 75, 249–284. Google Scholar | Crossref | ISI | |
|
Perkins, D. (1992). Smart schools: Better thinking and learning for every child. New York, NY: Free Press. Google Scholar | |
|
Pintrich, P. R. (2004). A conceptual framework for assessing motivation and self-regulated learning in college students. Educational Psychology Review, 16, 385–407. Google Scholar | Crossref | ISI | |
|
Plank, S. B., Jordan, W. J. (2001). Effects of information, guidance, and actions on postsecondary destinations: A study of talent loss. American Educational Research Journal, 38, 947–979. Google Scholar | SAGE Journals | ISI | |
|
Ritchhart, R. (2002). Intellectual character: What it is, why it matters, and how to get it. San Francisco, CA: Jossey-Bass. Google Scholar | |
|
SPSS, Inc . (2010). PASW 18.0 for windows. Chicago, IL: IBM. Google Scholar | |
|
Stanton-Salazar, R. D. (2001). Manufacturing hope and despair: The school and kin support networks of U.S.-Mexican youth. New York, NY: Teachers College Press. Google Scholar | |
|
Tinto, V. (2007). Research and practice of student retention: What’s next? Journal of College Student Retention, 8, 1–19. Google Scholar | SAGE Journals | |
|
Torres, J. B., Solberg, V. S. (2001). Role of self-efficacy, stress, social integration, and family support in Latino college student persistence and health. Journal of Vocational Behavior, 59, 3–63. Google Scholar | Crossref | ISI | |
|
U.S. Department of Education . (2010). Race to the Top Assessment Program. Retrieved from http://www2.ed.gov/programs/racetothetop-assessment/index.html Google Scholar | |
|
Venezia, A., Kirst, M. W., Antonia, A. L. (2003). Betraying the college dream: How disconnected K-12 and postsecondary education systems undermine student aspirations. Stanford, CA: Stanford Institute for Higher Education Research. Google Scholar | |
|
Wiley, A., Wyatt, J., Camara, W. J. (2010). The development of a multidimensional college readiness index. New York, NY: College Board. Google Scholar | |
|
Wolters, C. A. (1998). Self-regulated learning and college students’ regulation of motivation. Journal of Educational Psychology, 90, 224–235. Google Scholar | Crossref | ISI | |
|
Zajacova, A., Lynch, S. M., Espenshade, T. J. (2005). Self-efficacy, stress, and academic success in college. Research in Higher Education, 46, 677–706. Google Scholar | Crossref | ISI |
