Abstract
Dominance analysis (DA) is a method used to evaluate the relative importance of predictors that was originally proposed for linear regression models. This article proposes an extension of DA that allows researchers to determine the relative importance of predictors in hierarchical linear models (HLM). Commonly used measures of model adequacy in HLM (i.e., deviance, pseudo-R2, and proportional reduction in prediction error) were evaluated in terms of their appropriateness as measures of model adequacy for DA. Empirical examples were used to illustrate the procedures for comparing the relative importance of Level-1 predictors and Level-2 predictors in a person-in-group design. Finally, a simulation study was conducted to evaluate the performance of the proposed procedures and develop recommendations.
References
|
Azen, R., Budescu, D. V. (2003). The dominance analysis approach for comparing predictors in multiple regression. Psychological Methods, 8, 129–148. Google Scholar | Crossref | Medline | |
|
Azen, R., Budescu, D. V. (2009). Applications of multiple regression in psychological research. In Millsap, R. E., Maydeu-Olivares, A. (Eds.), The SAGE handbook of quantitative methods in psychology (pp. 285–310). Thousand Oaks, CA: Sage. Google Scholar | Crossref | |
|
Azen, R., Traxel, N. M. (2009). Using dominance analysis to determine predictor importance in logistic regression. Journal of Educational and Behavioral Statistics, 34, 319–347. Google Scholar | SAGE Journals | |
|
Bring, J. (1994). How to standardize regression coefficients. The American Statistician, 48, 209–213. Google Scholar | |
|
Budescu, D. V. (1993). Dominance analysis: A new approach to the problem of relative importance of predictors in multiple regression. Psychological Bulletin, 114, 542–551. Google Scholar | Crossref | |
|
Chevan, A., Sutherland, M. (1991). Hierarchical partitioning. The American Statistician, 45, 90–96. Google Scholar | Crossref | |
|
Grömping, U. (2009). Variable importance assessment in regression: Linear regression versus random forest. The American Statistician, 63, 308–319. Google Scholar | Crossref | |
|
Hair, E., Halle, T., Terry-Humen, E., Lavelle, B., Calkins, J. (2006). Children’s school readiness in the ECLS-K: Predictions to academic, health, and social outcomes in first grade. Early Childhood Research, 21, 431–454. Google Scholar | Crossref | |
|
Kreft, I. G. G., de Leeuw, J., Aiken, L. S. (1995). The effect of different forms of centering in hierarchical linear models. Multivariate Behavioral Research, 30, 1–21. Google Scholar | Crossref | Medline | |
|
Lindeman, R. H., Merenda, P. F., Gold, R. Z. (1980). Introduction to bivariate and multivariate analysis. Glenview, IL: Scott Foresman. Google Scholar | |
|
Lipovetsky, S., Conklin, M. (2001). Analysis of regression in game theory approach. Applied Stochastic Models in Business and Industry, 17, 319–330. Google Scholar | Crossref | |
|
Luo, W., Kwok, O. (2010). Proportional reduction of prediction error in cross-classified random effects models. Sociological Methods & Research, 39, 188–205. Google Scholar | SAGE Journals | |
|
McCoach, D. B., Black, A. C. (2008). Evaluation of model fit and adequacy. In O’Connell, A. A., McCoach, D. B. (Eds.), Multilevel modeling of educational data (pp. 245–272). Charlotte, NC: Information Age Publishing. Google Scholar | |
|
Moerbeek, M. (2004). The consequence of ignoring a level of nesting in multilevel analysis. Multivariate Behavioral Research, 39, 129–149. Google Scholar | Crossref | Medline | |
|
Raudenbush, S. W. (1989a). “Centering” predictors in multilevel analysis: Choices in consequences. Multilevel Modeling Newsletter, 1, 10–12. Google Scholar | |
|
Raudenbush, S. W. (1989b). A response to Longord and Plewis. Multilevel Modeling Newsletter, 1, 8–10. Google Scholar | |
|
Raudenbush, S. W., Bryk, A. S. (2002). Hierarchical Linear Models. Applications and data analysis methods. Thousand Oaks, CA: Sage. Google Scholar | |
|
Singer, J. D., Willett, J. B. (2003). Applied longitudinal data analysis: Modeling change and event occurrence. Oxford: Oxford University Press. Google Scholar | Crossref | |
|
Snijders, T., Bosker, R. J. (1994). Modeled variance in two-level models. Sociological Methods & Research, 22, 342–363. Google Scholar | SAGE Journals | |
|
Tranmer, M. (2001). Ignoring a level in a multilevel model: Evidence from UK census data. Environment and Planning, 33, 941–948. Google Scholar | SAGE Journals | |
|
Van den Noortgate, W., Opdenakker, M. C., Onghena, P. (2005). The effects of ignoring a level in multilevel analysis. School Effectiveness and School Improvement, 16, 281–303. Google Scholar | Crossref | |
|
Van Landeghem, G., De Fraine, B., Van Damme, J. (2005). The consequence of ignoring a level of nesting in multilevel analysis: A comment. Multivariate Behavioral Research, 40, 423–434. Google Scholar | Crossref | Medline | |
|
Waller, N. G. (2008). Fungible weights in multiple regression. Psychometika, 73, 691–703. Google Scholar | Crossref |
