Abstract
Exponential random graph models (ERGM) have been widely applied in the social sciences in the past 10 years. However, diagnostics for ERGM have lagged behind their use. Collinearity-type problems can emerge without detection when fitting ERGM, yielding inconsistent model estimates and problematizing inference from parameters. This article provides a method to detect multicollinearity in ERGM. It outlines the problem and provides a method to calculate the variance inflation factor (VIF) from ERGM parameters. It then evaluates the method with a Monte Carlo simulation, fitting 216,000 ERGMs and calculating the VIFs for each model. The distribution of VIFs is analyzed using multilevel regression to determine what network characteristics lend themselves to collinearity-type problems. The relationship between VIFs and unstable standard errors (a standard sign of collinearity) is also examined. The method is shown to effectively detect multicollinearity, and guidelines for interpretation are discussed.
References
|
An, Weihua . 2016. “Fitting ERGMs on Big Networks.” Social Science Research 59:107–19. Google Scholar | Medline | |
|
Barabasi, Albert-Laszlo, Albert, Reka. 1999. “Emergence of Scaling in Random Networks.” Science 286:509–12. Google Scholar | Medline | ISI | |
|
Chandrasekhar, Arun G, Jackson, Matthew O.. 2014. “Tractable and Consistent Random Graph Models.” Physics and Society. doi: arXiv:1210.7375v4. Google Scholar | |
|
Chatterjee, Samprit, Price, Bertram. 1991. Regression Analysis by Example. New York: Wiley. Google Scholar | |
|
Faust, Katherine . 2007. “Very Local Structure in Social Networks.” Sociological Methodology 37(1):209–56. Google Scholar | SAGE Journals | ISI | |
|
Fox, John . 2008. Applied Regression Analysis and Generalized Linear Models. Thousand Oaks, CA: Sage. Google Scholar | |
|
Fox, John, Monette, Georges. 1992. “Generalized Collinearity Diagnostics.” Journal of the American Statistical Association 87(417):178–83. Google Scholar | |
|
Frank, Ove, Strauss, David. 1986. “Markov Graphs.” Journal of the American Statistical Association 81:832–42. Google Scholar | ISI | |
|
Geyer, Charles J., Thompson, Elizabeth A.. 1992. “Constrained Monte Carlo Maximum Likelihood for Dependent Data.” Journal of the Royal Statistical Society Series B 54(3):657–99. Google Scholar | |
|
Goodreau, Steven M., Handcock, Mark S., Hunter, David R., Butts, Carter T., Morris, Martina. 2008. “A statnet Tutorial.” Journal of Statistical Software 24(9):1–26. Google Scholar | Medline | |
|
Goodreau, Steven M., Kitts, James A., Morris, Martina. 2009. “Birds of a Feather, or Friend of a Friend? Using Exponential Random Graph Models to Investigate Adolescent Social Networks.” Demography 46(1):103–25. Google Scholar | Medline | ISI | |
|
Hanaki, Nobuyuki, Peterhansl, Alexander, Dodds, Peter S., Watts, Duncan J.. 2007. “Cooperation in Evolving Social Networks.” Management Science 53(7):1036–50. Google Scholar | |
|
Handcock, Mark S. 2003. “Statistical Models for Social Networks: Degeneracy and Inference.” Pp. 229–40 in Dynamic Social Network Modeling and Analysis, edited by Breiger, Ronald, Pattison, Phillipa. Washington, DC: National Academies Press. Google Scholar | |
|
Handcock, Mark S., Hunter, David R., Butts, Carter T., Goodreau, Steven M., Morris, Martina. 2003. Statnet: Software tools for the Statistical Modeling of Network Data. Retrieved May 22, 2017 (http://statnetproject.org). Google Scholar | |
|
Handcock, Mark S., Robins, Garry, Snijders, Tom, Moody, Jim, Besag, Julian. 2003. “Assessing Degeneracy in Statistical Models of Social Networks.” Journal of the American Statistical Association 76:33–50. Google Scholar | |
|
Hanneke, Steve, Fu, Wenjie, Xing, Eric P.. 2010. “Discrete Temporal Models of Social Networks.” Electronic Journal of Statistics 4:585–605. Google Scholar | ISI | |
|
Harrell, Franke E. 2001. Regression Modeling Strategies with Application to Linear Models, Logistic Regression, and Survival Analysis. New York: Springer-Verlag. Google Scholar | |
|
Harris, Jenine K. 2014. An Introduction to Exponential Random Graph Modeling. Thousand Oaks, CA: Sage. Google Scholar | |
|
Hipp, John R., Butts, Carter T., Acton, Ryan, Nagle, Nicholas N., Boessen, Adam. 2013. “Extrapolative Simulation of Neighborhood Networks Based on Population Spatial Distribution: Do they Predict Crime?” Social Networks 35:614–25. Google Scholar | |
|
Holland, Paul W., Leinhardt, Samuel. 1981. “An Exponential Family of Probability Distributions for Directed Graphs.” Journal of the American Statistical Association 76(737):33–50. Google Scholar | |
|
Hunter, David R . 2007. “Curved Exponential Family Models for Social Networks.” Social Networks 29(2):216–30. Google Scholar | Medline | ISI | |
|
Hunter, David R., Goodreau, Steven M., Handcock, Mark S.. 2008. “Goodness of Fit of Social Network Models.” Journal of the American Statistical Association 103(481):248–58. Google Scholar | ISI | |
|
Hyojoung, Kim, Bearman, Peter S.. 1997. “The Structure and Dynamics of Movement Participation.” American Sociological Review 62(1):70–93. Google Scholar | |
|
Koskinen, Johan, Snijders, Tom A. B.. 2013. “Simulation, Estimation, and Goodness of Fit.” Pp. 141–66 in Exponential Random Graph Models for Social Networks: Theory Methods and Applications, edited by Lusher, Dean, Koskinen, Johan, Robins, Garry. Cambridge, England: Cambridge University Press. Google Scholar | |
|
Kreager, Derek A., Young, Jacob T. N., Haynie, Dana L., Bouchard, Martin, Schaefer, David R., Zajac, Gary. 2017. “Where ‘Old Heads’ Prevail: Inmate Hierarchy in a Men’s Prison Unit.” American Sociological Review 82(4):685–718. Google Scholar | SAGE Journals | ISI | |
|
Krivitsky, Pavel N., Handcock, Mark S.. 2014. “A separable model for dynamic networks.” Journal of the Royal Statistical Society B 76(1):29–46. Google Scholar | |
|
Levy, Michael . 2016. “ERGM Tutorial.” Retrieved October 11, 2017 (http://michaellevy.name/blog/ERGM-tutorial/). Google Scholar | |
|
Lusher, Dean, Koskinen, Johan, Robins, Garry. 2013. Exponential Random Graph Models for Social Networks: Theory, Methods, and Applications. Cambridge, England: Cambridge Press. Google Scholar | |
|
Mooney, Christopher Z. 1997. Monte Carlo Simulation. Thousand Oaks, CA: Sage. Google Scholar | |
|
Newman, Mark E. J . 2002. “Assortative Mixing in Networks.” Physical Review Letters 89:208701. Google Scholar | Medline | ISI | |
|
Newman, Mark E. J., Strogatz, Steven H., Watts, Duncan J.. 2001. “Random Graphs with Arbitrary Degree Distributions.” Phyiscal Reviews E 64:026118. Google Scholar | Medline | ISI | |
|
O’Brien, Robert M. 2007. “A Caution Regarding Rules of Thumb for Variance Inflation Factors.” Quality and Quantity 41:673–90. Google Scholar | ISI | |
|
O’Malley, James A., Onnela, Jukka-Pekka. 2014. “Topics in Social Network Analysis and Network Science.” Physics and Society. doi: arXiv:1404.0067v1. Google Scholar | |
|
Padgett, John F., Ansell, Christopher K.. 1993. “Robust Action and the Rise of the Medici, 1400-1434.” American Journal of Sociology 98(6):1259–319. Google Scholar | ISI | |
|
Papachristos, Andrew V. 2009. “Murder by Structure: Dominance Relations and the Social Structure of Gang Homicide.” American Journal of Sociology 115(1):74–128. Google Scholar | Medline | ISI | |
|
Papachristos, Andrew V., Hureau, David, Braga, Anthony. 2013. “The Corner and the Crew: The Influence of Geography and Social Networks on Gang Violence.” American Sociological Review 78(3):417–47. Google Scholar | SAGE Journals | ISI | |
|
Rencher, Alvin C. 2002. Methods of Multivariate Analysis. 2nd ed. Hoboken, NJ: John Wiley. Google Scholar | |
|
Ripley, Ruth M., Snijders, Tom A. B., Boda, Zsofia, Voros, Andras, Preciado, Paulina. 2017. Manual for RSiena. Retrieved May 22, 2017 (https://www.stats.ox.ac.uk/∼snijders/siena/RSiena_Manual.pdf). Google Scholar | |
|
Robins, Garry, Pattison, Pip, Kalish, Yuval, Lusher, Dean. 2007. “An Introduction to Exponential Random Graph (p*) Models for Social Networks.” Social Networks 29(2):173–91. Google Scholar | ISI | |
|
Salter-Townshend, Michael, Murphy, Thomas Brendan. 2015. “Role Analysis in Networks using Mixtures of Exponential Random Graph Models.” Journal of Computational Graph Statistics 24(2):520–38. Google Scholar | Medline | |
|
Shore, Jesse, Lubin, Benjamin. 2015. “Spectral Goodness of fit for Network Models.” Social Networks 43:16–27. Google Scholar | |
|
Snijders, Tom A. B . 2002. “Markov Chain Monte Carlo Estimation of Exponential Random Graph Models.” Journal of Social Structure 3(2):1–40. Google Scholar | |
|
Snijders, Tom A. B., Bosker, Roel J.. [1999] 2008. Multilevel Analysis: An Introduction to Basic and Advanced Multilevel Modeling. 3rd ed. London, England: Sage. Google Scholar | |
|
Snijders, Tom A. B., Pattison, Phillipa E., Robins, Garry L., Handcock, Mark S.. 2006. “New Specifications for Exponential Random Graph Models.” Sociological Methodology 36(1):99–153. Google Scholar | SAGE Journals | ISI | |
|
Snijders, Tom A. B., van de Bunt, Gerhard G., Steglich, Christian E. G.. 2010. “Introduction to Actor-based Models for Network Dynamics.” Social Networks 32:44–60. Google Scholar | ISI | |
|
Steglich, Christian, Snijders, Tom A. B., Pearson, Michael. 2010. “Dynamic Networks and Behavior: Separating Selection from Influence.” Sociological Methodology 40(1):329–93. Google Scholar | SAGE Journals | ISI | |
|
Watts, Duncan J., Strogatz, Steven H.. 1998. “Collective Dynamics of ‘Small-world’ Networks.” Nature 393:440–42. Google Scholar | Medline | ISI | |
|
Wimmer, Andreas, Lewis, Kevin. 2010. “Beyond and Below Racial Homophily: ERG Models of a Friendship Network Documented on Facebook.” American Journal Sociology 116(2):583–642. Google Scholar | Medline | ISI |
