Introduction to Latent Class Analysis With Applications

Overview of Cultural Capital

Section:

ChooseTop of pageAbstractOverview of Cultural Capi... <<Data DescriptionApplication: An Illustrat...Loading DataFitting the ModelAssessing Local Independe...Specifying the Number of ...Viewing and Interpreting ...Item Response Probabiliti...Classifying Pupils Into C...How to Interpret the Late...Some Extensions of the LC...Multilevel LCASome Concluding RemarksReferencesCITING ARTICLES

Cultural capital is a sociological LV widely recognized and introduced by Pierre Bourdieu. Bourdieu (1986) distinguished between three types of capital:

1. Economic capital: refers principally to economic resources (cash, assets);

2. Social capital: resources based on group membership, relationships, networks of influence, and support; and

3. Cultural capital: forms of knowledge, skills, education, and advantages that provide a higher status in society. Parents provide their children with cultural capital by transmitting their own attitudes and knowledge needed to succeed in an educational system.

Theorists and researchers in the field of education have paid great attention to the concept of cultural capital due to its positive effect on students’ educational success (see, for example, Cheadle, 2008; Sullivan, 2001; van de Werfhorst & Hofstede, 2007). Cultural capital can be viewed as a multidimensional concept that cannot be measured directly with a single variable. Moreover, how to measure cultural capital in the best way is a questionable issue (Kingston, 2001; Lareau & Weininger, 2003). Early studies focused on indicators of high status culture and possession of cultural objects at home (e.g., paintings, works of art), or participation in cultural events (e.g., art shows, music concerts, museums; Aschaffenburg & Maas, 1997). However, this approach has been criticized for being too narrow (Lareau & Weininger, 2003); consequently, indicators of reading habits, cultural communication, educational resources at home, and extracurricular activities have been taken into account (Covay & Carbonaro, 2010). According to this theoretical perspective, we consider cultural capital for early adolescence as a LV measurable using an LCA.

The following research questions were principally addressed in the example application:

• Research Question 1: Are there classes of early adolescents differently supplied with cultural capital?

• Research Question 2: Is there a latent class structure that adequately represents the heterogeneity in cultural capital endowment among early adolescents?

• Research Question 3: Are some of the observed covariates predictive of individuals’ membership in each class?

Specifically, this article will focus on

1. describing the data used in the analysis (indicator variables and covariates),

2. demonstrating a step-by-step analysis of the data,

3. interpreting the results of a standard LCA application, and

4. introducing a simple example of LCA with covariates.

All procedures will be illustrated using Latent GOLD, but the equivalent SAS and R codes are provided as additional online appendix materials.

Data Description

Section:

ChooseTop of pageAbstractOverview of Cultural Capi...Data Description <<Application: An Illustrat...Loading DataFitting the ModelAssessing Local Independe...Specifying the Number of ...Viewing and Interpreting ...Item Response Probabiliti...Classifying Pupils Into C...How to Interpret the Late...Some Extensions of the LC...Multilevel LCASome Concluding RemarksReferencesCITING ARTICLES

The data considered in the following application came from a 2010 survey administered in Italy to assess the mathematics and reading skills of fifth-grade (10-11 years old) primary school pupils. The data have been provided by the Institute for the Evaluation of the School System (INVALSI). INVALSI annually evaluates the efficiency and effectiveness of the Italian education system as a whole and for individual schools, by assessing the skills and knowledge of students enrolled in both private and public institutions. Presently, INVALSI assesses student achievement at different stages of the educational system: the second and fifth year of the primary school (about ages 7 and 10, respectively); the first and third year of lower secondary school (ages 11 and 13); and the second year of upper secondary school (age 15). The original sample contained nearly 40,000 observations clustered in about 1,400 schools and collected nationwide.¹ For the pedagogical purposes of this article, we randomly selected a subsample of 2,095 pupils considering only records with no missing variables. In that way, no hierarchical structure of data had to be considered in the analysis.

In 2010, the INVALSI survey was administered using two different sources to collect information: the pupil’s biographic form and the pupil’s questionnaire. The pupil’s biographic form was completed by the school staff and gathered information held by the school (e.g., if the student started school 1 year earlier) and some family data that are not asked directly of pupils (e.g., parents’ highest education, parents’ employment status). The pupil’s questionnaire includes binary (correct = 1, incorrect = 0) test items in mathematics (44) and reading (69), as well as information about pupils’ home possessions, family habits, daily reading time, and weekly extracurricular activities. A description of the variables used on the survey and the percentage of observations in each category are summarized in Table 1.

Table 1. Summary of Survey Variables.

Table 1. Summary of Survey Variables.

View larger version

Depending on the responses to the items on the questionnaire, LCA modeling could be useful for identifying possible categories of the latent attribute “cultural capital,” that is, early adolescents will be grouped into classes (the categories of a categorical variable) according to their endowment of that intangible asset.

Application: An Illustrated Example Using Latent GOLD

Section:

ChooseTop of pageAbstractOverview of Cultural Capi...Data DescriptionApplication: An Illustrat... <<Loading DataFitting the ModelAssessing Local Independe...Specifying the Number of ...Viewing and Interpreting ...Item Response Probabiliti...Classifying Pupils Into C...How to Interpret the Late...Some Extensions of the LC...Multilevel LCASome Concluding RemarksReferencesCITING ARTICLES

The first routine to fit a latent class model, maximum likelihood latent structure analysis (MLLSA), was limited to a small number of nominal observed variables. Currently, standard available routines can handle a long list of variables made up of different scale types (nominal, ordinal, discrete, and continuous). For example, the log-linear and event history analysis with missing data using the EM algorithm (LEM) routine (Vermunt, 1997) provides a command language that can be used to specify a large variety of models for categorical data, including LC models. Contrary to these command language driven packages, Latent GOLD provides a Graphical User Interface—GUI (i.e., SPSS-like)—that is especially developed for LCA (for a detailed introduction to Latent GOLD, see Vermunt & Magidson, 2005a, 2005b). It implements a variety of LC models, deals with variables of different scale types, allows multiple covariates to be included and to specify a multilevel model when data are nested with a hierarchy (e.g., pupils within schools).

In this illustrated example, data on fifth-grade pupils will be used to estimate an LC model of cultural capital with Latent GOLD.

Specifically, we demonstrate how to load data, fit standard LC models, explore which models fit the data in the best way, interpret results, and display results graphically. In Online Appendix A, we include instructions to replicate the application using SAS and R.

Loading Data

Section:

ChooseTop of pageAbstractOverview of Cultural Capi...Data DescriptionApplication: An Illustrat...Loading Data <<Fitting the ModelAssessing Local Independe...Specifying the Number of ...Viewing and Interpreting ...Item Response Probabiliti...Classifying Pupils Into C...How to Interpret the Late...Some Extensions of the LC...Multilevel LCASome Concluding RemarksReferencesCITING ARTICLES

Within Latent GOLD, users can easily load data from a variety of input file formats: SPSS data file (filename.sav), ASCII text file (fileneame.dat, filename.csv, or filename.txt), ASCII array (array format) file (filename.arr), and Latent GOLD save file (filename.lgf). For this application, we have prepared an ASCII text file (i.e., put name of file with extension here) named lca_data. To load the data file, go to the menu option and choose File > Open and choose the file type (i.e., text files).

Fitting the Model

Section:

ChooseTop of pageAbstractOverview of Cultural Capi...Data DescriptionApplication: An Illustrat...Loading DataFitting the Model <<Assessing Local Independe...Specifying the Number of ...Viewing and Interpreting ...Item Response Probabiliti...Classifying Pupils Into C...How to Interpret the Late...Some Extensions of the LC...Multilevel LCASome Concluding RemarksReferencesCITING ARTICLES

For our analysis, we use the following 10 items described in Table 1: quietplace, computer, desk, web, ency, books, joyread, sport, cultact, and lang. We use these items because they are related to the LV cultural capital. Table 1 shows the frequencies of these 10 items in the questionnaire, which shows a substantial amount of variability: About two thirds of pupils have a quiet place to study, 78% have a computer available for doing homework, 88% have their own desk, and so on. An important question to ask when inspecting your data is whether there are patterns of responses that occur more frequently than others. To address this question, it is necessary to construct a contingency table considering all 10 items used as observed variables. Each cell of the contingency table is the combination of responses to the 10 items, namely, the response pattern, and contains the frequency (proportion) of pupils who provided a specific response pattern.

Hence, in the present application, the contingency table contains 2,304 cells (as we consider eight dichotomous variables and two variables with three categories, that is, 2⁸ × 3² = 2,304); thus, some cells have zero counts. Bootstrapping methods (Nylund, Asparouhov, & Muthén, 2007) have been proposed in the context of LCA as a way to deal with such “sparsely populated” tables when assessing global fit of the model. To solve this problem, a parametric bootstrapping method may be used by selecting the “bootstrapping chi2” option in the main menu of Latent GOLD (note that in the application shown here, the estimates do not change very much).

The analysis of the response patterns is always a useful screening tool to gain more knowledge of the empirical data (e.g., to assess which response patterns occur most frequently). In this sense, the aim of an LCA is to try to fit a set of latent classes that represents the response patterns in the data, and to provide a sense of the latent class membership. In other words, LCA gives the probability of obtaining a certain response pattern (and a certain value of the categorical variable) for a given individual.

Formally, let j = 1, . . ., J be the observed (manifest) variables with r_j = 1, . . ., R_j the corresponding response categories. Y is the vector of response patterns; y represents a particular response pattern (e.g., for our data set, we have 10 manifest variables, y = no, no, yes, no, yes, none or <10, none or <1 hour, none, none); and C represents the number of latent classes, c = 1, . . . C.

In traditional LC models, two parameters have to be estimated in order to estimate the probability that an individual choose a certain category of a manifest variable:

1. γ_c the probability of membership in latent class c (class membership probabilities);

2. ρ_i|c the probability of response i to item j conditional on membership in latent class c (item response probabilities);

where $I(y_j=r_j)$ is an indicator function that equals 1 when the response to item j = r_j and 0 otherwise. Equation 1 expresses the probability of observing a particular vector of responses as a function of the probabilities of membership in each latent class (γ) and the probabilities of observing each response conditional on latent class membership (ρ). Each unit (individual) is in one and only one class (i.e., the classes are mutually exclusive and exhaustive) such that the sum of the probabilities of membership in each class sum to 1, ${\displaystyle {\sum }_{c=1}^C{\mathrm{\gamma }}_c}=1.$

The parameter ρ expresses the relationship between each item (manifest variable) and each latent class (i.e., item response probabilities indicate how well each individual can be classified into specific latent classes, given their item response values). Sometimes, item response probabilities are called measurement parameters for their usefulness in the measurement of the LV and for the interpretation of the latent classes. Each individual (pupil) provides only one response to each manifest variable j and, consequently, the vector of item response probabilities for a particular manifest variable conditional on a particular latent class sums to 1 (for more technical details on LCA mathematical definitions, see Collins & Lanza, 2010). Ultimately, LC parameters are estimated to characterize each class (i.e., the class profile), the response patterns related to the latent classes, and the size of each class.

When there are missing data, parameter estimates are likely to be biased. Generally, missingness should be handled by modern missing data methods such as maximum likelihood estimation and multiple imputations (Schafer & Graham, 2002). Because LC models are multiple group models where group membership must be inferred from the data, Enders and Gottschall (2011) argued that it is not possible to use any multiple imputation method to preserve group differences in the mean and covariance structure across hidden latent classes. Thus, they recommend treating group membership as a latent class variable in a mixture modeling framework, where a latent class intercept quantifies the relative probability of membership in each class. So, the imputation phase should be carried out using only the manifest variables because the imputation does not have a priori knowledge of class membership. In Latent GOLD, the missing values option allows for the inclusion of records containing missing values on covariates and predictors as well as records containing missing values on the indicators. Including cases with missing values on covariates and predictors causes the mean to be imputed for the scale type numeric and the effect of the missing value category to be equated to zero for the scale type nominal. Missing values on indicators and dependent variables are handled directly in the likelihood function (for details on treatment of missing data in Latent GOLD, see Vermunt & Magidson, 2005 a,b).

Assessing Local Independence

Section:

ChooseTop of pageAbstractOverview of Cultural Capi...Data DescriptionApplication: An Illustrat...Loading DataFitting the ModelAssessing Local Independe... <<Specifying the Number of ...Viewing and Interpreting ...Item Response Probabiliti...Classifying Pupils Into C...How to Interpret the Late...Some Extensions of the LC...Multilevel LCASome Concluding RemarksReferencesCITING ARTICLES

Local independence is the underlying assumption of LVMs (Lazarsfeld & Henry, 1968). Observed items are conditionally independent of each other given that an individual belongs to a certain latent class. Local dependence for a K-class model exists if the model does not fit the data. A diagnostic statistic that measures the extent to which the association between two manifest variables is reproduced by an LC model is given by the bivariate residual (BVR) statistic (Magidson & Vermunt, 2001).

A formal measure of the extent to which the observed association between two variables is reproduced by a model is given by the BVR statistic (Magidson & Vermunt, 2001). Each BVR corresponds to a Pearson χ² statistic (divided by the degrees of freedom) where the observed frequencies in a two-way cross-tabulation of the variables are contrasted with those expected counts estimated under the corresponding LC model. A BVR value substantially larger than 1 suggests that the model falls short of explaining the association in the corresponding two-way table (Magidson & Vermunt, 2004). If it happens, the model may fail in reproducing the relation between variables, and a model with a different number of classes may provide a significant improvement over the fitted model.

To fit an LC model within Latent GOLD, select Cluster from the Menu. Then, the LC Cluster Analysis dialog box opens. For our analysis, we use the 10 variables quietplace, computer, desk, web, ency, books, joyread, sport, cultact, and lang as observed (manifest) variables of the LV cultural capital. Select the 10 variables in the Variables list box and click the Indicators button to put them into the Indicator list box. With the SCAN option, identify each category or value for the item indicator variables. If you double click on any variable, you can view the categories of each indicator and verify the values. After highlighting all 10 variables and right-clicking, select the appropriate scale type (see Screenshot 1 in the supplementary file Online Appendix B).

Specifying the Number of Classes

Section:

ChooseTop of pageAbstractOverview of Cultural Capi...Data DescriptionApplication: An Illustrat...Loading DataFitting the ModelAssessing Local Independe...Specifying the Number of ... <<Viewing and Interpreting ...Item Response Probabiliti...Classifying Pupils Into C...How to Interpret the Late...Some Extensions of the LC...Multilevel LCASome Concluding RemarksReferencesCITING ARTICLES

When conducting an LCA, a major decision in the process of model specification is choosing the number of latent classes to retain. This is done by considering parsimony and the interpretability of the solution (i.e., the labeling and substantive meaning of the latent classes). To determine the number of latent classes, we will estimate different models, each specifying a different number of latent classes. We start with the model with only one class and continue increasing it to determine if the set of available model diagnostics points to a certain number of classes to retain. Based on the model selection diagnostics available in Latent GOLD, we estimated up to four latent classes.

To specify the number of classes estimated in Latent GOLD, go into the Variables tab and in the box titled Clusters (below the Indicators push button), type “1-4” to request the estimation of 1-, 2-, 3-, and 4-class models. Now, click on Estimate (at the right bottom of the analysis dialog box). Table 2 summarizes for each model the following information: log-likelihood, Bayesian information criterion (BIC), Akaike information criterion (AIC), number of estimated parameters, the likelihood ratio χ statistic (L2; one of several statistics that can be used to assess how well the model fits the data), and the model degrees of freedom (df). Model selection in LCA (i.e., the choice of the number of latent classes to retain) is done by analyzing several indices reported in Table 2 and the interpretability of classes. To date, there is no common agreement about what are the best criteria for determining the number of latent classes in mixture models (i.e., the wide class of models to which LCA belongs); this lack of agreement is the most critical drawback in the application of these statistical procedures (Nylund et al., 2007).

Table 2. Summary of Model Results Used for Model Selection.

Table 2. Summary of Model Results Used for Model Selection.

View larger version

By highlighting the data file name in Latent GOLD, a summary of all the models estimated is displayed. Additional statistics can be displayed by clicking on the associated check-box in the Model Summary Display. As shown in Table 2, the column labeled L² indicates the amount of shared association among the variables, which remains unexplained after estimating the model. L² measures the lack of model fit with the lower the value, the better the relative fit of a given model to another model. However, L² may not be reliable when there are large numbers of empty cells or sparse data (Magidson & Vermunt, 2004).

As we want to obtain information on the most appropriate number of classes, to retain and have model fit measures that are reliable in the case of sparse data, we specifically look at the information criteria measured by AIC and BIC. The number of appropriate latent classes was chosen by comparing models in terms of relative fit measures and primarily by interpretability of the latent classes. You can also select the data set file name and right-click for further indices (see Screenshot 2 in supplementary file Online Appendix B).

Based on the results shown in Table 2 and displayed in Figure 1, we chose to retain the model with three latent classes. Specifically, both BIC and AIC worsen as more than three latent classes are extracted from the data, which signifies a possible over-extraction in the number of latent classes in the observed data. Modeling with three latent classes provides the most parsimonious solution, and the solution could be interpreted meaningfully. That is, the three latent classes that underlie cultural capital endowment could be labeled in terms of pupils who are well supplied, moderately supplied, and poorly supplied.

Download

Open in new tab

Download in PowerPoint

Figure 1. Screen plot of BIC value by each model specification.

Note. BIC = Bayesian information criterion; M1 = model with only one class; M2 = model with two classes; M3 = model with three classes; M4 = model with four classes.

In Latent GOLD, the BVRs are provided under the Residuals Tab. In our example, BVRs are larger than 1 for some two-way tables involving “desk” or “books,” which suggest a flaw or weakness in the 3-class solution. Traditionally, when lack of fit is flagged for a given LC solution, it is improved by adding another latent class (Magidson & Vermunt, 2004). When a 4-, or even better, 5-class model is specified, the BVRs are smaller than the 3-class solution. This suggests that the 5-class solution may provide an improvement in fit over the 3-class solution. However, the 5-class solution is more difficult to interpret and not as meaningful as the 3-class solution.

An alternative is to specify a non-traditional LC model; that is, an LC factor model to include more than one LV. LC factor models were proposed as a general alternative to the traditional exploratory LC modeling (see Magidson & Vermunt, 2001, 2004, for more details of LC factor models).

Viewing and Interpreting Results

Section:

ChooseTop of pageAbstractOverview of Cultural Capi...Data DescriptionApplication: An Illustrat...Loading DataFitting the ModelAssessing Local Independe...Specifying the Number of ...Viewing and Interpreting ... <<Item Response Probabiliti...Classifying Pupils Into C...How to Interpret the Late...Some Extensions of the LC...Multilevel LCASome Concluding RemarksReferencesCITING ARTICLES

Next, for the 3-class model, we will assess the statistical significance associated with each variable. Within Latent GOLD, click on (+) from the “3-class” model to display the output, then select Parameters, Profile, and ProbMeans.

Interpreting Parameters

When you click on Parameters, a summary of the Parameter estimates and related statistics is displayed (see Table 3 and Screenshot 3 in the supplementary file Online Appendix B).

Table 3. Estimated Parameters for 3-Classes Model Solution.

Table 3. Estimated Parameters for 3-Classes Model Solution.

View larger version

For each indicator, the p value is shown to be less than .05, indicating that the null hypothesis (i.e., all effects associated with that indicator are zero) should be rejected. Thus, for each indicator, the knowledge of the response of a certain individual to that indicator contributes significantly in discriminating between clusters. The R² values, in the last column of the table, indicate how much of the variance of each indicator is accounted for by this 3-class model. For example, 67.07% of the variance of the variable labeled computer was explained, whereas only the 0.028% of the variance of variable labeled desk was explained. Note that when using the model display menu and right-clicking on the output, other statistics can be displayed in the output tab (e.g., standard errors, z statistics).

Item Response Probabilities

Section:

ChooseTop of pageAbstractOverview of Cultural Capi...Data DescriptionApplication: An Illustrat...Loading DataFitting the ModelAssessing Local Independe...Specifying the Number of ...Viewing and Interpreting ...Item Response Probabiliti... <<Classifying Pupils Into C...How to Interpret the Late...Some Extensions of the LC...Multilevel LCASome Concluding RemarksReferencesCITING ARTICLES

With Profile, we view the parameters re-expressed as item response probabilities. Table 4 reports the Profile results. Overall, Class 1 contains about 57% of pupils, Class 2 contains 27%, and the remaining 16% is in Class 3. The item response probabilities (the γ in Equation 1) show the differences in response patterns that help us distinguish the classes. For example, consider the variable labeled quietplace (i.e., availability of a quiet place to study at home) where the probability to answer “yes” is 0.92 for the first class, 0.84 for the second class, and 0.74 for the third class. Looking at the pattern of responses for all the classes, we get an overall picture of the meaning of the three classes, which helps us to label them appropriately and meaningfully. Generally, pupils in Class 1 are much more likely to respond “yes” to the variables labeled quietplace, computer, desk, web, ency, and books than the other two classes; they speak Italian at home (lang); and have more than 10 books at home.

Table 4. Item Response Probabilities.

Table 4. Item Response Probabilities.

View larger version

Starting with these item response probabilities, we have thus classified pupils into three classes corresponding to groups of pupils that are well, moderately, and poorly supplied with cultural capital. Looking at the two opposite classes, pupils in Class 1 show a response pattern that indicates more intense cultural activities and a larger possession of goods at home. Pupils in Class 2 show a response pattern with low levels in both cultural assets. Finally, pupils in Class 3 have more intense cultural activities than those in Class 2 (sport, cultural activities, and so on), but they have smaller possession of goods at home (a quiet place to study, a computer, etc.). We can also take the results provided in Table 4 and plot item response probabilities. This would be done by having the x-axis representing the items and the y-axis representing the probability to score a certain category to a specific item, given that a pupil belongs to a particular cultural capital class.

To create plots that display the item response probabilities in Latent GOLD, you need to click on Prf-Plot. Figure 2 shows the profile plot for the 3-class model and gives an immediate view of the three classes that are represented as three different lines. Latent GOLD labels the latent classes as Clusters, but we prefer to call them latent classes. The profile for any particular cluster may be highlighted by clicking on the symbol next to any of the three clusters (i.e., Cluster 1, Cluster 2, or Cluster 3) at the bottom of the plot. For example, to highlight the profile for Cluster 3, click on the symbol of Cluster 3. Furthermore, right-clicking on the plot allows you to choose the category of the item. Figures from 2 to 5 report all Profile Plots: (a) All clusters, (b) Cluster 1 versus Cluster 2, (c) Cluster 2 versus Cluster 3, and (c) Cluster 1 versus Cluster 3.

Download

Open in new tab

Download in PowerPoint

Figure 2. Profile plot for all clusters.

Note. The y-axis represents the item response probabilities for Class 1 (labeled Cluster in Latent GOLD), Class 2, and Class 3. The x-axis represents the categories for each variable. The conditional probabilities for variables are displayed and connected to form a line graph.

Download

Open in new tab

Download in PowerPoint

Figure 3. Profile plot for Cluster 1 versus Cluster 2.

Note. The y-axis represents the item response probabilities for Class 1 (labeled Cluster in Latent GOLD), Class 2, and Class 3. The x-axis represents the categories for each variable. The conditional probabilities for variables are displayed and connected to form a line graph.

Download

Open in new tab

Download in PowerPoint

Figure 4. Profile plot for Cluster 2 versus Cluster 3.

Note. The y-axis represents the item response probabilities for Class 1 (labeled Cluster in Latent GOLD), Class 2, and Class 3. The x-axis represents the categories for each variable. The conditional probabilities for variables are displayed and connected to form a line graph.

Download

Open in new tab

Download in PowerPoint

Figure 5. Profile plot for Cluster 1 versus Cluster 3.

Note. The y-axis represents the item response probabilities for Class 1 (labeled Cluster in Latent GOLD), Class 2, and Class 3. The x-axis represents the categories for each variable. The conditional probabilities for variables are displayed and connected to form a line graph.

ProbMeans: Output and Tri-Plot

The ProbMeans output re-sets the parameters in terms of row percentages rather than column percentages (see Screenshot 4). The first row of the table contains the overall probability for any individual included in a specific cluster (the size of each cluster), which is also reported in the first row of numbers in the Profile table (see Screenshot 4 in supplementary file Online Appendix B). Graphically, the probabilities are displayed using the tri-plot (Figure 6).

Download

Open in new tab

Download in PowerPoint

Figure 6. Tri-plot.

Note. Class membership probabilities (ProbMeans in Latent GOLD output) plotted graphically.

The same information provided by ProbMeans can be displayed with the Tri-Plot graphic option in Latent GOLD. This option has the advantage of yielding a barycentric coordinate display of the categories of all indicators, where the vertices of the triangle represent the three clusters. For example, looking at the variable quietplace, 60% of pupils who indicated that they have a quiet place to study are in Cluster 1, while 26% are in Cluster 2, and 14% are in Cluster 3.

Classifying Pupils Into Classes: The Probability of Latent Class Membership

Section:

ChooseTop of pageAbstractOverview of Cultural Capi...Data DescriptionApplication: An Illustrat...Loading DataFitting the ModelAssessing Local Independe...Specifying the Number of ...Viewing and Interpreting ...Item Response Probabiliti...Classifying Pupils Into C... <<How to Interpret the Late...Some Extensions of the LC...Multilevel LCASome Concluding RemarksReferencesCITING ARTICLES

Latent GOLD creates an output file that contains the original data used in the analysis followed by the probability of membership to each latent class (Class 1, Class 2, . . . ). Next, each individual is assigned to the corresponding modal class. In the Output Tab, check the box for Standard Classification. Click on Classification—Posterior to view the Classification Output. Click on Classification on the left of the panel. A snapshot of the output is shown in Figure 4. The first row of the Classification Output shows that four pupils have the following response pattern:

quietplace = computer = desk = web = ency = books = joyread = sport = cultact = lang = 1. These four pupils are classified into Class 2 as the probability of being in this class is the highest (.9689). Under the column labeled modal, we see the label “2” to indicate this classification. Each pupil has to be classified into one of these three mutually exclusive classes so that the probabilities sum up to 1 for each pupil. Furthermore, one important point to note here is that for some pupils, the class membership is well determined. For some pupils, it is a bit more ambiguous, as there is no single class to which they certainly belong.

At this point, we can select Save Results from the main menu and the new data set, containing the old variables and the new five columns (Observed Frequencies, Modal, Cluster 1, Cluster 2, and Cluster 3) will be saved. We can look now at the number of response patterns and number of pupils within each latent class. In Latent Class 1 (Cluster 1), there are 174 response patterns and 1,268 pupils; in Latent Class 2 (Cluster 2), there are 140 and 460, respectively; and in Latent Class 3 (Cluster 3), there are 170 and 367, respectively (see Screenshot 5 in supplementary file Online Appendix B).

How to Interpret the Latent Classes?

Section:

ChooseTop of pageAbstractOverview of Cultural Capi...Data DescriptionApplication: An Illustrat...Loading DataFitting the ModelAssessing Local Independe...Specifying the Number of ...Viewing and Interpreting ...Item Response Probabiliti...Classifying Pupils Into C...How to Interpret the Late... <<Some Extensions of the LC...Multilevel LCASome Concluding RemarksReferencesCITING ARTICLES

We determined that the LCA could group pupils into three latent classes with respect to their cultural capital. We labeled these classes as

1. Well supplied (Latent Class 1, LC1);

2. Moderately supplied (Latent Class 3, LC3); and

3. Poorly supplied (Latent Class 2, LC2).

In particular, pupils in LC1 have more cultural goods at home (the item response probability to answer yes for quietplace, computer, desk, web, and ency is greater than 85%). Pupils classified in LC2 are also well equipped with cultural goods at home. Nevertheless, pupils in LC1 are more involved in cultural activities, as they have greater probabilities to spend more than 1 hour in reading for amusement (joyread), to play at least one sport (sport), or to attend cultural activities (cultact; compared with LC2 and LC3, the item response probability is greater), and they speak Italian at home (lang).

Regarding cultural activities, LC2 and LC3 are quite similar except for sport as pupils in LC3 have a greater probability to play at least one sport (than pupils in LC1). Conversely, LC1 and LC2 are quite similar for cultural goods possession except for ency. The main difference between LC2 and LC3 is with regard to the probability to have resources at home, such as a computer (computer) and Internet connection (web); pupils in LC3 do not have these resources at home.

The 3-latent classes’ solution has been selected not only on the basis of statistics but also in order to better interpret the latent classes. Indeed, if we selected fewer latent classes (e.g., two), we might lose information about the middle category; whereas, choosing more than three classes (e.g., four or five) does not add relevant information about students’ cultural capital supply (rather, we include more parameters in the model).

Finally, we can cross the observed frequencies of pupils in each class with some relevant characteristics about the pupils or their parents. For example, Tables 5 and 6 show, for each class, the observed frequencies of pupils classified by parents’ highest educational level and the residence of pupils. We observe that pupils in LC1 have parents with higher educational levels (high including secondary 65%, tertiary 71%), and mainly live in Central Italy (65%; followed by Northern, 60%; and Southern, 59%).

Table 5. Latent Class Classification and Parents’ Highest Educational Level.

Table 5. Latent Class Classification and Parents’ Highest Educational Level.

View larger version

Table 6. Frequency of Cases Occurring Within Latent Class Classification by Residence Area.

Table 6. Frequency of Cases Occurring Within Latent Class Classification by Residence Area.

View larger version

This step is a post-classification of pupils, to explore if some variable of interest could affect the probability of membership in each latent class and, consequently, if it is reasonable to specify a latent class regression model. The parents’ level of education (see Table 5) seems to be a good predictor of the latent class membership probability.

Some Extensions of the LCA: Adding Covariates

Section:

ChooseTop of pageAbstractOverview of Cultural Capi...Data DescriptionApplication: An Illustrat...Loading DataFitting the ModelAssessing Local Independe...Specifying the Number of ...Viewing and Interpreting ...Item Response Probabiliti...Classifying Pupils Into C...How to Interpret the Late...Some Extensions of the LC... <<Multilevel LCASome Concluding RemarksReferencesCITING ARTICLES

Several extensions have been proposed for the basic LC model. One of the most important is the inclusion of covariates, which predict the LV. In this case, a latent class regression model (LCRM) can be specified. An LCRM (Bandeen-Roche, Miglioretti, Zeger, & Rathouz, 1997; Bouwmeester, Sijtsma, & Vermunt, 2004; Dayton & Macready, 1988; Hagenaars & McCutcheon, 2002; Heijden, Dressens, & Bockenholt, 1996) is a finite mixture model designed to identify a number of categorical classes of a LV on the basis of individual responses to a set of indicator variables. It considers, jointly, the effect of covariates on the probability of belonging to a certain latent class. Thus, covariates can be added into the latent class model to predict the latent class membership probability.

In our application, pupils’ covariates could be introduced in the analysis (e.g., the educational level of the mother/father or the geographical area of pupils’ residence). In this way, LCA classifies pupils into classes according to (a) the probability that a pupil provides a specific response pattern to items and (b) a given vector of covariates.

The probability of class membership is related to the values or levels of the covariates through multinomial logistic regression, where the dependent variable is latent rather than directly observed (Agresti, 2002). When a grouping variable is included in LCA with covariates, the multinomial logistic regression parameters are estimated for each group. As with any regression framework, covariates can be categorical, continuous, or a combination of both. Categorical covariates must be coded as dummy variables in order to preserve their categorical information and estimate the model (in Latent GOLD, this step is not required, as the user specifies at the beginning the scale of measurement of each variable included).

The item response probabilities (ρ parameters) in Equation 1 do not depend on the values or levels of covariates. To express the item response probabilities as function of covariates, Equation 1 changes to the following:

where ${\gamma }_c(\mathrm{x})=P(L=c|X=x)$ is the probability of membership to latent class c given the x value of the X covariate (that is a standard baseline category as in a multinomial logistic model). With a single covariate X, γ_c(x) can be expressed as

where $c^{\prime }=1,\dots ,C-1.$

Model estimation is performed by means of logistic regression with the only difference being that the outcome is latent rather than observed. When covariates are included, not only are the sets of parameters ρ and γ estimated (i.e., the probabilities of observing each response conditional on latent class membership, ρ; and the probability of observing a particular vector of responses as a function of the probabilities of membership in each latent class, γ), but also a set of β parameters are provided, that is, the logistic regression of coefficients for covariates, predicting class membership.

To include a covariate in Latent GOLD, click on the main menu, then cluster, and select the covariate to add in the box labeled covariates in the bottom right. We consider as a covariate the highest parents’ educational level labeled highedu2 (in years) and we re-estimate the 3-class model. Table 7 displays the estimated 3-latent class model with the 10 observed variables and the highest parents’ level of education. To test the effect or importance of the covariate to the 3-class model, we can use the log-likelihood ratio test (LR) by comparing the two log-likelihoods (LL) calculated for the model without covariate to the LL for the model with the covariate. Specifically, LR = −2(−11,308 − [−11,219]) = 178, with 2 df (df = difference between the number of estimated parameters). As the LR test statistic has a χ distribution, we can easily verify (comparing this value with the corresponding value of the chi-square distribution) that it is significant at p < .0001, indicating that parents’ educational level is a significant predictor of the conditional latent class membership.

Table 7. Estimated Parameters 3-Class Model With Highest Parents’ Educational Level as Covariate.

Table 7. Estimated Parameters 3-Class Model With Highest Parents’ Educational Level as Covariate.

View larger version

The probability of membership in LC1 increases as the parents’ education level increases. The opposite occurs for LC2 and LC3, especially for LC2. Pupils whose parents are more educated have a higher chance to be more supplied with cultural capital (i.e., the probability of membership to LC1 increases and, conversely, the probability of membership to LC2 decreases). Figure 7 displays the pattern of class membership based on increasing levels of parents’ education. The inclusion of this covariate provided new response patterns as pupils will now be classified on the account of item responses to the 10 cultural capital items and on parental education (758 response profiles have now been identified; see Screenshot 6 in supplementary file Online Appendix B).

Download

Open in new tab

Download in PowerPoint

Figure 7. Probability of latent class membership of pupils in each of the three classes on the basis of the parents’ highest level of education.

Note. LC = latent class.

Multilevel LCA

Section:

ChooseTop of pageAbstractOverview of Cultural Capi...Data DescriptionApplication: An Illustrat...Loading DataFitting the ModelAssessing Local Independe...Specifying the Number of ...Viewing and Interpreting ...Item Response Probabiliti...Classifying Pupils Into C...How to Interpret the Late...Some Extensions of the LC...Multilevel LCA <<Some Concluding RemarksReferencesCITING ARTICLES

Another important extension is the Multilevel LCA (MLCA) for nested data when observations are not independent (LCA assumes independent observations). The idea underlying MLCA is that the parameters of the regression model may differ across unobserved subgroups (Hagenaars & McCutcheon, 2002; Vermunt, 2003, 2008).

In Latent GOLD (advanced version), the Multilevel Model option can be used to define LC models for nested data (as in the framework of the present application, pupils could have been clustered within classes, and classes within schools; or in other fields, patients nested within hospitals, or citizens nested within regions).

Using our data from Model Menu, select Advanced; next, select Multilevel Model Group ID and then select the second level units. For our data, the second level is the variable labeled “region” (i.e., pupils are clustered into 21 regions of residence). Furthermore, we can select the number of classes for the region. We fit the 3-class model with different numbers of classes of region. Latent GOLD reports the log-likelihood value, the number of estimated parameters, and the BIC and AIC information criteria for the estimated models. Results show that a 3-class Multilevel Model was the most parsimonious model (see Screenshot 7 in supplementary file Online Appendix B). Consequently, when data are nested, it is necessary, preliminarily, to check if group parameters of the regression model may differ across subgroups.

Some Concluding Remarks

Section:

ChooseTop of pageAbstractOverview of Cultural Capi...Data DescriptionApplication: An Illustrat...Loading DataFitting the ModelAssessing Local Independe...Specifying the Number of ...Viewing and Interpreting ...Item Response Probabiliti...Classifying Pupils Into C...How to Interpret the Late...Some Extensions of the LC...Multilevel LCASome Concluding Remarks <<ReferencesCITING ARTICLES

In this article, we have introduced the way in which an LCA can be used in the field of early adolescence. Using a sample of data from a 2010 survey administered in Italy to assess mathematics and reading skills of fifth-grade (10 years old) pupils nationwide, we carried out an LCA with Latent GOLD (SAS and R codes are provided as well in a supplemental file in the online appendix). In this way, pupils were classified into mutually exclusive categories representing different levels of the LV, cultural capital. Ten manifest variables were considered, and on the basis of their item response probabilities and on the value of the latent class membership probability, pupils were classified into three classes. Furthermore, a covariate, parents’ highest education level, was added into the 3-class model and shown to enhance latent class membership probability.

It is hoped that this example application has provided researchers with details on how to use and conduct an LCA when studying a latent phenomenon in the field of early adolescence. In general, LCA is a useful procedure that can be used for classifying pupils based on a single LV and can be extended to multilevel contexts and include covariates.