- Department of Psychology, The Ohio State University, Columbus, OH, United States
The combination of network modeling and psychometric models has opened up exciting directions of research. However, there has been confusion surrounding differences among network models, graphic models, latent variable models and their applications in psychology. In this paper, I attempt to remedy this gap by briefly introducing latent variable network models and their recent integrations with psychometric models to psychometricians and applied psychologists. Following this introduction, I summarize developments under network psychometrics and show how graphical models under this framework can be distinguished from other network models. Every model is introduced using unified notations, and all methods are accompanied by available R packages inducive to further independent learning.
1. Introduction
Networks represent relationships or edges among a group of entities (we will call nodes), which, depending on the context, can be individuals, cells, countries, railway stations, and ecological species. Systems resembling a network are abundant with examples such as the World Wide Web, power grid systems, cell networks, economical networks, and social networks. The most commonly studied networks in behavioral science perhaps are social networks. Social networks can arise in various contexts including follower-followee relationships in online platforms, coauthorship among scientists, and friendships formed at schools.
Statistical modeling of networks has emerged as a major topic of interest, with a growing number of books and survey papers across disciplines (e.g., Wasserman and Faust, 1994; Newman, 2003; Goldenberg et al., 2010; Snijders, 2011; Vivar and Banks, 2012; Matias and Robin, 2014; Sweet, 2016; Desmarais and Cranmer, 2017; Kim et al., 2018; Smith et al., 2019; Zhang et al., 2020; Sosa and Buitrago, 2021). Existing surveys cover a broad range of topics including processes occurring on networks, exponential random graph models (ERGMs), stochastic actor oriented models (SAOMs), and latent variable network models, e.g., latent space models (LSM) and stochastic blockmodels (SBM).
A latent variable is not directly observed, but inferred from observed variables. A latent variable can be used to reduce the complexity of information by providing a parsimonious description of a multitude of noisy and often high-dimensional observations. This benefit of latent variables has been seen in a variety of settings, including factor analysis, item response theory (Spearman, 1904; Harman, 1976; van der Linden and Hambleton, 1997), and more recently, in network modeling (Snijders, 1996; Hoff et al., 2002). The key benefit of latent variables in network modeling is to capture various forms of dependencies or associations between a pair of persons or a group of persons. Conditional on latent variables, some form of independence can be assumed in the error term (Henry, 2014), which largely simplifies the model. In educational and psychological studies, latent variables are also used to model abstract concepts such as depression, extraversion, and intelligence. I refer readers to Bollen (2002) for a further discussion on the use of latent variables in psychology.
With the rising popularity of network modeling, there has been rapid growth in research works that incorporate latent variable network models with psychometric models. Given the rather new status of this type of research, to the best of my knowledge, there has not been any attempt to document the progress in the integrations of latent variable network models with psychometric models such as item response models, structural equation models, and factor analysis. Therefore, in this paper, I outline key developments bridging network latent variable models with psychometric models, summarize their connections with network models as well as psychometric models and point out directions for future research.
The paper is organized as follows. I first introduce network modeling using discrete and continuous latent variables, i.e., stochastic blockmodels and latent space models. I divide latent space models into two categories following models' latent effects, whether the latent effect is based on Euclidean distances or vector products. I then describe integrative frameworks motivated by latent variable network models and psychometric models. In section 4, I summarize model developments under the popular network psychometrics framework and provide key distinctions of this framework from the current topic. In section 5, I present a diagram summarizing relationships of all models and point out current gaps in research and possible future directions.
2. Latent Variable Network Modeling
In this section, I first describe network modeling using discrete latent variables, namely stochastic blockmodels. Then, I introduce two categories of network models with continuous latent variables: (i) distance models that are built on Euclidean distances between two nodes, and (ii) vector models that are built on vector products between two nodes. The reasoning behind this categorization is two-fold. First, these two categories represent two distinct ways of modeling information in a network and result in two distinct ways of interpreting latent spaces. Second, there are many models under each of these two categories that would be difficult to keep track of if this categorization was not made.
The purpose of discussing latent variable network modeling is two-fold. First, despite many efforts surveying network models, a detailed introduction of latent variable network models to behavioral scientists is still lacking. By providing a comprehensive survey of latent variable network models using unified notations and terminologies, I hope to provide an introductory tool for psychologists from substantive as well as methodological backgrounds to delve deeper into this topic. Second, in the next section, it can be seen that among many available options for latent variable network models, only one or two are chosen by psychologists. Therefore, I hope to encourage a more diverse integration of network models with psychometric models by providing a comprehensive discussion of latent variable network models.
2.1. Stochastic Blockmodels
In this section, I summarize the posteriori blockmodeling of networks introduced by Snijders and Nowicki (1997) and Nowicki and Snijders (2001). In the stochastic blockmodels, the probability of a connection between two nodes depends on their block (group) memberships. Suppose there is a network written as an adjacency matrix:
where xa,b represents the presence of an edge (binary network) or the degree of association (weighted network) between nodes a and b, a, b = 1, …, N and b ≠ a1, and N is the total number of nodes. Let us define the discrete latent variable ua as the latent block membership for node a, ua ∈ 1, 2, …, K, where K is the total number of blocks or groups. Conditional on the latent variable, the probability of two nodes forming an edge is independent of all the other edges in the network:
where mua, ub is the probability of a connection between the corresponding blocks. SBMs can be used to identify equivalent nodes in a network based on their relationships with other nodes (structural equivalence) as members of the same group share the same patterns of relationships. Stochastic blockmodels can be fitted using the CIDnetworks package with MCMC algorithms (Adhikari et al., 2015) and the blockmodels package using variational inference (Leger, 2015), among others (e.g., Brusco et al., 2020; Chiquet et al., 2021).
However, the assumption that the probability of shared connections between nodes is dependent on their membership to a single block may be too restrictive. Airoldi et al. (2008) proposes an extension of SBMs, called the mixed membership stochastic blockmodels, to allow nodes to belong to multiple groups with varying affiliation probabilities. SBMs have also been extended to accommodate differences in nodal degrees (total number of edges a node has to other nodes) (e.g., Karrer and Newman, 2011), to model network evolution across time (e.g., Xing et al., 2010; Yang et al., 2011; Xu and Hero, 2014; Matias and Miele, 2017) and to model multiple types of relationships among the same set of nodes (e.g., Paul et al., 2016; Barbillon et al., 2017; Paul and Chen, 2020) and among different types of nodes (e.g., Sengupta and Chen, 2015; Huang et al., 2020).
2.2. Distance Models
A latent space is a hypothetical multidimensional space that represents the positions of nodes in a lower dimensional space. The position of nodes in the lower dimensional space reflects the geometric rules of the latent distance model. The idea of a latent space for network modeling is first seen in Hoff et al. (2002), where a vector of length K, u is used to represent the position of a node in a K-dimensional latent space. Conditional on the latent positions, the probability of two nodes forming an edge is independent of all the other edges in the network:
where U is a K × N matrix consisting of latent positions, and Z, β include the covariates and their coefficients.
In this section, I review network modeling with continuous latent variables following the categorization of distance vs. vector models. In a vector model, the vector product between two nodes is included, thus the vector length and the angle between two vectors both drive the interpretation of the latent space. In a distance model, the Euclidean distance between two nodes is included, thus the magnitude of the distance drives the interpretation of the latent space. The smaller the Euclidean distance, the more likely that the two nodes form a connection.
2.2.1. Latent Distance Model
The probability of an edge between two nodes depends on their Euclidean distance given covariates (Hoff et al., 2002):
where α is the intercept; g(·) is the link function. Most commonly, X is binary; g(ϕa,b) is the logistic inverse link functions, i.e., . Other link functions for the latent distance model are available in the latentnet package (Krivitsky and Handcock, 2008).
The latent distance model has been extended to allow built-in clustering, called the latent position cluster model (Handcock et al., 2007), to accommodate nodes' varying degrees of sociability and popularity, called the latent cluster random effects model (Krivitsky et al., 2009), to model multi-layer networks (Gollini and Murphy, 2016; Salter-Townshend and McCormick, 2017; Zhang et al., 2020), and to model network's changes across time (Sarkar and Moore, 2005; Sewell and Chen, 2015). The latent distance model can be fitted using the latentnet package with MCMC algorithms. For large datasets, the latent distance model can be fitted using the lvm4net package with variational inference (Gollini, 2014).
2.3. Vector Models
2.3.1. Latent Projection Model
The earliest form of vector network model appears in Hoff et al. (2002), called the latent projection model:
In the projection model, the angle between two latent vectors and the length of vector ua affect two nodes' probability to connect. When looking at a latent space formed by the latent projection model, one can assess nodes' propensity to form edges by looking at vectors' directions, with opposite directions () indicating aversion to edge formation, similar directions () indicating favorable edge formation, and perpendicular relations () indicating independence. The probability of a connection from node a to node b is differently modeled than the probability of a connection from node b to node a.
2.3.2. Bilinear Mixed-Effects Model
Hoff (2005) proposed a generalized bilinear mixed-effects model that can be seen as an extension of the latent projection model with a modified latent effect:
where aa is the random sender (initiator of a connection) effect, bb is the random receiver (receiver of a connection) effect, and Σγ represents the within dyad (a pair of nodes) dependence. Higher reciprocity means that the receiver of a connection is more likely to reciprocate the friendly gesture by the sender. Across the row of the social network, differences in nodes' sociability are accounted for by aa; and, across columns, differences in nodes' popularity are accounted for by bb. Dependencies occurring in a group of three nodes or more include transitivity, balance and clusterability; they are accounted for by the vector product . We refer readers to Wasserman and Faust (1994) and Hoff (2008) for further discussions about these dependencies.
2.3.3. Additive and Multiplicative Effects Model
The additive and multiplicative effects (AME) model is proposed in Minhas et al. (2019) and Hoff (2021).
where is the multiplicative effect modeling dependencies involving triads of nodes. Models with a different multiplicative effect () are sometimes called eigenmodels or latent factor models (see Hoff, 2008; Minhas et al., 2019). Another similar but different multiplicative effect can be seen in Hoff (2021) without the diagonal matrix D, which allows different latent dimensions to exert different effects on the probabilities to connect. Other parameters of the AME model follow those of the bilinear mixed-effects model. The AME model can be fitted using the AMEN package (Hoff et al., 2020).
The bilinear mixed-effects model and AME model are extensions of the latent projection model. According to Hoff (2008), the multiplicative effect in the eigen model, uTDu, generalizes the latent class effect in stochastic blockmodels and the latent distance effect in latent distance models. Sosa and Buitrago (2021) show that the eigen model has better out of sample predictive accuracy for networks with varying properties and structures compared to the latent class and distance models. We refer readers to Smith et al. (2019) and Sosa and Buitrago (2021) for further discussions on vector models vs. distance models.
In addition to latent spaces defined by Euclidean distances and vector products, Schweinberger and Snijders (2003) proposes an ultrametric space, where nodes are assigned to a system of nested groups. A negatively curved hyperbolic space has been proposed by Krioukov et al. (2010). The radius of the hyperbolic space grows exponentially rather than linearly, as in Euclidean distance space. A hyperbolic space is more suitable for networks with tree-like structures (see Krioukov et al., 2010; Smith et al., 2019).
3. Introducing Latent Variable Network Modeling to Psychometric Models
Recent research has seen a surge of developments integrating network models with psychometric models such as structural equation models and item response models. In this section, I summarize some of these efforts.
3.1. Doubly Latent Space Joint Model
Jin and Jeon (2019) proposes the doubly latent space joint model (DLSJM) that applies the latent space model framework to item responses. The DLSJM separates the information about items and persons in the item response matrix, Y into two sets of sociomatrices V = {V1, V2, …VN} and U = {U1, U2, …UM}, where N is the total number of persons, and M is the total number of items. I will use subscripts p and j as person indices and subscripts a and b as item indices.
This transformation is a projection of the item response matrix, seen as a bipartite network, into sets of relationship sociomatrices that record the similarity of items and the commonality of persons. In network terms, this transformation relies on the duality of bipartite networks, the transfer of information between connections within nodes of type A, connections within nodes of type B and connections between nodes of type A and nodes of type B.
After transformation, DLSJM models the commonality of persons as a network and estimates latent positions of persons p and j following the latent distance model:
where zp and zj are latent positions for persons p and j; fa(z) and fb(z) are functions of D-dimensional latent person positions served as latent positions of items. Latent item positions are defined as averages of positive responses weighted by latent person positions, or alternatively speaking, averages of latent person positions for whom the responses are positive. A hierarchical extension of the DLSJM is proposed by Jin et al. (2018) to accommodate variations across different schools.
Following latent distance model and latent space joint model (Gollini and Murphy, 2016), DLSJM takes on similar model assumptions. In DLSJM, sociomatrices V and U are conditionally independent given latent person positions. Furthermore, information collected for person i in the form of pairwise similarities of all items are assumed to be conditionally independent to similar information collected for person j. Information collected for item a in the form of commonalities of all persons are also assumed to be conditionally independent to similar information collected for item b.
3.2. Latent Space Item Response Model
Jeon et al. (2021) proposes a latent space item response model, which applies a latent distance model with random intercepts to an item response matrix. For a binary item response matrix Y, the expectation of a correct response for person p to item i is as follows:
where , , , , log , , and D is the number of dimensions. Following notations in the previous sections, I use up to denote the latent position of person p and vi to denote the latent position of item i. The authors use random effects αp and βi to account for differences in the overall scores of persons and in the sum scores of items.
Compared with DLSJM, the latent space item response model analyzes item responses instead of first transforming item responses. Compared to Rasch models with random item effects, it adds a Euclidean-distance latent effect to capture deviations from the random intercepts. The added Euclidean-distance latent effect also allows visualizations of the item and person nodes in a hypothetical latent space. As a network model, latent space item response model can be seen as a bipartite latent space model, first developed in the latentnet package (Krivitsky and Handcock, 2008). Unlike the bipartite latent space model, the latent space item response model adds a γ coefficient in front of the Euclidean-distance latent effect, allowing varying degrees of contribution by the Euclidean-distance effect to the probability of a connection.
Latent space item response model can be fitted using the latentnet package with the assumption of γ = −1. For large-scale datasets, a variational algorithm for bipartite latent space model is proposed by Wang et al. (2021), which can be applied using the jlsm package (Wang, 2021). The bipartite latent space model has also been extended to model networks across multiple time points by Sarkar and Moore (2005) and Friel et al. (2016).
3.3. Social Network Structural Equation Model
Liu et al. (2018) proposes social network structural equation model that integrates latent distance model with structural equation model. Different from the previous two methods, the social network structural equation model analyzes both a network dataset and an item response matrix with the goal of estimating their dependence or association. Following previous notations, I will use X to denote the social network, Y to denote the item response matrix and Z to denote covariates. The model is estimated in two separate steps. First, item responses are fitted to a confirmatory factor model (measurement model):
where yp is a vector of length M representing person p's scores on M items (indicators); ηp represents a vector of D latent variables, ηp ~ MVN(0, Φ); Λ is the M × D factor loading matrix; and ϵp is the unexplained residual, ϵp ~ MVN(0, Ψ). In the second step, the factor scores from the first step are fitted as covariates of the social network model (structural model):
where α is the intercept; ha,b is the manifest nodal covariate between nodes a and b2; and ηa and ηb are the factor scores obtained from the measurement model. Coefficients β and γ estimate the effects of the manifest covariates and the Mahalanobis distances of the latent factors, respectively. In the structural model, the friendship connection is explained by manifest covariates as well as factor scores extracted from the measurement model. The measurement model can be fitted using the lavvan package (Rosseel, 2012), and the structural model can be fitted as a logistic regression.
Extensions of the social network structural equation model are proposed as social network mediation analysis, where the latent position is first extracted from the social network following latent distance model (Liu et al., 2021) and eigenmodel (Che et al., 2021), and subsequently fitted as a mediator in a regression analysis. The latent positions can be estimated using the latentnet package (Krivitsky and Handcock, 2008), the Eigenmodel package (Hoff, 2012), or the AMEN package (Hoff, 2015). Social networks have been fitted as regression mediators in the hierarchical network model (HNM) for mediation, proposed by Sweet (2019). In HNM for mediation, a network statistic is used to summarize the entire network and then fitted as the mediator in a regression model. Different from social network mediation analysis, the network model and the mediation model in HNM for mediation are simultaneously estimated instead of in two steps.
3.4. Joint Latent Space Model
Wang et al. (2021) proposes a joint latent space model (JLSM) to jointly analyze social network and item responses. Using a joint modeling approach, the authors model social network and item responses stemming from a shared data generation process. I use ua to denote latent position of person a and vi to denote latent position of attribute i.
where , , and are unknown parameters. To model the connection between persons a and b, the authors use the (squared) Euclidean distance3 between latent positions ua and ub. To model whether person p possesses attribute i, the authors use the Euclidean distance between latent positions up and vi. The dependence between social network and item responses is modeled by the shared latent variable U.
JLSM4 extends the latent space joint model proposed by Gollini and Murphy (2016), and both use a shared latent variable to model the dependence between different networks. The JLSM can be applied using the jlsm package (Wang, 2021).
4. Network Psychometrics
Although not a framework for modeling networks, network psychometrics has gain wide-spread popularity in various disciplines of psychology (e.g., Cramer et al., 2012; Fried et al., 2015; McNally et al., 2015; van Borkulo et al., 2015; Dalege et al., 2016; Isvoranu et al., 2016; Kossakowski et al., 2016) with a mission to contend the common-cause interpretation of latent variables with a web (network) of connected variables. Whether the contention is fair or a matter of incomplete perception (see Fried and Cramer, 2017; Bringmann and Eronen, 2018), it has paved the way for the introduction of network modeling to psychology. For this reason, we provide a summary of current developments under network psychometrics, and we offer a few key distinctions of this framework from the current discussion.
Graphical models are proposed under network psychometrics to analyze multivariate datasets including item responses. Each variable is conceptualized as a node in the network, and the presence of conditional dependence between variables is constructed as an edge between two nodes. In graphical models, the network is no longer the observed (social) network, but constructed based on correlations between observed variables. The gaussian graphical model (GGM) constructs edges between variables based on their partial correlations. Suppose we observe P multivariate normal variables, yj, j = 1, 2, …, P:
where wjk is the weight of the edge between nodes j and k. Compared with latent variable models such as structural equation model, GGM considers correlations between observed variables as the data generating process instead of outcomes of shared latent variables.
In Marsman et al. (2018), it is shown that the Ising model is statistically equivalent to the item response model such that we can expect the same model fit when both are applied to the same data. By proving this equivalence, Marsman et al. (2018) provides an alternative framework for understanding abstract psychological phenomena such as depression. The co-occurrence of disorder symptoms can be hypothesized as stemming from correlated observed variables instead of a shared latent variable. This alternative view has broad applications in various sub-fields of psychology.
In latent network modeling, Epskamp et al. (2017) combines graphical models with latent variable models by allowing latent variables (or their residuals, seen in residual network modeling) to be modeled as a correlated network. Epskamp (2020) extends GGM to model observations across time, called graphical vector autoregressive model. Yang et al. (2014) and Chen et al. (2015) propose mixed graphical models to accommodate situations, where distributions of variables, conditional on other variables, have different exponential family forms. I refer readers to Epskamp et al. (2017), Epskamp (2020), and Altenbuchinger et al. (2020) for comprehensive discussions of graphical models under network psychometrics. These graphical models can be implemented using the qgraph package (Epskamp et al., 2012); and a review of related statistical software can be seen in Haslbeck and Waldorp (2015).
Compared with network models introduced in the previous sections, graphical models under network psychometrics possess a few key distinctions. First, these models are not meant for analyzing networks, instead they create a network representation of variables based on correlations. Second, as a psychological framework, network psychometrics presents an alternative way to conceptualize psychological phenomena, which is not the case for network modeling. It argues for a network of correlated observed variables as the true data generating process instead of shared latent variables. Furthermore, network models are distinct from other analytic methods because networks are distinct from other types of data including multivariate datasets. The assumption of independence does not apply in a network as it does in a multivariate dataset because the association between persons is part of the modeling interest. In fact, dependencies in a network are often complex and are not yet well-defined. For these reasons, network modeling, as a discipline, is often not covered in quantitative courses, and multivariate models are not applicable for network datasets.
5. Summary and Directions for Future Research
Studies on network modeling and psychometrics may be divided into many lines of research, such as dynamic vs. static modeling and Bayesian vs. frequentist inference. In this paper, I focus on the integration of latent variable network modeling with psychometric models. When analyzing a network, latent variables are used to model network dependencies (e.g., associations between a pair of nodes or a group of nodes) and to construct low-dimensional geometric spaces, which are useful for visualization. In psychometric models, latent variables can be used to simplify model specification and provide statistical representation of abstract latent constructs. From these, I outline recent efforts integrating latent variable network models with psychometric models. To conclude, I provide a diagram (see Figure 1) outlining relationships of methods discussed in sections 2, 3, and 4. Psychometric models and network models are in the left and the right of the diagram. Presence of a link represents the integration of the two methods that motivate the development of the new framework at the center.
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/773289/fpsyg-12-773289-HTML/image_m/fpsyg-12-773289-g001.jpg)
Figure 1. Diagram summarizing the relationship between psychometric models and network models5. Double-headed arrows indicate integrations of two frameworks with the resulting framework at the center.
Despite recent efforts integrating latent variable network models with psychometric models, there remain several challenges. While viewing item response data as a bipartite network opens doors for new possibilities, further research is needed to understand the implications of this equivalence. In a network, the assumption of independence between persons is violated as dependencies between them are the drivers of a connected network, and the goal of network modeling is to analyze and understand such dependencies. Meanwhile, the independence assumption is traditionally applied in an item response matrix, which makes applying network modeling to item responses problematic. This is not necessarily the case though. If respondents of a survey come from the same school or reside in the same geographic region, it is reasonable to assume dependence between them given the nonzero likelihood of their prior engagement. If we assume dependence between persons in an item response matrix, what are its implications?
To fully take into account potential dependence between respondents of an item response matrix, it is preferential to have observations of respondents' relationships in addition to their attributes. To model the dependence between networks and individual attributes, we can incorporate individual attributes as nodal or edge covariates in network modeling, e.g., in stochastic blockmodels (Sweet, 2015; Mele et al., 2019) and in latent space models (Hoff et al., 2002; Krivitsky and Handcock, 2008; Austin et al., 2013; Fosdick and Hoff, 2015). Alternatively, we can apply social influence models and regard individual attributes as the dependent variable and estimate the effects of the social network on attributes. (Dorans and Drasgow, 1978; Robins et al., 2001; Leenders, 2002; Frank et al., 2004; Fujimoto et al., 2013; Sweet and Adhikari, 2020). The situation is more complicated when individual attributes are multivariate or multidimensional such as the item responses. The social network structural equation model regards item responses as the dependent variable in the first step, and then models the social network as the dependent variable in the second step. The joint latent space approach simultaneously models the social network and item responses as the dependent variables. Both pose as interesting directions of research, but improvements are also possible.
Latent variable network modeling has the potential to be further integrated in educational and psychological research. Through this paper, we hope to inspire readers to begin incorporating some of these methods to their current analysis plans and develop new methods filling in existing research gaps and answering new research questions. Despite the novelty of these models, we have included information about the R packages available for network models as well as the integrative methods in order to facilitate further independent learning.
Author Contributions
The author confirms being the sole contributor of this work and has approved it for publication.
Conflict of Interest
The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Footnotes
1. ^Ties from a node to itself are rarely considered. Diagonal entries can be written as 0 though they are omitted from the analysis.
2. ^Elements of hab are transformation of the nodal covariates.
3. ^The squared Euclidean distances are shown to result in similar latent positions as Euclidean distances while maintaining computational efficiency by Gollini and Murphy (2016).
4. ^An earlier version of this model can be seen in Wang (2019), where an ensemble of item response matrices was modeled through a shared attribute similarity matrix, and the vector-product latent effect was used instead of the Euclidean distance in modeling the item responses.
5. ^JLSM: A earlier version of JLSM contains the vector product latent effect (Wang, 2019).
References
Adhikari, S., Dabbs, B., Junker, B., Sadinle, M., Sweet, T., and Thomas, A (2015). Cidnetworks: Generative Models for Complex Networks With Conditionally Independent Dyadic Structure. R Package Version 0.8.
Airoldi, E. M., Blei, D. M., Fienberg, S. E., and Xing, E. P (2008). Mixed membership stochastic blockmodels. J. Mach. Learn. Res. 9, 1981–2014.
Altenbuchinger, M., Weihs, A., Quackenbush, J., Grabe, H. J., and Zacharias, H. U (2020). Gaussian and mixed graphical models as (multi-) omics data analysis tools. Biochim. Biophys. Acta 1863:194418. doi: 10.1016/j.bbagrm.2019.194418
Austin, A., Linkletter, C., and Wu, Z (2013). Covariate-defined latent space random effects model. Soc. Netw. 35, 338–346. doi: 10.1016/j.socnet.2013.03.005
Barbillon, P., Donnet, S., Lazega, E., and Bar-Hen, A (2017). Stochastic block models for multiplex networks: an application to a multilevel network of researchers. J. R. Stat. Soc. Ser. A 180, 295–314. doi: 10.1111/rssa.12193
Bollen, K. A. (2002). Latent variables in psychology and the social sciences. Annu. Rev. Psychol. 53, 605–634. doi: 10.1146/annurev.psych.53.100901.135239
Bringmann, L. F., and Eronen, M. I (2018). Don't blame the model: Reconsidering the network approach to psychopathology. Psychol. Rev. 125:606. doi: 10.1037/rev0000108
Che, C., Jin, I. H., and Zhang, Z (2021). Network mediation analysis using model-based eigenvalue decomposition. Struct. Equat. Model. 28, 148–161. doi: 10.1080/10705511.2020.1721292
Chen, S., Witten, D. M., and Shojaie, A (2015). Selection and estimation for mixed graphical models. Biometrika 102, 47–64. doi: 10.1093/biomet/asu051
Chiquet, J., Donnet, S., and Barbillon, P (2021). sbm: Stochastic Blockmodels. R package version 0.4.0–9100.
Cramer, A. O., Van der Sluis, S., Noordhof, A., Wichers, M., Geschwind, N., Aggen, S. H., et al. (2012). Dimensions of normal personality as networks in search of equilibrium: you can't like parties if you don't like people. Eur. J. Pers. 26, 414–431. doi: 10.1002/per.1866
Dalege, J., Borsboom, D., van Harreveld, F., van den Berg, H., Conner, M., and van der Maas, H. L (2016). Toward a formalized account of attitudes: the casual attitude network (can) model. Psychol. Rev. 123:2. doi: 10.1037/a0039802
Desmarais, B. A., and Cranmer, S. J (2017). Statistical Inference in Political Networks Research. Oxford: Oxford University Press. doi: 10.1093/oxfordhb/9780190228217.013.8
Dorans, N., and Drasgow, F (1978). Alternative weighting schemes for linear prediction. Organ. Behav. Hum. Perform. 21, 316–345. doi: 10.1016/0030-5073(78)90057-0
Epskamp, S. (2020). Psychometric network models from time-series and panel data. Psychometrika 1–26. doi: 10.1007/s11336-020-09697-3
Epskamp, S., Cramer, A. O., Waldorp, L. J., Schmittmann, V. D., Borsboom, D., et al. (2012). Qgraph: Network visualizations of relationships in psychometric data. J. Stat. Softw. 48, 1–18. doi: 10.18637/jss.v048.i04
Epskamp, S., Rhemtulla, M., and Borsboom, D (2017). Generalized network psychometrics: combining network and latent variable models. Psychometrika 82, 904–927. doi: 10.1007/s11336-017-9557-x
Fosdick, B. K., and Hoff, P. D (2015). Testing and modeling dependencies between a network and nodal attributes. J. Am. Stat. Assoc. 110, 1047–1056. doi: 10.1080/01621459.2015.1008697
Frank, K. A., Zhao, Y., and Borman, K (2004). Social capital and the diffusion of innovations within organizations: the case of computer technology in schools. Sociol. Educ. 77, 148–171. doi: 10.1177/003804070407700203
Fried, E. I., Bockting, C., Arjadi, R., Borsboom, D., Amshoff, M., Cramer, A. O., et al. (2015). From loss to loneliness: the relationship between bereavement and depressive symptoms. J. Abnorm. Psychol. 124:256. doi: 10.1037/abn0000028
Fried, E. I., and Cramer, A. O (2017). Moving forward: challenges and directions for psychopathological network theory and methodology. Perspect. Psychol. Sci. 12, 999–1020. doi: 10.1177/1745691617705892
Friel, N., Rastelli, R., Wyse, J., and Raftery, A. E (2016). Interlocking directorates in Irish companies using a latent space model for bipartite networks. Proc. Natl. Acad. Sci. U.S.A. 113, 6629–6634. doi: 10.1073/pnas.1606295113
Fujimoto, K., Wang, P., and Valente, T. W (2013). The decomposed affiliation exposure model: a network approach to segregating peer influences from crowds and organized sports. Netw. Sci. 1, 154–169. doi: 10.1017/nws.2013.7
Goldenberg, A., Zheng, A. X., Fienberg, S. E., and Airoldi, E. M (2010). A survey of statistical network models. Found. Trends Mach. Learn. 2, 129–233. doi: 10.1561/2200000005
Gollini, I. (2014). lvm4net: Latent Variable Models for Networks. R package Version 0.1. Available online at: http://cran.r-project.org/web/packages/lvm4net/
Gollini, I., and Murphy, T. B (2016). Joint modeling of multiple network views. J. Comput. Graph. Stat. 25, 246–265. doi: 10.1080/10618600.2014.978006
Handcock, M. S., Raftery, A. E., and Tantrum, J. M (2007). Model-based clustering for social networks. J. R. Stat. Soc. Ser. A 170, 301–354. doi: 10.1111/j.1467-985X.2007.00471.x
Haslbeck, J., and Waldorp, L. J (2015). MGM: estimating time-varying mixed graphical models in high-dimensional data. arXiv preprint arXiv:1510.06871. Available online at: http://arxiv.org/abs/1510.06871
Henry, N. W. (2014). Latent Structure Analysis. Wiley StatsRef: Statistics Reference Online. doi: 10.1002/9781118445112.stat02466
Hoff, P. (2008). “Modeling homophily and stochastic equivalence in symmetric relational data,” in Advances in Neural Information Processing Systems, Vol. 20, eds J. Platt, D. Koller, and S. Roweis (Cambridge, MA: MIT Press), 657–664.
Hoff, P. (2012). Eigenmodel: Semiparametric Factor and Regression Models for Symmetric Relational Data. R Package Version 1.01, Vienna: R Foundation for Statistical Computing.
Hoff, P. (2021). Additive and multiplicative effects network models. Stat. Sci. 36, 34–50. doi: 10.1214/19-STS757
Hoff, P. D. (2005). Bilinear mixed-effects models for dyadic data. J. Am. Stat. Assoc. 100, 286–295. doi: 10.1198/016214504000001015
Hoff, P. D. (2015). Dyadic data analysis with amen. arXiv preprint arXiv:1506.08237. Available online at: https://arxiv.org/abs/1506.08237
Hoff, P. D., Fosdick, B., Volfovsky, A., and He, Y (2020). AMEN: Additive and Multiplicative Effects Models for Networks and Relational Data. R Package Version 1.3. Available online at: https://CRAN.R-project.org/package=amen
Hoff, P. D., Raftery, A. E., and Handcock, M. S (2002). Latent space approaches to social network analysis. J. Am. Stat. Assoc. 97, 1090–1098. doi: 10.1198/016214502388618906
Huang, W., Liu, Y., and Chen, Y (2020). Mixed membership stochastic blockmodels for heterogeneous networks. Bayesian Anal. 15, 711–736. doi: 10.1214/19-BA1163
Isvoranu, A.-M., Borsboom, D., van Os, J., and Guloksuz, S (2016). A network approach to environmental impact in psychotic disorder: brief theoretical framework. Schizophr. Bull. 42, 870–873. doi: 10.1093/schbul/sbw049
Jeon, M., Jin, I. H., Schweinberger, M., and Baugh, S (2021). Mapping unobserved item-respondent interactions: a latent space item response model with interaction map. Psychometrika 2, 1–26. doi: 10.1007/s11336-021-09762-5
Jin, I. H., and Jeon, M (2019). A doubly latent space joint model for local item and person dependence in the analysis of item response data. Psychometrika 84, 236–260. doi: 10.1007/s11336-018-9630-0
Jin, I. H., Jeon, M., Schweinberger, M., and Lin, L (2018). Hierarchical Network Item Response Modeling for Discovering Differences Between Innovation and Regular School Systems in Korea. Available online at: arxiv.org/abs/1810.07876
Karrer, B., and Newman, M. E (2011). Stochastic blockmodels and community structure in networks. Phys. Rev. E 83:016107. doi: 10.1103/PhysRevE.83.016107
Kim, B., Lee, K. H., Xue, L., and Niu, X (2018). A review of dynamic network models with latent variables. Stat. Surveys 12:105. doi: 10.1214/18-SS121
Kossakowski, J. J., Epskamp, S., Kieffer, J. M., van Borkulo, C. D., Rhemtulla, M., and Borsboom, D (2016). The application of a network approach to health-related quality of life (HRQoL): introducing a new method for assessing HRQoL in healthy adults and cancer patients. Qual. Life Res. 25, 781–792. doi: 10.1007/s11136-015-1127-z
Krioukov, D., Papadopoulos, F., Kitsak, M., Vahdat, A., and Boguná, M (2010). Hyperbolic geometry of complex networks. Phys. Rev. E 82:036106. doi: 10.1103/PhysRevE.82.036106
Krivitsky, P. N., and Handcock, M. S (2008). Fitting position latent cluster models for social networks with latentnet. J. Stat. Softw. 24:5. doi: 10.18637/jss.v024.i05
Krivitsky, P. N., Handcock, M. S., Raftery, A. E., and Hoff, P. D (2009). Representing degree distributions, clustering, and homophily in social networks with latent cluster random effects models. Soc. Netw. 31, 204–213. doi: 10.1016/j.socnet.2009.04.001
Leenders, R. T. A. (2002). Modeling social influence through network autocorrelation: constructing the weight matrix. Soc. Netw. 24, 21–47. doi: 10.1016/S0378-8733(01)00049-1
Leger, J. B. (2015). blockmodels: Latent and Stochastic Block Model Estimation by a “V-EM” Algorithm. Available online at: http://CRAN.R-project.org/packageblockmodels
Liu, H., Jin, I. H., and Zhang, Z (2018). Structural equation modeling of social networks: specification, estimation, and application. Multivariate Behav. Res. 53, 714–730. doi: 10.1080/00273171.2018.1479629
Liu, H., Jin, I. H., Zhang, Z., and Yuan, Y (2021). Social network mediation analysis: a latent space approach. Psychometrika 86, 272–298. doi: 10.1007/s11336-020-09736-z
Marsman, M., Borsboom, D., Kruis, J., Epskamp, S., van Bork, R., Waldorp, L., et al. (2018). An introduction to network psychometrics: relating ising network models to item response theory models. Multivar. Behav. Res. 53, 15–35. doi: 10.1080/00273171.2017.1379379
Matias, C., and Miele, V (2017). Statistical clustering of temporal networks through a dynamic stochastic block model. J. R. Stat. Soc. 79, 1119–1141. doi: 10.1111/rssb.12200
Matias, C., and Robin, S (2014). Modeling heterogeneity in random graphs through latent space models: a selective review. ESAIM Proc. Surveys 47, 55–74. doi: 10.1051/proc/201447004
McNally, R. J., Robinaugh, D. J., Wu, G. W., Wang, L., Deserno, M. K., and Borsboom, D (2015). Mental disorders as causal systems: a network approach to posttraumatic stress disorder. Clin. Psychol. Sci. 3, 836–849. doi: 10.1177/2167702614553230
Mele, A., Hao, L., Cape, J., and Priebe, C. E (2019). Spectral inference for large stochastic blockmodels with nodal covariates. arXiv preprint arXiv:1908.06438. doi: 10.2139/ssrn.3438987
Minhas, S., Hoff, P. D., and Ward, M. D (2019). Inferential approaches for network analysis: AMEN for latent factor models. Polit. Anal. 27, 208–222. doi: 10.1017/pan.2018.50
Newman, M. E. (2003). The structure and function of complex networks. SIAM Rev. 45, 167–256. doi: 10.1137/S003614450342480
Nowicki, K., and Snijders, T. A. B (2001). Estimation and prediction for stochastic blockstructures. J. Am. Stat. Assoc. 96, 1077–1087. doi: 10.1198/016214501753208735
Paul, S., and Chen, Y (2016). Consistent community detection in multi-relational data through restricted multi-layer stochastic blockmodel. Electron. J. Stat. 10, 3807–3870. doi: 10.1214/16-EJS1211
Paul, S., and Chen, Y (2020). Spectral and matrix factorization methods for consistent community detection in multi-layer networks. Ann. Stat. 48, 230–250. doi: 10.1214/18-AOS1800
Robins, G., Pattison, P., and Elliott, P (2001). Network models for social influence processes. Psychometrika 66, 161–189. doi: 10.1007/BF02294834
Rosseel, Y. (2012). Lavaan: an R package for structural equation modeling and more. Version 0.5-12 (beta). J. Stat. Softw. 48, 1–36. doi: 10.18637/jss.v048.i02
Salter-Townshend, M., and McCormick, T. H (2017). Latent space models for multiview network data. Ann. Appl. Stat. 11:1217. doi: 10.1214/16-AOAS955
Sarkar, P., and Moore, A. W (2005). Dynamic social network analysis using latent space models. ACM SIGKDD Explor. Newslett. 7, 31–40. doi: 10.1145/1117454.1117459
Schweinberger, M., and Snijders, T. A (2003). Settings in social networks: a measurement model. Sociol. Methodol. 33, 307–341. doi: 10.1111/j.0081-1750.2003.00134.x
Sengupta, S., and Chen, Y (2015). Spectral clustering in heterogeneous networks. Stat. Sin. 1081–1106. doi: 10.5705/ss.2013.231
Sewell, D. K., and Chen, Y (2015). Latent space models for dynamic networks. J. Am. Stat. Assoc. 110, 1646–1657. doi: 10.1080/01621459.2014.988214
Smith, A. L., Asta, D. M., and Calder, C. A (2019). The geometry of continuous latent space models for network data. Stat. Sci. 34:428. doi: 10.1214/19-STS702
Snijders, T. A. (1996). Stochastic actor-oriented models for network change. J. Math. Sociol. 21, 149–172. doi: 10.1080/0022250X.1996.9990178
Snijders, T. A. (2011). Statistical models for social networks. Annu. Rev. Sociol. 37, 131–153. doi: 10.1146/annurev.soc.012809.102709
Snijders, T. A., and Nowicki, K (1997). Estimation and prediction for stochastic blockmodels for graphs with latent block structure. J. Classif. 14, 75–100. doi: 10.1007/s003579900004
Sosa, J., and Buitrago, L (2021). A review of latent space models for social networks. Rev. Colomb. de Estadíst. 44, 171–200. doi: 10.15446/rce.v44n1.89369
Spearman, C. (1904). “general intelligence”, objectively determined and measured. Am. J. Psychol. 15, 201–293. doi: 10.2307/1412107
Sweet, T., and Adhikari, S (2020). A latent space network model for social influence. Psychometrika 1–24. doi: 10.1007/s11336-020-09700-x
Sweet, T. M. (2015). Incorporating covariates into stochastic blockmodels. J. Educ. Behav. Stat. 40, 635–664. doi: 10.3102/1076998615606110
Sweet, T. M. (2016). Social network methods for the educational and psychological sciences. Educ. Psychol. 51, 381–394. doi: 10.1080/00461520.2016.1208093
Sweet, T. M. (2019). Modeling social networks as mediators: a mixed membership stochastic blockmodel for mediation. J. Educ. Behav. Stat. 44, 210–240. doi: 10.3102/1076998618814255
van Borkulo, C., Boschloo, L., Borsboom, D., Penninx, B. W., Waldorp, L. J., and Schoevers, R. A (2015). Association of symptom network structure with the course of depression. JAMA Psychiatry 72, 1219–1226. doi: 10.1001/jamapsychiatry.2015.2079
van der Linen, W. J., and Hambleton, R. K., (eds.). (1997). Handbook of Modern Item Response Theory. New York, NY: Springer.
Vivar, J. C., and Banks, D (2012). Models for networks: a cross-disciplinary science. Wiley Interdisc. Rev. 4, 13–27. doi: 10.1002/wics.184
Wang, S. (2019). Joint analysis of social and item response networks with latent space models (M.S. thesis). The Ohio State University, Columbus, OH, United States.
Wang, S. (2021). jlsm: Joint Latent Space Model for Social Networks and Attributes. R Package Version 1. Available online at: https://CRAN.R-project.org/package=jlsm
Wang, S. S., Paul, S., and De Boeck, P (2021). Joint latent space model for social networks with multivariate attributes. arXiv preprint arXiv:1910.12128v2.
Wasserman, S., and Faust, K (1994). Social Network Analysis: Methods and Applications, Vol. 8. Cambridge: Cambridge University Press. doi: 10.1017/CBO9780511815478
Xing, E. P., Fu, W., and Song, L (2010). A state-space mixed membership blockmodel for dynamic network tomography. Ann. Appl. Stat. 535–566. doi: 10.1214/09-AOAS311
Xu, K. S., and Hero, A. O (2014). Dynamic stochastic blockmodels for time-evolving social networks. IEEE J. Selec. Top. Signal Process. 8, 552–562. doi: 10.1109/JSTSP.2014.2310294
Yang, E., Baker, Y., Ravikumar, P., Allen, G., and Liu, Z (2014). “Mixed graphical models via exponential families,” in Artificial Intelligence and Statistics, 1042–1050.
Keywords: network analysis, psychometrics, network psychometrics, latent space models, item response models, latent space item response models, joint latent space models
Citation: Wang S (2021) Recent Integrations of Latent Variable Network Modeling With Psychometric Models. Front. Psychol. 12:773289. doi: 10.3389/fpsyg.2021.773289
Received: 09 September 2021; Accepted: 04 October 2021;
Published: 09 December 2021.
Edited by:
Alessandro Giuliani, National Institute of Health (ISS), ItalyReviewed by:
Lorenzo Farina, Sapienza University of Rome, ItalySandra Morelli, National Institute of Health (ISS), Italy
Copyright © 2021 Wang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Selena Wang, wang.10171@osu.edu