Skip to main content

ORIGINAL RESEARCH article

Front. Sustain., 29 August 2024
Sec. Modeling and Optimization for Decision Support

Mapping causal networks from theories of change in sustainability projects: a software co-design process

  • 1Laboratorio Nacional de Ciencias de la Sostenibilidad [LANCIS], Instituto de Ecología [IE], Universidad Nacional Autónoma de México [UNAM], Mexico City, Mexico
  • 2Redes por la Diversidad, Equidad y Sustentabilidad, A.C., Cuetzalan, Mexico
  • 3School of Geosciences, University of Edinburgh, Edinburgh, United Kingdom
  • 4Independent Consultant, Bogotá, Colombia
  • 5Posgrado en Ciencias de la Sostenibilidad, Instituto de Ecología [IE], Universidad Nacional Autónoma de México [UNAM], Mexico City, Mexico
  • 6Departamento de Ciencias de la Computación, Instituto Tecnológico Autónomo de México [ITAM], Mexico City, Mexico
  • 7Independent Consultant, Xalapa, Mexico

Envisioning trajectories towards sustainability encompasses enacting significant changes in multiple spheres (i.e., infrastructure, policy, practices, behaviors). These changes unfold within the intricate landscapes of wicked problems, where diverse perspectives and potential solutions intersect and often clash. Advancing more equitable and sustainable trajectories demands recognition of and collaboration with diverse voices to uncover meaningful synergies among groups striving to catalyze substantial change. Projects of this nature necessitate the exploration of varied tools and methodologies to elicit, convey, and integrate ideas effectively. Creating spaces for reflexivity is essential for catalyzing more meaningful impact as individuals engage in discussions aimed at sharing and questioning the coherence of their projects while forging synergies, identifying common objectives, and planning long-term outcomes. We present the initial phase of an endeavor in which we developed a software that elicits causal networks based on mapping relations between projects’ actions and outcomes. To illustrate our approach, we describe the results of using this software within collaborative workshops with groups spearheading projects initiated by a government entity in Mexico City. By adapting elements of the Theory of Change model, this software transcends the dominant linear project logic by guiding participants in designing causation networks that unveil how different projects can articulate to identify potential common elements and find new possibilities for coordination among initiatives. We discuss the potential of such software application as a dynamic tool to guide and promote reflection and coherence when crafting projects that aim to more meaningfully address sustainability problems.

1 Introduction

Designing and enacting trajectories towards sustainability entails articulating significant structural changes (i.e., transformative change Dupuis et al., 2023; Scoones et al., 2020) in infrastructure, policy, practices, and behavior (O’Brien, 2018). As these changes occur in entangled contexts of wicked problems (Rittel and Webber, 1973), diverse framings and potential “solutions” are always contested and influenced by many factors such as dominant interests and power asymmetries (Turnhout et al., 2020). Thus, promoting more equitable and sustainable trajectories necessitates working from and with diversity (in contexts, struggles, interests, positionalities, agendas, etc.), and to explicitly acknowledge that engaging with such plurality is the basis for finding more meaningful synergies between individuals or groups committed to catalyzing more significant changes (Caniglia et al., 2021).

Collaborative endeavors aimed at addressing sustainability problems entail engaging with the complex task of sharing, eliciting, and understanding how individuals differently frame the challenge at stake and the proposed strategies to address it (Charli-Joseph et al., 2023). Such different ways of framing an issue are determined by individual’s particular interests, beliefs, values, life history, social relations, political orientation, etc. Thus, creating and implementing sustainability projects requires facilitating caring and respectful collaborative processes that can enable reflexive dialogues to understand different framings while co-constructing a common language and collective agreements. There are many efforts inspired by methodological approaches, conceptual frameworks, or particular experiences that seek to integrate diverse types of knowledge, interests, and needs into projects aimed at achieving significant impact towards sustainability (e.g., Participatory Action Research-Fals Borda et al., 2006, transdisciplinary co-production of knowledge Chambers et al., 2021, iterative learning spaces for reflection and engagement Binder et al., 2015). For instance, the Theory of Change framework is a dialogue-based process intended to generate a description of a sequence of events expected to lead to a particular desired outcome, with concrete impacts that are assessed through diverse indicators (Vogel, 2012). Generally, this process is depicted in a linear diagram where pre-conditions, inputs or requirements, activities or interventions, assumptions, outputs, outcomes, and impacts are captured.

However, there is still a need to enable spaces within a project process to reflect on how to co-design strategies for building alliances, implementing actions for addressing challenges at stake, and creating mechanisms to evaluate more intangible foreseen outcomes (Sol et al., 2018). Moreover, as the formation of intersectoral teams is often sudden and responds to urgent needs and/or circumstantial situations, many projects lack a coherent methodological design and clear planning of the participatory process and its different engagement phases and evaluation mechanisms (Merçon et al., 2018).

Enabling iterative processes to reflect on how change might happen and what influence is possible in specific contexts is a fundamental ingredient to collectively guide planned initiatives or projects, and adapt them according to emergent conditions and diverse needs and interests (Marshall et al., 2021). Ultimately, the importance of reflexivity in driving change (Dieleman, 2008) underscores the need to further develop innovative mechanisms that foster more meaningful engagement within projects focused on achieving lasting impacts towards sustainability.

In this paper, we present how we adapted components of the classical Theory of Change framework to develop a software that maps out causal relations between projects’ actions and potential effects, or outcomes. The development of this software is dedicated to practitioners and project proponents in sustainability science and related subjects who want to reflect on the assembly of the machinery of a particular project or projects. This article is structured as follows: In Section 2 we present conceptual elements that inform our approach; Section 3 describes our methodological approach for designing, developing and testing the software; and Section 4 and 5 present and discuss the results and lessons learned; finally, we conclude the paper in Section 6.

2 From Theory of Change to causation networks

Theory of Change (ToC) is a framework or model originated as a theory-based approach to assess the impact of social programs (Oberlack et al., 2019). ToC are mental representations and theoretical assumptions that explain how and why the activities of an initiative (project, program, organization) generate particular changes (Mason and Barnes, 2007). Approaches such as “planning theory” used to address social policy problems (Rittel and Webber, 1973) and “theory-based evaluation” (Weiss, 1997; Chen, 2015) formed the theoretical foundations for the ToC approach. However, Carol Weiss was the first to describe the value of evaluating any theory-based program in 1972 (Maru et al., 2018).

The ToC framework, although initially applied as a planning and evaluation tool for social projects, has evolved over several decades, expanding its scope to encompass sustainability initiatives. This approach generates both ex-ante and ex-post models to anticipate outcomes or retrospectively analyze outcomes and changes (Mayne, 2015). In the context of sustainability projects, this framework has garnered significant attention and has been used to monitor and evaluate interventions, programs, and projects’ processes. This heightened interest stems from the need to provide tangible evidence of impacts facilitated by the sequential nature of the process, which allows for the documentation of progress between activities and change trajectories delineation (Mayne, 2017).

Although the ToC model remains widely popular (Vogel, 2012; Mayne, 2015; Mayne, 2017; Reinholz and Andrews, 2020), its evolution has been prompted by the recognition of a fundamental weakness: its inherent linearity (Abercrombie et al., 2018). Numerous scholars point out that instead of following a linear sequence of events, ToC models can also exhibit a network-like behavior. This critical insight is extensively explored by Murphy (2021), highlighting the issue of oversimplification within traditional ToC frameworks, typically presented as linear logical constructs. Other authors, such as Alford (2017), have similarly critiqued this oversimplification, drawing attention to the limitations of conventional ToC models and advocating for the inclusion of recurrent causal loop diagrams to incorporate feedback mechanisms.

In response to the above-mentioned limitations of ToC, Systemic Theory of Change (SToC) has been proposed to allow a comprehensive representation where structures can be nested, more intricate arrangements can be formed, and multiple projects can interconnect. Conceived by Murphy and Jones (2020, 2021) and Aragón and Giles Macedo (2010), this approach offers a framework to navigate the interconnections and interdependencies within sustainability endeavors, facilitating a more holistic understanding of their dynamics and envisioned impacts. The essence of this approach is mapping the structure elicited by SToC into a complex network structure.

The science of complex networks has provided novel perspectives and analytical tools to study various kinds of systems (Sayama, 2015). In particular, network science has been a strategy for the analysis of complex systems as networks can better capture the complexity of a system and can be constructed from actual data. Complex network analysis enables the identification of recurrent causal loops, levels of dependency, feedback between nodes and other attributes of the system. Salient features of a network, such as nodes with high degrees of connectivity or high betweenness centrality, warrant further analysis to assist identifying potential deeper leverage points for promoting change (Leydesdorff, 2007; Lee et al., 2021). There are well documented examples such as the world wide web, ecological networks, or movie-actor collaboration networks in which key actors (nodes) are drivers of system-wide behavior (Albert, 2002).

Therefore, we posit that a software that incorporates certain elements of the Theory of Change framework but developed with a systemic-network approach able to assist reflecting and designing a more coherent nonlinear project rationale, while also allowing articulating several projects to elicit potential convergences and gaps, might have the potential to contribute to more meaningfully addressing urgent sustainability challenges. These conceptual elements inspired the development of the first version of a software we describe in the following section.

3 Methodological approach and co-construction process

The development of our software application was grounded in principles of the Theory of Change framework, and integrating foundational elements of causal networks. The ultimate aim of this software was to enhance the interconnectivity of sustainability projects by embracing a more systemic and complex perspective.

The overall process consisted of three phases: 1) development of software prototype; 2) participatory spaces, and 3) software piloting. We describe these phases in the following subsections.

3.1 Co-construction of software prototype

The initial phase, carried out during 2022, involved coding the software. We selected the framework described by Mayne (2015) to serve as the basis for our code. In 2023, we continued to refine and expand the software.

We designed a data model inspired by the directed graphs used to visualize causality in ToC. In this model a list of triads of state-connection-state-also known as an edgelist-represent change. It corresponds to the “if-then-because” logic of ToC. Figure 1 shows an entity-relationship diagram of our data model.

Figure 1
www.frontiersin.org

Figure 1. Entity-relationship diagram of our data model. Boxes represent tables and the lists they contain describe their columns. Lines represent relationships in the data.

Elements of the project identified as states are nodes. We defined them using nouns such as “an information system,” “empowered communities,” “public policy,” etc. They can be tagged by type (social, biophysical, infrastructure, etc.) and can be located temporally and/or spatially. Nodes can be used to define initial states which correspond to problem statements or serve to define short, medium or long-term goals. Furthermore, they can describe shared objectives beyond project boundaries meaning that project designers and implementers are able to connect states outside the scope of their project activities, which could also be addressed. In this way, projects can be represented in a larger network of understanding.

Connections, also known as edges, represent causation that leads one state into another. They can stand for activities or simply pose causal relationships among states. Connections can include spatial data and temporal types (i.e., short, mid, long-term). Once nodes and edges are input to the software application, they become a useful computer model. They can be displayed as a network or exported in GraphML format for further analysis and visualization in other programs. Directed networks can be created from a subset of a project’s edgelist, or from a set that includes more than one project.

3.2 Participatory spaces

A fundamental element of our approach involved engaging with groups of individuals that were implementing sustainability projects (independently of their initial or more mature stages) to both reflect on its progress and to facilitate interactions to test it. Thus, and having identified a window of opportunity that emerged from an ongoing project collaboration between our team and the Mexico City Secretariat of Education, Science, Technology and Innovation (SECTEI for its Spanish acronym Secretaría de Educación, Ciencia, Tecnología e Innovación de la Ciudad de México) that funds sustainability projects within Mexico City, we approached four project teams and invited them to be part of a series of participatory spaces designed to test and reflect on the software architecture and potential functions. We received a positive response from the four projects’ teams. The titles and main objective of each project were the following: 1) Agroecosystems design for sustainable food production— aimed at fostering local agricultural production to reduce impacts on conservation land; 2) Agroecological sustainability laboratory—aimed at developing innovative collaborative networks that enable agroecology for different purposes related to health, food, social inclusion and education; 3) Chinampera school—aimed at rehabilitating an agro-food system in the chinampas of the Xochimilco urban wetland; and, 4) Laboratory for sustainable soil management and compost evaluation—aimed at improving soil quality through better quality compost and the substitution of chemical fertilizers. All four projects were part of the Food Safety Laboratories Network (LABSA for its Spanish acronym Red de Laboratorios en Seguridad Alimentaria).

Once we had these four projects on-board, and with the developed conceptual prototype for the software architecture, we embarked on a process to collectively reflect on the prototype and receive feedback to further develop the software using the four projects. The participatory spaces were designed to engage with the projects’ coordinators and teams to gain insights into their project objectives, outcomes, and goals. The process consisted of two stages:

S0—First approach: a comprehensive questionnaire was designed to collect information about the projects and how they were connected to SECTEI main goal. This questionnaire was sent to the projects’ coordinators, and consisted of three sections: 1) information and context about the project, 2) information about the contribution of their project to the “Suelo de Conservación” (conservation land policy) of Mexico City, and 3) information about the importance of belonging to the LABSA network. A total of fifteen questions served to understand the projects and this information also helped to prepare the following workshops held in May 2023.

S1—construction of the Theory of Change per project: two workshops were held in May 2023 with representatives from four LABSA’s projects. The workshops aimed to co-construct each project’s ToC. Guided by a facilitator, each project’s team/coordinator indicated the overall goal(s) of their project and reflected on the following questions: a) What changes should occur in the system to achieve the project’s goal(s)?; b) Where, and what kind of changes must occur considering the following categories: social networks, landscape and biophysical changes, governance systems, behavioral changes and new capabilities?; and, c) Which of these changes might contribute to SECTEI general goal?

The next step was to write down these changes on cards according to the following categories: a) social relations; b) landscape/biophysical; c) governance systems; d) behavioral changes or new capacities (see Figure 2). Categories are based on Meadows (2015) and O’Brien (2018) work. The categories are more profound concepts to trigger changes discussed in the above-mentioned research. They can leverage the social, environmental or economic systems mainly analyzed in sustainability projects. The intention is to reflect on aspects that could generate paradigm shifts more systemically. These cards were arranged along a timeline where T1 corresponded to the present, T2 and T3 the mid-term, T4 and T5 to the long term where the SECTEI’s goal was located. Once the cards/changes were positioned along the timeline, the project’s team/coordinators were asked to connect them using arrows to form a causal sequence. The scale of each change (local–L, regional–R, or statewide–S) was also indicated when identified.

Figure 2
www.frontiersin.org

Figure 2. Theory of Change process. A Theory of Change was constructed for each project. A timeline with four points was used (T1, T2, T3, and T4), where the long-term institutional goal of SECTEI was captured at the end of the line. Each project builds its ToC starting in retrospect, from the project’s general goal reflecting on the needed changes to achieve the goal. The four categories of change (C) were: a) social relations in pink; b) landscape/biophysical in green; c) governance systems in blue; d) behavioral changes or new capacities in yellow. Also, the scales of the changes were marked when identified.

3.3 Piloting our software application

Drawing from the rich reflections that emerged in the participatory spaces with the LABSA network group, we piloted the software using real data from the four projects by generating causal networks for each project. Afterwards, data was curated, standardizing titles’ states that were similar among the projects. This step was crucial when constructing the meta-network that included the four projects. In that way, it was possible to identify the states in which different projects could find a synergy.

The development of the software is open to collaboration through a public repository hosted at https://codeberg.org/LANCIS-UNAM/prisma/.

4 Insights from piloting the software

After the interaction with the LABSA network, four networks were generated, one per project (see Figure 3A as an example of a co-produced Theory of Change network; the other three can be found in the Supplementary material). During the two workshops, participants discussed their ideas and scopes of the project’s main goal, and labels were generated consensually. The space allowed the co-creation of changes that participants recognized they had not thought of individually. The temporality helped to arrange the cards and activities developed within the project. The creation of a collaborative change network yielded reflections that the members had not considered before working as a group, even though the projects were already underway (for example in the Chinampera School project, they visualized the amount of work needed to have the percentage of Chinampas implemented to achieve their goal).

Figure 3
www.frontiersin.org

Figure 3. (A) Theory of Change network co-produced with project coordinators. This figure is the Agroecosystems design for sustainable food production project network that identifies the changes needed to achieve the network-wide goal based on the activities they carry out. The colored cards show changes on a) social relations in pink; b) landscape/biophysical in green; c) governance systems in blue; d) behavioral changes or new capacities in yellow. (B) An adapted Theory of Change model is shown from the same project.

The model that was generated in the workshops shows the first stages of the Theory of Change methodology in which the different states were arranged over time until the desired goal was reached by project and then by institutional goal. Once the cards were curated, these were entered into the software. We then obtained networks with shorter names that homologated the desired states among the four projects and were linked by the activities that make the states change over time. Here we present the example of one network (see the Supplementary material for the other three networks). Finally, using the network merging functionality of our software, we show the meta-network of the four networks where we observe two converging points between the projects that were added using the software. We found that each project addresses different themes and issues that are not necessarily connected but can all be aligned with the overall goal of SECTEI.

States, connections and activities from the workshops were input to the platform thereby populating three relational tables: states, connections, and activities. The corresponding data was read directly in those tables or visualized within the platform using an interactive graphical interface. Visualization is a part of the analysis of complex networks, but the most important feature is that they are computer models that can be further analyzed by mathematical and computational techniques in fields of knowledge such as topology and complex network theory. By storing the complex networks in a relational database, detailed queries can be made for any search criteria. Search results are interpreted as edgelists from which subnetworks or super-networks are created. This means networks can be created from only parts of projects or from more than one project at a time or even the whole database. This ability to split or merge allows for powerful flexibility. Additionally, a subset or superset can be exported in GraphML format, which allows for further analysis using external specialized software such as Cytoscape, Gephi, NetworkX and many more.

By using the software, we obtained a meta-graph that linked all the projects of the LABSA network. This allowed us to identify two shared nodes (better quality soil, and ecosystems that favor human survival). Figure 4 shows the distribution of the states of each project and the concurrent states among the four projects. These were better quality soil and ecosystems that favor human survival.

Figure 4
www.frontiersin.org

Figure 4. Metha graph showing the four LABSA network projects and the nodes where these converge in red (developed with Cytoscape-version 3.10.0.). We observe the a) Chinampera School in green, b) Laboratory of Sustainable Soil Management and Compost Evaluation Project (LAMSSEC) in blue, c) Agroecological Sustainability Laboratory (LASOS) in purple, and d) Agroecosystems design for sustainable food production in orange.

5 Discussing lessons learned

As explained, the development of the software was informed from the outcomes of the participatory workshops where participants crafted networks for their projects based on elements from the Theory of Change approach. Through these participatory spaces, participants collectively envisioned a joint trajectory towards common objectives while discussing both anticipated challenges and potential opportunities. This inclusive approach not only allowed identifying overlooked aspects crucial for achieving shared goals, but also fostered an atmosphere of transparency and collaboration. Moreover, using our software in these spaces facilitated the identification of interconnected states of change across projects that would enable participants to forge more meaningful connections and pool resources effectively. Hereafter, we discuss five main lessons learned through the first phase of the software implementation.

5.1 Resisting a dominant linear logic

As we are all generally programmed to represent projects’ processes in a linear sequence, conventional dominant approaches perpetuate simplistic models or frameworks such as the Logical Model, or even the ToC, and thus determine the toolsets and indicators to evaluate the projects’ outcomes and impact. These tools and approaches are designed to deal with complexity by simplification. Although mapping objectives and activities along a single trajectory expresses expectations in a clear way, it lacks the possibility to emphasize other important connections among states, where chronological order is irrelevant (but doable if necessary). During the workshops we observed participants initially expecting a tool for planning, but not for reflection. This became apparent in how several participants immediately looked for ways of chronologically ordering objectives and activities.

When organizing nodes by chronological succession, time is a straight line, but causation connectors are heavily warped and difficult to follow (Figure 3). However, when organizing nodes by proximity for their visualization, loops are readily apparent, although time is no longer a straight line (Figure 3B).

However, although we acknowledge the need for timelines in project planning, by their nature they emphasize linearity and, in a way, obfuscate complexity in causation, (as stated by Abercrombie et al., 2018 and Murphy, 2021). By contrast, modeling projects as complex networks might tackle these limitations (Murphy, 2021). If a causal network is arranged by proximity of states, connections are simple lines and phenomena such as circular causation are clearly represented as loops in the network. Thus, the software allows the creation of these connections meant to express circular causation. Although states in our software can include expected dates, creating networks with our software is about causality connections. Networks of causation are inspired by ToC, but by explicitly representing them as complex networks might contribute to embracing the complexity of wicked problems in the very way we analyze them and plan actions that might contribute to tackle them.

5.2 Balancing opposing cyber-human uses

We anticipated two different use patterns of our software: 1) in workshops, with facilitation, and 2) by lone self-motivated users operating without facilitation. Thus, our software was designed to assist both uses.

Regarding the first use, the meta-graph showed to be more useful when states and connections are clear descriptions of consensual reality. However, consensus is often difficult to achieve (e.g., it is common to have different names for the same things or use the same names for different things). Therefore, facilitation is instrumental for achieving agreements on a homogeneous use of the relevant terminology. Thus, states, connections, and activities can be more clearly identified by users from different teams and organizations. A further advantage is that facilitators can elicit knowledge in depth from disciplinary scientists or field experts who may not be familiar with ToC or complex networks. However, facilitating interactions also presents challenges, such as the logistics of organizing in-person or virtual workshops that involve convening actors at the same time (Tarmizi et al., 2006).

Regarding the second use pattern pertaining to lone self-motivated users, operating without facilitation may be easier to achieve as there is no imperative to organize workshops where all participants are present. We are inspired by examples of mass collaboration such as Wikipedia, whose essence is to allow immediate edits by any reader, thus allowing a collective curation of the content. Therefore, our platform should also be available to a wide audience and enable a broader coverage of the problem space, although missing the depth and clarity achieved through facilitated collective analysis. However, even if users’ engagement might be superficial in contrast to facilitated dialogue processes, aggregated participation of many users may contribute to creating more plural understandings by generating valuable data sets for collective decision making (Hamada et al., 2020).

Our design contemplates concurrent editing of all the objects that conform to causal networks. Like in wikis, there should be no need for authorization before changes can be made, instead a log of every change should be preserved, and means should be provided for restoring objects to any previous state. This model for mass concurrency is commonplace in tools such as Git (Chacon and Straub, 2014) where several web-based platforms for collaboration have been developed (e.g., Gitea, Forgejo). As such, our network design contemplates visualizing additions in green, deletions in red, and the rest in neutral colors; and a closer inspection of edited texts should use a normal diff-patch display (MacKenzie et al., 2002). With this design, different structures of causation can be developed and used for fostering discussion among users, which is useful even if no consensus is reached.

5.3 Closing gaps and finding synergies by the creation of a meta-graph

Integrating all elicited projects’ causal networks yielded a sparse meta-graph in which each project was a subnetwork disconnected from the others. Further analysis enabled us to connect them all into a complete graph by adding two states that represent ultimate goals (as shown in Figure 4). Although the only means to connect projects was by including such nodes, it could also be the case that sub-graphs can be connected by renaming some of their states in such a way that they describe the same issue and thus can be fused. As fusing nodes can be assisted by facilitators, our design entailed a toolset for contrasting different possible structures, as described in the previous section.

Hence, we expect the platform to be useful in negotiations necessary for different teams to agree on naming and describing shared states. Furthermore, other tools might be developed for mobilizing computer power in the detection and suggestion of similar concepts (such as Natural Language Processing or Large Language Models; Bates 1995).

We expect future workshops supported by the completed software version to yield connected networks in which intermediate nodes shared by different projects will be described as such by participants. We believe that finding common ground about these nodes could detonate unexpected collaborations and serve as a basis for designing transdisciplinary strategies.

5.4 Making connections without activities

In the participatory workshops, we observed some participants that placed their projects in a wider context, which was described by states causally connected to objectives in their projects, but for which no activities were planned. For example, long-term objectives were commonly added and connected, but activities were only placed and described as connections between states within the project. Nevertheless, we found that states within and beyond the project are valuable descriptions of particular contexts, problem spaces, and stated goals. Therefore, our design enabled including connections between states that may or may not contain activities, as connections are meant to express causation without regard to intervention.

5.5 Strengths, limitations, and next steps

Using tools and workshops to model change collaboratively and ideally in a transdisciplinary environment is advantageous because it fosters reflexivity. As described by Giddens (1976), reflexivity involves the acknowledgement that the subject influences the object through self-awareness or self-reflection. This brings stakeholders to critically examine their assumptions, biases, and worldviews, fostering a more holistic understanding of the complex interconnections between social, economic, and environmental factors. Reflexivity allows project teams to continuously monitor and adapt to changing circumstances, ensuring that interventions remain relevant and effective over time (Gurtner et al., 2007). Also, reflexivity encourages creativity and innovation by challenging conventional thinking and exploring alternative approaches to sustainability challenges. By embracing diverse perspectives and knowledge systems, projects can generate novel solutions that may not have been apparent within traditional disciplinary boundaries (Lang et al., 2012). This participatory approach not only enhances the legitimacy and acceptance of sustainable initiatives but also builds capacity within communities to address future challenges independently. Thus, fostering reflexivity is a substantial strength of our software.

On the other hand, a weakness of our software is that users presented with a network tend to interpret connections as chronological order. Perhaps this is due to similarities with widespread project management tools such as the “Critical Path Method (CPM)” (Kelley and Walker, 1959), or the “Program Evaluation and Review Technique (PERT)” (Fulkerson, 1962). These tools make use of networks with an emphasis on the scheduling of tasks. Our software is not meant for project management, yet it was frequently perceived as such since it asks about project objectives and activities.

Furthermore, although developing complex networks can be a challenging endeavor, creating a network with the graphical user interface in our program is relatively simple. Workshops’ participants and collaborators alike seemed tempted to use visualization as the only means for analysis. The next versions of our software should consider adding other analytical tools that include different visualizations not only of the networks themselves, but of their most important metrics. Adding brief and precise explanatory texts could also help to better understand the tool, as well as serving educational purposes. Nevertheless, the use of complex networks as computational models of causation may be a strength if it helps transdisciplinary scientists to integrate large numbers of projects to create holistic narratives.

As stated, the development of this software is a work in progress. We plan to have other series of workshops and iterative trials to improve the user interface by allowing better interactions among different users. We also plan to develop a way of onboarding lone users in such a way that noise is kept to a minimum and the collective meta-graph makes the most sense to all participants. Ultimately, we aim to engage a wide and diverse group of users that could find our tool useful for their endeavors.

6 Conclusion

In this work we presented the initial steps of a project in which we developed a software aimed at creating a meta-graph tool as a virtual nexus where myriad projects intertwine to enable a cyber-human space to facilitate reflecting on projects’ architecture and planned outcomes. Through adapting elements of the Theory of Change model, this software was used to guide participants in designing causation networks that transcend the dominant linear project logic and allowed them to unveil the articulation of different projects to then identify common elements. Thus, we posit that this tool could be instrumental in fostering new possibilities for coordination and synergy among initiatives, and in promoting reflection when crafting projects that aim to more meaningfully address sustainability problems.

Particularly from the participatory spaces we learned that by curating the states of the theories of change of the LABSA network projects we were able to connect them with concurrent goals and objectives. This interaction was a posteriori and there were few overlapping nodes. As ongoing projects, activities were already implemented and there was no space for a change. They recognized that using ToC allowed them to visualize more connections among states within projects. This approach was of particular interest to SECTEI and the LABSA network as a means to understand if the projects are linked and how.

Finally, our approach showed the importance of reflexivity as a transdisciplinary strategy to advocate for more meaningful changes through widening breadth, deepening understandings, and collectivizing analyses within a creative space designed to visualize and analyze causality, complexity and connectivity among projects. By recognizing similarities and potential convergences among efforts, social actors might contribute to amplify the impact potential of initiatives aimed at addressing complex sustainability challenges. We hope this effort inspires others to create mechanisms and conditions to collectively imagine transformative changes towards more plural and shared sustainabilities.

Data availability statement

The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found in the article/Supplementary material.

Author contributions

PG-M: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing. RG-H: Conceptualization, Methodology, Software, Visualization, Writing – original draft. FS-C: Conceptualization, Formal analysis, Methodology, Software, Visualization, Writing – original draft. LC-J: Writing – review & editing, Conceptualization, Writing – original draft. JM-N: Investigation, Methodology, Writing – review & editing, Data curation, Formal analysis, Visualization, Writing – original draft. JM: Investigation, Writing – review & editing, Methodology. EP-V: Methodology, Writing – review & editing, Formal analysis. SG-A: Investigation, Writing – review & editing, Data curation, Formal analysis. AF-R: Writing – review & editing, Conceptualization, Investigation. AT: Methodology, Writing – review & editing, Software, Visualization. JC-J: Investigation, Methodology, Writing – review & editing.

Funding

The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This work was part of the PAPIIT-UNAM project num. TA300121 which funded this initiative.

Acknowledgments

We thank Mariana Velázquez for helping in the facilitation of the workshops with SECTEI. We also thank Alanis. F. Duque Rodríguez for her presentation about spheres of food security in the workshops. Finally, we are thankful to Ofelia Angulo, Pedro Álvarez-Icaza, Sara Muñoz, for opening the space to collaborate with the four LABSA network projects and their coordinators (Judith López Jardines, Arturo Argueta, María Elena Trujillo Ortega and Luis Manuel Rodríguez Sánchez). S. Garcilita Arguello acknowledges that his contribution to this work was made while being an undergraduate student and research assistant at UNAM, with the support from the Asociación Mexicana de Cultura, A. C.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/frsus.2024.1405501/full#supplementary-material

References

Abercrombie, R., Boswell, K., and Thomasoo, R. (2018). Thinking big: How to use theory of change for systems change. London: Lankelly Chase Foundation.

Google Scholar

Albert, R., and Barabási, A.-L. (2002). Statistical mechanics of complex networks. Rev. Mod. Phys. 74, 47–97. doi: 10.1103/revmodphys.74.47

Crossref Full Text | Google Scholar

Alford, C. (2017). Two approaches for combining theories of change and system maps. In Too Deep. Available at: https://blog.kumu.io/two-approaches-for-combining-theories-of-change-and-system-maps-5b556091c880 (Accessed July 3, 2023).

Google Scholar

Aragón, A. O., and Giles Macedo, J. C. (2010). A ‘systemic theories of change approach for purposeful capacity development. IDS Bull. 41, 87–99. doi: 10.1111/j.1759-5436.2010.00140.x

Crossref Full Text | Google Scholar

Bates, M. (1995). Models of natural language understanding. Proc. Natl. Acad. Sci. 92, 9977–9982. doi: 10.1073/pnas.92.22.9977

PubMed Abstract | Crossref Full Text | Google Scholar

Binder, C. R., Absenger-Helmli, I., and Schilling, T. (2015). The reality of transdisciplinarity: a framework-based self-reflection from science and practice leaders. Sustain. Sci. 10, 545–562. doi: 10.1007/s11625-015-0328-2

PubMed Abstract | Crossref Full Text | Google Scholar

Borda, O. F., Reason, P., and Bradbury, H. (2006). “Participatory (action) research in social theory: origins and challenges” in Handbook of action research: Participative inquiry and practice. ed. H. Bradbury (Thousand Oaks, CA: Sage), 27–37.

Google Scholar

Caniglia, G., Luederitz, C., von Wirth, T., Fazey, I., Martín-López, B., Hondrila, K., et al. (2021). A pluralistic and integrated approach to action-oriented knowledge for sustainability. Nat. Sustain. 4, 93–100. doi: 10.1038/s41893-020-00616-z

Crossref Full Text | Google Scholar

Chacon, S., and Straub, B. (2014). Pro git. Berlin: Springer Nature.

Google Scholar

Chambers, J. M., Wyborn, C., Ryan, M. E., Reid, R. S., Riechers, M., Serban, A., et al. (2021). Six modes of co-production for sustainability. Nat. Sustain. 4, 983–996. doi: 10.1038/s41893-021-00755-x

Crossref Full Text | Google Scholar

Charli-Joseph, L., Siqueiros-García, J. M., Eakin, H., Manuel-Navarrete, D., Mazari-Hiriart, M., Shelton, R., et al. (2023). Enabling collective agency for sustainability transformations through reframing in the Xochimilco social–ecological system. Sustain. Sci. 18, 1215–1233. doi: 10.1007/s11625-022-01224-w

Crossref Full Text | Google Scholar

Chen, H. (2015). “Practical program evaluation: theory-driven evaluation and the integrated evaluation perspective” in Analisis Standar Pelayanan Minimal Pada Instalasi Rawat Jalan di RSUD Kota Semarang. 2nd ed (Thousand Oaks, CA: Sage Publications).

Google Scholar

Dieleman, H. (2008). Sustainability, art and reflexivity. Sustainability 108:146.

Google Scholar

Dupuis, L., Leandre, C., Langridge, J., Delavaud, A., Jactel, H., and Soubelet, H. (2023). Analyzing the capacity to initiate transformative change: a methodology for assessing biodiversity strategies. Biodivers. Conserv. 32, 3641–3660. doi: 10.1007/s10531-023-02660-5

Crossref Full Text | Google Scholar

Fulkerson, D. R. (1962). Expected critical path lengths in PERT networks. Oper. Res. 10, 808–817. doi: 10.1287/opre.10.6.808

Crossref Full Text | Google Scholar

Giddens, A. (1976). New Rules of Sociological Method: A positive Critique of Interpretative Sociologies, London: Hutchinson.

Google Scholar

Gurtner, A., Tschan, F., Semmer, N. K., and Nägele, C. (2007). Getting groups to develop good strategies: effects of reflexivity interventions on team process, team performance, and shared mental models. Organ. Behav. Hum. Decis. Process. 102, 127–142. doi: 10.1016/j.obhdp.2006.05.002

Crossref Full Text | Google Scholar

Hamada, D., Nakayama, M., and Saiki, J. (2020). Wisdom of crowds and collective decision-making in a survival situation with complex information integration. Cogn. Res. Princ. Implic. 5, 48–15. doi: 10.1186/s41235-020-00248-z

PubMed Abstract | Crossref Full Text | Google Scholar

Kelley, J. E., and Walker, M. R. (1959). Critical-path planning and scheduling. In Papers presented at the December 1–3, 1959, eastern joint IRE-AIEE-ACM computer conference.

Google Scholar

Lang, D. J., Wiek, A., Bergmann, M., Stauffacher, M., Martens, P., Moll, P., et al. (2012). Transdisciplinary research in sustainability science: practice, principles, and challenges. Sustain. Sci. 7, 25–43. doi: 10.1007/s11625-011-0149-x

Crossref Full Text | Google Scholar

Lee, J., Lee, Y., Oh, S. M., and Kahng, B. (2021). Betweenness centrality of teams in social networks. J. Nonlinear Sci. 31:061108. doi: 10.1063/5.0056683

Crossref Full Text | Google Scholar

Leydesdorff, L. (2007). Betweenness centrality as an indicator of the interdisciplinarity of scientific journals. J. Am. Soc. Inf. Sci. Technol. 58, 1303–1319. doi: 10.1002/asi.20614

Crossref Full Text | Google Scholar

MacKenzie, D., Eggert, P., and Stallman, R. (2002). Comparing and merging files with GNU diff and patch. Godalming: Network Theory Ltd.

Google Scholar

Marshall, F., Van Zwanenberg, P., Eakin, H., Charli-Joseph, L., Ely, A., Marin, A., et al. (2021). “Reframing sustainability challenges” in Transformative pathways to sustainability (London: Routledge), 187–205.

Google Scholar

Maru, Y. T., Sparrow, A., Butler, J. R. A., Banerjee, O., Ison, R., Hall, A., et al. (2018). Towards appropriate mainstreaming of “theory of change” approaches into agricultural research for development: challenges and opportunities. Agric. Syst. 165, 344–353. doi: 10.1016/j.agsy.2018.04.010

PubMed Abstract | Crossref Full Text | Google Scholar

Mason, P., and Barnes, M. (2007). Constructing theories of change: methods and sources. Evaluation 13, 151–170. doi: 10.1177/1356389007075221

Crossref Full Text | Google Scholar

Mayne, J. (2015). Useful theory of change models. Can. J. Program Eval. 30, 119–142. doi: 10.3138/cjpe.230

Crossref Full Text | Google Scholar

Mayne, J. (2017). Theory of change analysis: building robust theories of change. Can. J. Program Eval. 32, 155–173. doi: 10.3138/cjpe.31122

Crossref Full Text | Google Scholar

Meadows, D. (2015). Leverage points-places to intervene in a system. Available at: https://mchwdc.unc.edu/wp-content/uploads/2022/04/Leverage-Points_Places-to-Intervene-in-a-System-Meadows.pdf

Google Scholar

Merçon, J., Ayala-Orozco, B., and Rosell, J. (2018). Experiencias de colaboración transdisciplinaria para la sustentabilidad. México: Copit Arxives.

Google Scholar

Murphy, R. J., and Jones, P. (2020). Design management for wicked problems: towards systemic theories of change through systemic design. In En 22st DMI: Academic design management conference, Toronto, ON.

Google Scholar

Murphy, R. J., and Jones, P. (2021). Towards systemic theories of change: high-leverage strategies for managing wicked problems. Des. Manag. J. 16, 49–65. doi: 10.1111/dmj.12068

Crossref Full Text | Google Scholar

O’Brien, K. (2018). Is the 1.5 C target possible? Exploring the three spheres of transformation. Curr. Opin. Environ. Sustain. 31, 153–160. doi: 10.1016/j.cosust.2018.04.010

Crossref Full Text | Google Scholar

Oberlack, C., Schneider, F., Herweg, K., Messerli, P., Tribaldos, T., Breu, T., et al. (2019). Theories of change in sustainability science: understanding how change happens. Gaia 28, 106–111. doi: 10.14512/gaia.28.2.8

Crossref Full Text | Google Scholar

Reinholz, D. L., and Andrews, T. C. (2020). Change theory and theory of change: what’s the difference anyway? Int. J. STEM Educ. 7:2. doi: 10.1186/s40594-020-0202-3

Crossref Full Text | Google Scholar

Rittel, H. W. J., and Webber, M. M. (1973). Dilemmas in a general theory of planning. Policy. Sci. 4, 155–169. doi: 10.1007/BF01405730

Crossref Full Text | Google Scholar

Sayama, H. (2015). Introduction to the modeling and analysis of complex systems. New York: Open SUNY Textbooks.

Google Scholar

Scoones, I., Stirling, A., Abrol, D., Atela, J., Charli-Joseph, L., Eakin, H., et al. (2020). Transformations to sustainability: combining structural, systemic and enabling approaches. Curr. Opin. Environ. Sustain. 42, 65–75. doi: 10.1016/j.cosust.2019.12.004

Crossref Full Text | Google Scholar

Sol, J., Van der Wal, M. M., Beers, P. J., and Wals, A. E. (2018). Reframing the future: the role of reflexivity in governance networks in sustainability transitions. Environ. Educ. Res. 24, 1383–1405. doi: 10.1080/13504622.2017.1402171

Crossref Full Text | Google Scholar

Tarmizi, H., de Vreede, G., and Zigurs, I. (2006). Identifying challenges for facilitation in communities of practice. In Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

Google Scholar

Turnhout, E., Metze, T., Wyborn, C., Klenk, N., and Louder, E. (2020). The politics of co-production: participation, power, and transformation. Curr. Opin. Environ. Sustain. 42, 15–21. doi: 10.1016/j.cosust.2019.11.009

Crossref Full Text | Google Scholar

Vogel, I. (2012). Review of the use of ‘theory of change’ in international development, review report. London: Department for International Development.

Google Scholar

Weiss, C. H. (1997). How can theory-based evaluation make greater headway? Eval. Rev. 21, 501–524. doi: 10.1177/0193841X9702100405

Crossref Full Text | Google Scholar

Keywords: meta-graph software, sustainability projects, causation networks, Theory of Change, Mexico

Citation: García-Meneses PM, García-Herrera R, Serrano-Candela F, Charli-Joseph L, Mota-Nieto J, Mejía Ciro JD, Platas-Valle E, Garcilita-Arguello S, Fernández-Reyes A, Toriz Cruz A and Corona-Jiménez JA (2024) Mapping causal networks from theories of change in sustainability projects: a software co-design process. Front. Sustain. 5:1405501. doi: 10.3389/frsus.2024.1405501

Received: 23 March 2024; Accepted: 15 August 2024;
Published: 29 August 2024.

Edited by:

Yinglong Wang, Qingdao University of Science and Technology, China

Reviewed by:

Davide Secchi, University of Southern Denmark Slagelse, Denmark
Zhijie Shang, University of Science and Technology Beijing, China

Copyright © 2024 García-Meneses, García-Herrera, Serrano-Candela, Charli-Joseph, Mota-Nieto, Mejía Ciro, Platas-Valle, Garcilita-Arguello, Fernández-Reyes, Toriz Cruz and Corona-Jiménez. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: P. M. García-Meneses, paola.garcia@ecologia.unam.mx

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.