Skip to main content

PERSPECTIVE article

Front. Clim., 02 July 2021
Sec. Climate Risk Management
This article is part of the Research Topic High-Quality Knowledge for Climate Adaptation: Revisiting Criteria of Credibility, Legitimacy, Salience, and Usability View all 10 articles

Advancing Relevance, Credibility, Legitimacy, and Effectiveness as a Heuristic for Local-Parallel Scenarios

  • 1Landscape Governance & Policy, Manaaki Whenua Landcare Research, Lincoln, New Zealand
  • 2Gateway Antarctica, University of Canterbury, Christchurch, New Zealand

The parallel scenario process provides a framework for developing plausible scenarios of future conditions. Combining greenhouse gas emissions, social and economic trends, and policy responses, it enables researchers and policy makers to consider global-scale interactions, impacts and implications of climate change. Increasingly, researchers are developing extended scenarios, based on this framework, and incorporating them into adaptation planning and decision-making processes at the local level. To enable the identification of possible impacts and assess vulnerability, these local-parallel scenarios must successfully accommodate diverse knowledge systems, multiple values, and competing priorities including both “top down” modeling and “bottom-up” participatory processes. They must link across scales, to account for the ways in which global changes affect and influence decision-making in local places. Due to the growing use of scenarios, there is value in assessing these developments using criteria or, more specifically, heuristics that may be implicitly acknowledged rather than formally monitored and evaluated. In this Perspective, we reflect on various contributions regarding the value of heuristics and propose the adoption of current definitions for Relevance, Credibility, and Legitimacy for guiding local scenario development as the most useful as well as using Effectiveness for evaluation purposes. We summarize the internal trade-offs (personal time, clarity-complexity, speed-quality, push-pull) and the external stressors (equity and the role of science in society) that influence the extent to which heuristics are used as “rules of thumb,” rather than formal assessment. These heuristics may help refine the process of extending the parallel scenario framework to the local and enable cross-case comparisons.

Introduction

The multi-scale and systemic nature of climate risk requires greater consideration of the ways in which responses to climate impacts and anticipated risks can be affected and influenced by conditions at the global, regional, and national scales (Simpson et al., 2021). The parallel scenario framework is a sophisticated, global-scale architecture involving representative concentration pathways (RCPs) of greenhouse gas emissions, shared socio-economic pathways (SSPs), and shared policy assumptions (SPAs) (Ebi et al., 2014). Since 2014 the framework has been used to develop long-term futures, providing insight into the potential effects of climate change on social-ecological systems, the effectiveness of adaptation and mitigation, and the policies necessary to reduce climate-related risks (O'Neill et al., 2014). The framework provides a set of boundary conditions for constructing internally consistent, plausible representations of diverse futures. Elaborating futures scenarios enables researchers, policymakers, and practitioners to explore interactions and feedback mechanisms between large-scale drivers of global change, and to identify and assess possible pathways for change (O'Neill et al., 2020).

This global scenario architecture provides a versatile and flexible structure that can accommodate diverse applications, at different scales, and provide insight into potential impacts and implications. In this, the three interrelated parallel pathways; the RCPs, SSPs and SPAs explore the impact climate change will have on social-ecological systems, the degree to which mitigation and adaptation policies can avoid and reduce those risks, and the costs and benefits of various policy mixes (Ebi et al., 2014). An emerging trend in impacts, vulnerability, and adaptation research, therefore, is to improve the links between the global and sub-national (hereafter local) level by extending the parallel scenario framework and incorporating outputs into applied adaptation decision-making processes (Campos et al., 2016; Cradock-Henry et al., 2018, 2020; Aguiar et al., 2020; Schmitt Olabisi et al., 2020). Such extended SSPs have been developed for a range of settings and problems, including specific sectors and activities such as agriculture and forestry (Daigneault et al., 2019; Mitter et al., 2020; Lehtonen et al., 2021), and scales and places (Frame et al., 2018; Lino et al., 2019; Chen et al., 2020; Gomes et al., 2020; Pedde et al., 2021).

Extending the basic architecture of the global parallel scenarios developed by the climate change research community to the local level also continues the trend in adaptation research, of researchers working with stakeholders—including communities and regions, policymakers and practitioners—to co-produce knowledge (Bremer and Meisch, 2017). Co-production processes seek to better understand local conditions, assess current and anticipated impacts and implications, and explore adaptation options (Ford et al., 2014; Boon et al., 2019; Cradock-Henry et al., 2020; Hill et al., 2020; Cradock-Henry, 2021). These local-parallel scenarios typically combine elements of top-down and bottom-up data derived from probabilistic or econometric models, or through interviews and other participatory methods, respectively.

Local scenarios can improve understanding of the types and magnitude of change, explore sensitivities, and evaluate ways of managing risks. Often these scenarios are used as part of an adaptive planning or pathways process that begins with a comprehensive understanding of the current situation, and then bounds future uncertainty within a manageable set of conditions (Cradock-Henry et al., 2018; Frame et al., 2018; Aguiar et al., 2020). However, development of these scenarios assumes seamless ways to coordinate and apply the frameworks from the global through the regional and national to the local while accommodating new directions. However, as O'Neill et al. (2020, p. 1,079) highlight, “At present, there is no commonly agreed practice regarding methods for downscaling the SSPs” and more detailed Integrated Assessment Models are needed (Pereira et al., 2021; Rosen, 2021).

The rapid growth in the application and development of decision-making tools and processes for adaptation is prompting reflection on the value of heuristics. These are seen as a “branch of study” that seeks to “understand the methods and rules of discovery and invention” (Pólya, 1990). Heuristics can expedite conceptual and methodological development by stimulating thinking. In this essay we use the word “heuristic” to refer to a rule of thumb. Following Starfield et al. (1994), “a heuristic is a plausible or reasonable approach that has often proved to be useful.” In so doing, we build on and extend recent work in the field, focusing on one of the most common heuristics in sustainability and climate science: relevance, credibility and legitimacy.

The relevance, credibility, and legitimacy heuristic (hereafter RCL) has been associated with desired attributes for information at the boundary between science and policy communities. It has been used extensively in the literature on adaptation (and climate change more generally), due in part to its origins in assessing the usability of seasonal climate forecasts for decision-making (Cash et al., 2006). We use RCL as our anchor point from the literature (e.g., Cash et al., 2002, 2003, 2006; Sarkki et al., 2014; Belcher et al., 2016, 2019; Cash and Belloy, 2020). We find this workable in practice at the local level, especially when there is a need for something that, while academically rigorous, can be easily understood by non-technical, on-the-ground practitioners. Or, to phrase it differently, we see the use of a heuristic to be of greater practical benefit than a formal evaluation methodology (Nalau et al., 2021). However, as Elsawah and colleagues point out, while conceptual papers such as that by Cash et al. (2006) are often quoted, their “recommendations are rarely used beyond the point of acknowledging that they exist” (Elsawah et al., 2020, p. 13). Our aim here is to consider the various formulations of criteria and attributes in the literature and propose a simple, reproducible formulation that can be used across local case studies.

In this Perspective we reflect on developing and applying local-parallel scenarios as part of adaptation planning. Findings have been generated inductively based on our own experience, and deductively from a review of the literature. We begin by summarizing the process of nesting the local in the global (section Nesting the Local in the Global), before describing the various RCL formulations (section What Is Meant by Relevance, Credibility, and Legitimacy, and What Is Effective?). In section Tradeoffs and Stressors in Developing Local-Parallel Scenarios we discuss how these criteria can accommodate internal and external stressors when working at the science–policy interface. We conclude by proposing how developing local-parallel scenarios might use these criteria most effectively.

Nesting the Local in the Global

There are many examples of adaptation planning and decision-making ranging from adaptation pathways to resilience and vulnerability assessment. Here we restrict ourselves to the growing use of scenarios at the local level, and the corresponding increase in case studies (Nilsson et al., 2017; Lino et al., 2019; Zandersen et al., 2019; Butler et al., 2020; Lehtonen et al., 2021). Scenarios are narratives describing plausible future worlds. They are a strategic planning method developed to make flexible and robust long-term plans in response to complex and uncertain futures. Scenarios were initially developed by mid-nineteenth century European military intelligence specialists, but since the 1960s they have been used in a variety of contexts and scales, including business and trade (Berkhout et al., 2002), conservation and development (Peterson et al., 2003; Daconto and Sherpa, 2010; Pereira et al., 2021), community development (Rawluk and Godber, 2011), and adaptive infrastructure management (Hamilton et al., 2013). Due to the uncertainties surrounding the magnitude and effects of climate change, natural variability, and the extent to which human societies will adopt mitigation and adaptation, scenarios are used extensively to explore the effects of certain decisions on climate change.

The global-scale parallel scenario framework, however, is unable to model the localized effects of climate change (Ebi et al., 2014; O'Neill et al., 2014). Precipitation, timing, and intensity of weather events, the role of local geography, or the specific socio-economic factors that affect local decisions on adaptation and mitigation in regions and communities therefore need to be elaborated on and bounded in other ways (O'Neill et al., 2020; Pereira et al., 2021).

At the regional or local level climate scenarios have tended to fall into two broad categories. The first involves emulating the parallel process by collecting and refining expert data and projections into relatively complex scenarios for specific regions. These scenarios are then used with planners, policy makers, and others to synthesize large amounts of scientific data, compare and contrast policy options, and inform decision-making. The second approach uses more community-development-type approaches by working with local communities to co-create scenarios that prioritize local knowledge and memories and community aspirations (Mistry et al., 2014). An emerging third way is the use of local socioeconomic and climate scenarios as a tool for exploring plausible future conditions and how these may influence adaptation strategies (Nilsson et al., 2017; Zandersen et al., 2019; Reimann et al., 2021). These local-parallel scenarios use the basic architecture of the global framework to provide a set of boundary conditions. The combination of emissions, policy mixes, and socioeconomic pathways is contextualized for local conditions through stakeholder knowledge and experience. The resulting narratives represent alternative trends, with a loose or soft linkage to national and/or global conditions (Lino et al., 2019).

Developing and applying such scenarios involves developing quite specific artifacts, such as narratives or other representations of plausible future conditions. These, in turn, may challenge established norms and values, and cut across other place-specific issues. For local stakeholders at least, these have as much, if not more, importance in the short-term decision-making on such issues as infrastructure investments, the viability of primary production, and employment (Cradock-Henry et al., 2018). Consequently, for any scenario development process to be effective at the local scale, it has to successfully engage and negotiate with local concerns (Cradock-Henry et al., 2020; Cradock-Henry and Frame, 2021). Also, as discussed next, useful heuristics are needed that provide guidance on the extent to which this has been achieved.

What is Meant By Relevance, Credibility, and Legitimacy, and What is Effective?

Cash et al. (2002, 2003, 2006) established the key concepts of “credibility, salience and legitimacy” as attributes for information at the boundary between science and policy communities. These acknowledged the science and policy interface as a complex terrain requiring skilful navigation, the dynamics of which, within a rapidly changing world, are becoming increasingly challenging (Cash and Belloy, 2020). The terms evolved as a heuristic means to evaluate the boundary between research and policy without necessarily delving into the politics of the situation, or to challenge underlying assumptions (Preston et al., 2015; Nalau et al., 2021). Such research is effectively transdisciplinary, where high-level modeling is likely to be of limited value and datasets are likely to be incomplete or inconsistent (Carlsen et al., 2016; Bosomworth and Gaillard, 2019; Cradock-Henry et al., 2020).

In other words, “credibility, salience, and legitimacy” provide criteria that link the processes of developing climate change information and its usefulness within the transdisciplinary research world, and that other world experienced by end-users, including policymakers. While the heuristic has been widely used to describe the science–policy boundary (White et al., 2010; Kunseler et al., 2015; Dannevig and Hovelsrud, 2016; Cash and Belloy, 2020), various alternative formulations have been proposed. “Salient” was considered to be analogous to “relevant,” which led to use of the term CRELE (credible, relevant, and legitimate), which has morphed into relevant, credible, and legitimate, resulting in the acronym, RCL. This, as discussed by others, is what appears to be gaining traction and which we adopt as the preferred terminology (Belcher et al., 2016, 2019; Dunn and Laing, 2017).

Other terms have also been proposed and include, for example, iterativity (Lemos and Morehouse, 2005; Dilling and Lemos, 2011), defined as “a continuous multi-directional interaction that goes beyond simple repetition, building on previous practices, learning from success and failure, and fostering evaluation itself among all participants at the interface and between science-policy interfaces and external audiences” (Sarkki et al., 2015, p. 507) which led to CRELE + IT. While this is useful in terms of transdisciplinary research, it can, for use in local scenarios, be seen as an essential requirement absorbed into the overall concept of effectiveness, as discussed later. Dunn and Laing (2017) suggested that CRELE is not suitable to describe policymakers' needs because it is more focused on information supply rather than information demand. They recommended the use of applicability, comprehensiveness, timing, and accessibility. This, and to a lesser extent CRELE, was criticized by Tangney (2017) as flawed, though with the latter acknowledging the criteria that should be prioritized for the use of evidence in decision-making (Hansson and Polk, 2018).

To this lexicon, Maier et al. (2016) added terms to describe multiple plausible futures: deep uncertainty, global/local uncertainty and volatility, uncertainty, complexity, and ambiguity. Interestingly, with reference to the development and application of the parallel scenarios, O'Neill et al. (2020) use the term “credible, reproducible, and consistent methods for the use of the SSPs across scales” (p. 6), which perhaps lacks enough rigor. All of this suggests that a formal and broadly accepted formulation would be helpful as the process of extending scenarios gains momentum globally.

The systematic review by Belcher et al. (2016), and its subsequent refinement (Hansson and Polk, 2018), led to definitions for the principles and criteria for assessing the quality of transdisciplinary research. We propose the use of their working definitions for the development of extended parallel scenarios at the local level, as follows:

Relevance: the importance, significance, and usefulness of the research problem, objectives, processes, and findings to the problem context

Credibility: the research findings are robust and the sources of knowledge are dependable—this includes clear demonstration of the adequacy of the data and the methods used to procure the data, including clearly presented and logical interpretation of findings

Legitimacy: the research process is perceived as fair and ethical—this encompasses the ethical and fair representation of all involved, and the appropriate and genuine inclusion and consideration of diverse participants, values, interests, and perspectives.

Belcher et al. (2016) also included the principle of effectiveness. This is, in this case, an assessment criterion to be considered ex ante at the proposal stage, with actual effectiveness determined ex post through the use of appropriate assessment tools. Thus, effectiveness defines the extent to which research generates knowledge and stimulates actions that address the problem and contribute to solutions and innovations. As a result, Belcher et al. (2019) placed this effectiveness heuristic outside the bounds of the adaptation processes, and we do not include effectiveness to assess adaptation processes prior to their application.

Tradeoffs and Stressors in Developing Local-Parallel Scenarios

Internal Tradeoffs

Sarkki et al. (2014) used empirical data to identify and explore four internal trade-offs at the science–policy interface, which they described as:

• The personal time trade-off between the commitment required by those involved to cover the highly complex, multi-faceted terrain of adaptation vs. commitment to an existing discipline or process

• The clarity–complexity trade-off between simple, strong, clear messages (relevance) vs. thorough treatment of uncertainties and systemic dimensions (credibility and legitimacy)

• The speed–quality trade-off between timely and rapid responses to policy needs (relevance) vs. time-consuming quality assessment (credibility) and/or consensus building (legitimacy)

• The push–pull trade-off between following strong policy demand (relevance) and more supply-oriented research strategies to enable identification of emerging issues or development of innovative solutions (credibility and legitimacy).

Sarkki et al. (2014) also identified issues relating to trust and inclusion of other worldviews, which are considered as external stressors.

External Stressors

Cash and Belloy (2020) describe four external stressors in the global context which address criticism that RCL does not fully address socio-political aspects, distributive justice, and the rapidly changing knowledge–action landscape. First there is the challenge of engaging with quite different forms of knowledge when working across scales, and the need to ensure trust is created in the process. Second there are equity issues, which are both urgent and complex and include ethical dimensions, populations with existing vulnerabilities, issues of privilege, as well as historically disadvantaged populations. Third there is the degradation of the role of science in society and the trust placed in science in the “post-truth” world where trust in science has become corroded with an increasing emphasis on personal or political preferences. This is most clearly exhibited through perspectives such as climate change denialism and resistance to evidence-based responses to the COVID-19 pandemic (Jasanoff, 2021). Finally, there are issues related to the production of knowledge through digital technologies across multiple platforms, including ease of access to shared information, which blurs the citizen–science boundary, and the ways in which social media is used by institutions, community groups, and businesses to influence opinions.

While these originated through consideration of global developments, we seek here to consider them specifically in relation to local scenario processes. That is to say, we consider the use of the RCL heuristics primarily through the first of these dynamics—working across scales. We then look at how this affects issues of equity and science in a post-truth society and with digital transformations only playing a relatively minor role. We do so based on our experiences with impacts, vulnerability, and adaptation at the local level in Aotearoa—New Zealand (New Zealand) that will be highly contextual and place-specific, but also seek to provide a more general perspective (Cradock-Henry et al., 2018, 2020; Frame et al., 2018; Ausseil et al., 2019; Cradock-Henry and Frame, 2021).

Equity

Cash and Belloy (2020) describe four aspects of inequity in contemporary society: historically disadvantaged populations; those with existing vulnerabilities; those in post-disaster recovery; over-arching ethical considerations of human and non-human ecology. Of these, the historically disadvantaged and those with existing vulnerabilities are, currently, the most pertinent to our discussion. In the New Zealand context we propose that the first relates solely to the indigenous population, with the latter covering other disadvantaged groups.

Aotearoa—New Zealand is a bi-cultural nation, with indigenous Maori retaining governance rights and management responsibilities for ancestral land through Te Tiriti o Waitangi (the Maori version of the Treaty of Waitangi, 1840)—New Zealand's founding document, framing the relationship between Maori and the Crown. In addition to their lands, many iwi (Maori tribes) have commercial agribusiness and forestry interests. They also live in or near coastal margins, which are likely to be exposed to the effects of climate change. Ideally, scenarios would be developed using kaupapa-based Māori methodologies (Smith, 2012); i.e., designed by and for Māori, addressing Māori concerns, conducted predominantly by Māori researchers and based on Māori cultural values. In practice, available technical capability and capacity can, currently, be a limiting factor. To ensure a Māori perspective, any local consultation process must involve iwi or hapu as an equal partner. This cannot be considered an optional add-on but must be seen as a central component. If this is not undertaken in a sincere and comprehensive manner, then success in achieving a legitimate result is greatly diminished.

Our experience also suggests it is both critical and difficult to negotiate and balance the power dynamics between ostensibly equal stakeholders (Cradock-Henry et al., in press). As with geopolitics, there are strong players and silent players. For example, there can be wealthy landowners with extensive business interests, positions in local-body politics, and strong, long-term family connections who may be able to exert a disproportionate influence on decision-making processes (sometimes over-stated as “oligarchs”). This authority needs to be made relatively transparent and the opportunity for alternative perspectives enabled.

If “oligarchs” are potentially over-privileged, then there is an equal risk of under-privileging local, “silent,” voices. These are groups or individuals who are potentially less able to form coherent and consistent opinions than those endowed with politically relevant resources. Exclusion of silent voices reduces the relevance and legitimacy of local scenarios. Consideration therefore also needs to be given to how participatory scenario processes unfold; for example, who participates, and to what extent local hierarchies of social difference (age, gender, class, ethnicity, etc.) shape how scenarios are facilitated, and the actions that emerge out of them (Stirling, 2008).

Science in Society

Expert-led scenario development tends to prioritize the knowledge and involvement of professionals over local communities and is usually expensive and resource intensive. However, experts can introduce information and identify opportunities not readily available to local communities. Nonetheless, scenarios can be perceived as derived from and delivered by experts telling local people what they need to do. In other words, the role of the external knowledge provider is perceived as privileged, with the potential to dominate the local. While this has been a topic within the science and technology studies field for several decades (e.g., Wynne, 1991, 1992), it is not always widely understood in practice by biophysical researchers or local authorities. Failure to accommodate this, or to have resources available to address this, could lead to early failures, which then place climate change as even less of a legitimate issue. This is exacerbated in the post-truth world, as highlighted through populist campaigns such as climate change denialism (Harvey et al., 2018; Bloomfield and Tillery, 2019; Bowden et al., 2019; Kovaka, 2021) and resistance to immunization programmes for the COVID-19 virus (Jaiswal et al., 2020; Uscinski et al., 2020).

In the context of developing local scenarios through participatory and co-production processes, this can result in the wider project being perceived by some locals as an extension of “government,” with researchers being seen as “suits from the city.” This has led, in our experience, to being advised against mentioning specific topics (in the rural New Zealand context this includes the use of toxins for predator management and proposed bans on fossil fuel mining) that can be particularly contested and divisive. Until recently, work on adaptation in New Zealand—particularly with farming communities—was fraught, with stakeholders' conflating mitigation and adaptation (Reisinger et al., 2011; Cradock-Henry, 2017) and opposition to taxes on carbon or greenhouse gas emissions (Cooper and Rosin, 2014). Attitudes, trust in science, and knowledge sharing have become politically polarized, with people rejecting scientific evidence that misaligns with their personal or political preferences, requiring greater sensitivity and diplomacy when managing participatory deliberation and analysis. It is essential therefore, to acknowledge and reflect on one's role in the scenario process. Assuming the role of the “honest broker” (Pielke, 2007; Sarkki et al., 2020) in scenario development can help navigate the tension between scenario types: what could happen vs. what should happen (Börjeson et al., 2006).

Participatory scenario development processes are more likely to reflect local people's experiences and aspirations. These should include important knowledge missed by experts, and include multiple stressors, and through this process build local agency to enact appropriate and socially acceptable solutions (Bohunovsky et al., 2011; Mistry et al., 2014; Wesche and Armitage, 2014; Flynn et al., 2018; Guaita García et al., 2020). However, they are often not spatially explicit, can miss important expert knowledge, are not robust enough and connected to national/global drivers, and can be resource intensive for participants (Guaita García et al., 2020). This tension between local and professional knowledges and experiences needs to be carefully facilitated.

Concluding Comments

Climate change adaptation processes are one possible intervention in the complex assemblage of climate risk management. However, they are deeply enmeshed in wider social contexts, including the exercise of authority and agency, irrespective of scale. The arguments about this at the global and national level are well-rehearsed (O'Neill et al., 2020; Rosen, 2021) and we propose, these are equally valid at the local level.

For the global parallel-scenario process to connect to local contexts in culturally meaningful ways, scenarios should be formally reviewed during their development to assess the extent to which they are relevant, credible, and legitimate for local stakeholders, and not just for researchers. They need to be made relevant by ensuring expert knowledge is contextualized for local concerns, conflicts, and aspirations. The processes cannot privilege the expert over the local and must provide credible and legitimate ways in which the future can be plausibly negotiated. We propose that the consistent use of heuristics, rather than formal definitions, for assessment criteria are important, and that the definitions produced by Belcher et al. (2016) and restated earlier provide a means of creating consistency between case studies. Inevitably these will be subject to review over time, as they have already. However, a consistency of approach in practical examples appears the most useful next step.

It is the local's inherent complexity that makes the political so critical to an overarching understanding of adaptation options. Accommodation of this complexity must address not just the rigors of sound research but also the trade-offs and stressors described. While absolute definitions for criteria have an obvious attractiveness, the dynamic around the terms used and the concerns their use seeks to address (see Cash and Belloy, 2020 for a deeper discussion) reinforce that these should be seen as heuristics which, as demonstrated so clearly by Nalau et al. (2021) must retain a high degree of flexibility. That does not, however, imply a casual approach. Only by consistently applying these heuristics can we counter Elsawah et al.'s critique (Elsawah et al., 2020, p. 13) that such concepts are developed but not used.

Data Availability Statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s.

Author Contributions

NC-H and BF: conceptualization, writing—reviewing, and editing. NC-H: funding acquisition. All authors contributed to the article and approved the submitted version.

Funding

This research was funded by the Ministry for Primary Industries (NZ) through the Sustainable Land Management and Climate Change (SLMACC) programme and the Ministry of Business and Innovation—Resilience to Nature's Challenges Kia Manawaroa—Ngā Akina o Te Ao Turoa National Science Challenge (Contract No. C05X1909).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We acknowledge the support of colleagues in the SLMACC project Robust Responses. Thanks are also due to the Editor and Reviewers for their astute comments.

References

Aguiar, A. P. D., Collste, D., Harmáčková, Z. V., Pereira, L., Selomane, O., Galafassi, D., et al. (2020). Co-designing global target-seeking scenarios: a cross-scale participatory process for capturing multiple perspectives on pathways to sustainability. Glob. Environ. Change 65:102198. doi: 10.1016/j.gloenvcha.2020.102198

CrossRef Full Text | Google Scholar

Ausseil, A. G. E., Daigneault, A. J., Frame, B., and Teixeira, E. I. (2019). Towards an integrated assessment of climate and socio-economic change impacts and implications in New Zealand. Environ. Model. Softw. 119, 1–20. doi: 10.1016/j.envsoft.2019.05.009

CrossRef Full Text | Google Scholar

Belcher, B. M., Claus, R., Davel, R., and Ramirez, L. F. (2019). Linking transdisciplinary research characteristics and quality to effectiveness: a comparative analysis of five research-for-development projects. Environ. Sci. Policy 101, 192–203. doi: 10.1016/j.envsci.2019.08.013

CrossRef Full Text | Google Scholar

Belcher, B. M., Rasmussen, K. E., Kemshaw, M. R., and Zornes, D. A. (2016). Defining and assessing research quality in a transdisciplinary context. Res. Eval. 25, 1–17. doi: 10.1093/reseval/rvv025

CrossRef Full Text | Google Scholar

Berkhout, F., Hertin, J., and Jordan, A. (2002). Socio-economic futures in climate change impact assessment: using scenarios as ‘learning machines.’ Glob. Environ. Change 12, 83–95. doi: 10.1016/S0959-3780(02)00006-7

CrossRef Full Text | Google Scholar

Bloomfield, E. F., and Tillery, D. (2019). The circulation of climate change denial online: rhetorical and networking strategies on Facebook. Environ. Commun. 13, 23–34. doi: 10.1080/17524032.2018.1527378

CrossRef Full Text | Google Scholar

Bohunovsky, L., Jäger, J., and Omann, I. (2011). Participatory scenario development for integrated sustainability assessment. Reg. Environ. Change 11, 271–284. doi: 10.1007/s10113-010-0143-3

CrossRef Full Text | Google Scholar

Boon, W. P. C., Hessels, L. K., and Horlings, E. (2019). Knowledge co-production in protective spaces: case studies of two climate adaptation projects. Reg. Environ. Change 19, 1935–1947. doi: 10.1007/s10113-019-01517-4

CrossRef Full Text | Google Scholar

Börjeson, L., Höjer, M., Dreborg, K.-H., Ekvall, T., and Finnveden, G. (2006). Scenario types and techniques: towards a user's guide. Futures 38, 723–739. doi: 10.1016/j.futures.2005.12.002

CrossRef Full Text | Google Scholar

Bosomworth, K., and Gaillard, E. (2019). Engaging with uncertainty and ambiguity through participatory ‘Adaptive Pathways’ approaches: scoping the literature. Environ. Res. Lett. 14:093007. doi: 10.1088/1748-9326/ab3095

CrossRef Full Text | Google Scholar

Bowden, V., Nyberg, D., and Wright, C. (2019). Planning for the past: local temporality and the construction of denial in climate change adaptation. Glob. Environ. Change 57:101939. doi: 10.1016/j.gloenvcha.2019.101939

CrossRef Full Text | Google Scholar

Bremer, S., and Meisch, S. (2017). Co-production in climate change research: reviewing different perspectives. Wiley Interdiscipl. Rev. Clim. Change 8:e482. doi: 10.1002/wcc.482

CrossRef Full Text | Google Scholar

Butler, J. R. A., Bergseng, A. M., Bohensky, E., Pedde, S., Aitkenhead, M., and Hamden, R. (2020). Adapting scenarios for climate adaptation: practitioners' perspectives on a popular planning method. Environ. Sci. Policy 104, 13–19. doi: 10.1016/j.envsci.2019.10.014

CrossRef Full Text | Google Scholar

Campos, I., Vizinho, A., Coelho, C., Alves, F., Truninger, M., Pereira, C., et al. (2016). Participation, scenarios and pathways in long-term planning for climate change adaptation. Plan. Theor. Pract. 17, 537–556. doi: 10.1080/14649357.2016.1215511

CrossRef Full Text | Google Scholar

Carlsen, H., Lempert, R., Wikman-Svahn, P., and Schweizer, V. (2016). Choosing small sets of policy-relevant scenarios by combining vulnerability and diversity approaches. Environ. Model. Softw. 84, 155–164. doi: 10.1016/j.envsoft.2016.06.011

CrossRef Full Text | Google Scholar

Cash, D., Clark, W. C., Alcock, F., Dickson, N., Eckley, N., and Jäger, J. (2002). Salience, Credibility, Legitimacy and Boundaries: Linking Research, Assessment and Decision Making. Cambridge, MA: John F. Kennedy School of Government, Harvard University.

Google Scholar

Cash, D. W., and Belloy, P. G. (2020). Salience, credibility and legitimacy in a rapidly shifting world of knowledge and action. Sustainability 12:7376. doi: 10.3390/su12187376

CrossRef Full Text | Google Scholar

Cash, D. W., Borck, J. C., and Patt, A. G. (2006). Countering the loading-dock approach to linking science and decision making comparative analysis of El Niño/Southern Oscillation (ENSO) forecasting systems. Sci. Technol. Hum. Val. 31, 465–494. doi: 10.1177/0162243906287547

CrossRef Full Text | Google Scholar

Cash, D. W., Clark, W. C., Alcock, F., Dickson, N. M., Eckley, N., Guston, D. H., et al. (2003). Knowledge systems for sustainable development. Proc. Natl. Acad. Sci. U.S.A. 100, 8086–8091. doi: 10.1073/pnas.1231332100

CrossRef Full Text | Google Scholar

Chen, H., Matsuhashi, K., Takahashi, K., Fujimori, S., Honjo, K., and Gomi, K. (2020). Adapting global shared socio-economic pathways for national scenarios in Japan. Sustain. Sci. 15, 985–1000. doi: 10.1007/s11625-019-00780-y

CrossRef Full Text | Google Scholar

Cooper, M. H., and Rosin, C. (2014). Absolving the sins of emission: the politics of regulating agricultural greenhouse gas emissions in New Zealand. J. Rural Stud. 36, 391–400. doi: 10.1016/j.jrurstud.2014.06.008

CrossRef Full Text | Google Scholar

Cradock-Henry, N. (2021). Linking the social, economic, and agroecological: a resilience framework for dairy farming. Ecol. Soc. 26:3. doi: 10.5751/ES-12122-260103

CrossRef Full Text | Google Scholar

Cradock-Henry, N. A. (2017). New Zealand kiwifruit growers' vulnerability to climate and other stressors. Reg. Environ. Change 17, 245–259. doi: 10.1007/s10113-016-1000-9

CrossRef Full Text | Google Scholar

Cradock-Henry, N. A., Blackett, P., Connolly, J., Frame, B., Teixera, E., and Johnstone, P. (in press). Adaptation pathways: guidelines a worked example of a participatory planning process in the agricultural sector. Elementa.

Google Scholar

Cradock-Henry, N. A., Blackett, P., Hall, M., Johnstone, P., Teixeira, E., and Wreford, A. (2020). Climate adaptation pathways for agriculture: insights from a participatory process. Environ. Sci. Policy 107, 66–79. doi: 10.1016/j.envsci.2020.02.020

CrossRef Full Text | Google Scholar

Cradock-Henry, N. A., and Frame, B. (2021). Balancing scales: enhancing local applications of adaptation pathways. Environ. Sci. Policy 121, 42–48. doi: 10.1016/j.envsci.2021.04.001

CrossRef Full Text | Google Scholar

Cradock-Henry, N. A., Frame, B., Preston, B. L., Reisinger, A., and Rothman, D. S. (2018). Dynamic adaptive pathways in downscaled climate change scenarios. Clim. Change 150, 333–341. doi: 10.1007/s10584-018-2270-7

CrossRef Full Text | Google Scholar

Daconto, G., and Sherpa, L. N. (2010). Applying scenario planning to park and tourism management in Sagarmatha National Park, Khumbu, Nepal. Mount. Res. Dev. 30, 103–112. doi: 10.1659/MRD-JOURNAL-D-09-00047.1

CrossRef Full Text | Google Scholar

Daigneault, A., Johnston, C., Korosuo, A., Baker, J. S., Forsell, N., Prestemon, J. P., et al. (2019). Developing detailed Shared Socioeconomic Pathway (SSP) narratives for the Global Forest Sector. J. For. Econ. 34, 7–45. doi: 10.1561/112.00000441

CrossRef Full Text | Google Scholar

Dannevig, H., and Hovelsrud, G. K. (2016). Understanding the need for adaptation in a natural resource dependent community in Northern Norway: issue salience, knowledge and values. Clim. Change 135, 261–275. doi: 10.1007/s10584-015-1557-1

CrossRef Full Text | Google Scholar

Dilling, L., and Lemos, M. C. (2011). Creating usable science: opportunities and constraints for climate knowledge use and their implications for science policy. Glob. Environ. Change 21, 680–689. doi: 10.1016/j.gloenvcha.2010.11.006

CrossRef Full Text | Google Scholar

Dunn, G., and Laing, M. (2017). Policy-makers perspectives on credibility, relevance and legitimacy (CRELE). Environ. Sci. Policy 76, 146–152. doi: 10.1016/j.envsci.2017.07.005

CrossRef Full Text | Google Scholar

Ebi, K. L., Kram, T., van Vuuren, D. P., O'Neill, B. C., and Kriegler, E. (2014). A new toolkit for developing scenarios for climate change research and policy analysis. Environ. Sci. Policy Sustain. Dev. 56, 6–16. doi: 10.1080/00139157.2014.881692

CrossRef Full Text | Google Scholar

Elsawah, S., Hamilton, S. H., Jakeman, A. J., Rothman, D., Schweizer, V., Trutnevyte, E., et al. (2020). Scenario processes for socio-environmental systems analysis of futures: a review of recent efforts and a salient research agenda for supporting decision making. Sci. Total Environ. 729:138393. doi: 10.1016/j.scitotenv.2020.138393

PubMed Abstract | CrossRef Full Text | Google Scholar

Flynn, M., Ford, J. D., Pearce, T., and Harper, S. L. (2018). Participatory scenario planning and climate change impacts, adaptation and vulnerability research in the Arctic. Environ. Sci. Policy 79, 45–53. doi: 10.1016/j.envsci.2017.10.012

CrossRef Full Text | Google Scholar

Ford, J. D., Champalle, C., Tudge, P., Riedlsperger, R., Bell, T., and Sparling, E. (2014). Evaluating climate change vulnerability assessments: a case study of research focusing on the built environment in northern Canada. Mitig. Adapt. Strateg. Glob. Change 20, 1267–1288. doi: 10.1007/s11027-014-9543-x

CrossRef Full Text | Google Scholar

Frame, B., Lawrence, J., Ausseil, A.-G., Reisinger, A., and Daigneault, A. (2018). Adapting global shared socio-economic pathways for national and local scenarios. Clim. Risk Manag. 21, 39–51. doi: 10.1016/j.crm.2018.05.001

CrossRef Full Text | Google Scholar

Gomes, L. C., Bianchi, F. J. J. A., Cardoso, I. M., Schulte, R. P. O., Arts, B. J. M., and Fernandes Filho, E. I. (2020). Land use and land cover scenarios: an interdisciplinary approach integrating local conditions and the global shared socioeconomic pathways. Land Use Policy 97:104723. doi: 10.1016/j.landusepol.2020.104723

CrossRef Full Text | Google Scholar

Guaita García, N., Martínez Fernández, J., and Fitz, C. (2020). Environmental scenario analysis on natural and social-ecological systems: a review of methods, approaches and applications. Sustainability 12:7542. doi: 10.3390/su12187542

CrossRef Full Text | Google Scholar

Hamilton, M. C., Thekdi, S. A., Jenicek, E. M., Harmon, R. S., Goodsite, M. E., Case, M. P., et al. (2013). Case studies of scenario analysis for adaptive management of natural resource and infrastructure systems. Environ. Syst. Decis. 33, 89–103. doi: 10.1007/s10669-012-9424-3

CrossRef Full Text | Google Scholar

Hansson, S., and Polk, M. (2018). Assessing the impact of transdisciplinary research: the usefulness of relevance, credibility, and legitimacy for understanding the link between process and impact. Res. Eval. 27, 132–144. doi: 10.1093/reseval/rvy004

CrossRef Full Text | Google Scholar

Harvey, J. A., van den Berg, D., Ellers, J., Kampen, R., Crowther, T. W., Roessingh, P., et al. (2018). Internet blogs, polar bears, and climate-change denial by proxy. Bioscience 68, 281–287. doi: 10.1093/biosci/bix133

PubMed Abstract | CrossRef Full Text | Google Scholar

Hill, R., Walsh, F. J., Davies, J., Sparrow, A., Mooney, M., Wise, R. M., et al. (2020). Knowledge co-production for Indigenous adaptation pathways: transform post-colonial articulation complexes to empower local decision-making. Glob. Environ. Change 65:102161. doi: 10.1016/j.gloenvcha.2020.102161

CrossRef Full Text | Google Scholar

Jaiswal, J., LoSchiavo, C., and Perlman, D. C. (2020). Disinformation, misinformation and inequality-driven mistrust in the time of COVID-19: lessons unlearned from AIDS denialism. AIDS Behav. 24, 2776–2780. doi: 10.1007/s10461-020-02925-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Jasanoff, S. (2021). Humility in the anthropocene. Globalizations 1–15. doi: 10.1080/14747731.2020.1859743

CrossRef Full Text | Google Scholar

Kovaka, K. (2021). Climate change denial and beliefs about science. Synthese 198, 2355–2374. doi: 10.1007/s11229-019-02210-z

CrossRef Full Text | Google Scholar

Kunseler, E.-M., Tuinstra, W., Vasileiadou, E., and Petersen, A. C. (2015). The reflective futures practitioner: balancing salience, credibility and legitimacy in generating foresight knowledge with stakeholders. Futures 66, 1–12. doi: 10.1016/j.futures.2014.10.006

CrossRef Full Text | Google Scholar

Lehtonen, H. S., Aakkula, J., Fronzek, S., Helin, J., Hildén, M., Huttunen, S., et al. (2021). Shared socioeconomic pathways for climate change research in Finland: co-developing extended SSP narratives for agriculture. Reg. Environ. Change 21:7. doi: 10.1007/s10113-020-01734-2

CrossRef Full Text | Google Scholar

Lemos, M. C., and Morehouse, B. J. (2005). The co-production of science and policy in integrated climate assessments. Glob. Environ. Change 15, 57–68. doi: 10.1016/j.gloenvcha.2004.09.004

CrossRef Full Text | Google Scholar

Lino, J., Rohat, G., Kirshen, P., and Dao, H. (2019). Extending the shared socioeconomic pathways at the city scale to inform future vulnerability assessments — the case of Boston, Massachusetts. J. Extr. Even. 6:2050009. doi: 10.1142/S2345737620500098

CrossRef Full Text | Google Scholar

Maier, H. R., Guillaume, J. H. A., van Delden, H., Riddell, G. A., Haasnoot, M., and Kwakkel, J. H. (2016). An uncertain future, deep uncertainty, scenarios, robustness and adaptation: how do they fit together? Environ. Model. Softw. 81, 154–164. doi: 10.1016/j.envsoft.2016.03.014

CrossRef Full Text | Google Scholar

Mistry, J., Tschirhart, C., Verwer, C., Glastra, R., Davis, O., Jafferally, D., et al. (2014). Our common future? Cross-scalar scenario analysis for social–ecological sustainability of the Guiana Shield, South America. Environ. Sci. Policy 44, 126–148. doi: 10.1016/j.envsci.2014.05.007

CrossRef Full Text | Google Scholar

Mitter, H., Techen, A.-K., Sinabell, F., Helming, K., Schmid, E., Bodirsky, B. L., et al. (2020). Shared socio-economic pathways for european agriculture and food systems: the eur-agri-SSPs. Glob. Environ. Change 65:102159. doi: 10.1016/j.gloenvcha.2020.102159

PubMed Abstract | CrossRef Full Text | Google Scholar

Nalau, J., Torabi, E., Edwards, N., Howes, M., and Morgan, E. (2021). A critical exploration of adaptation heuristics. Clim. Risk Manag. 32:100292. doi: 10.1016/j.crm.2021.100292

CrossRef Full Text | Google Scholar

Nilsson, A. E., Bay-Larsen, I., Carlsen, H., van Oort, B., Bjørkan, M., Jylhä, K., et al. (2017). Towards extended shared socioeconomic pathways: a combined participatory bottom-up and top-down methodology with results from the Barents region. Glob. Environ. Change 45, 124–132. doi: 10.1016/j.gloenvcha.2017.06.001

CrossRef Full Text | Google Scholar

O'Neill, B. C., Carter, T. R., Ebi, K., Harrison, P. A., Kemp-Benedict, E., Kok, K., et al. (2020). Achievements and needs for the climate change scenario framework. Nat. Clim. Change 10, 1074–1084. doi: 10.1038/s41558-020-00952-0

PubMed Abstract | CrossRef Full Text | Google Scholar

O'Neill, B. C., Kriegler, E., Riahi, K., Ebi, K. L., Hallegatte, S., Carter, T. R., et al. (2014). A new scenario framework for climate change research: the concept of shared socioeconomic pathways. Clim. Change 122:387–400. doi: 10.1007/s10584-013-0905-2

CrossRef Full Text | Google Scholar

Pedde, S., Harrison, P. A., Holman, I. P., Powney, G. D., Lofts, S., Schmucki, R., et al. (2021). Enriching the Shared Socioeconomic Pathways to co-create consistent multi-sector scenarios for the UK. Sci. Total Environ. 756:143172. doi: 10.1016/j.scitotenv.2020.143172

PubMed Abstract | CrossRef Full Text | Google Scholar

Pereira, L., Kuiper, J. J., Selomane, O., Aguiar, A. P. D., Asrar, G. R., Bennett, E. M., et al. (2021). Advancing a toolkit of diverse futures approaches for global environmental assessments. Ecosyst. People 17, 191–204. doi: 10.1080/26395916.2021.1901783

CrossRef Full Text | Google Scholar

Peterson, G. D., Cumming, G. S., and Carpenter, S. R. (2003). Scenario planning: a tool for conservation in an uncertain world. Conserv. Biol. 17, 358–366. doi: 10.1046/j.1523-1739.2003.01491.x

CrossRef Full Text | Google Scholar

Pielke, R. A. Jr. (2007). The Honest Broker: Making Sense of Science in Policy and Politics. Cambridge: Cambridge University Press.

Google Scholar

Pólya, G. (1990). How to Solve It: A New Aspect of Mathematical Method, 2nd Edn. London: Penguin Books.

Google Scholar

Preston, B. L., Mustelin, J., and Maloney, M. C. (2015). Climate adaptation heuristics and the science/policy divide. Mitig. Adapt. Strateg. Glob. Change 20, 467–497. doi: 10.1007/s11027-013-9503-x

CrossRef Full Text | Google Scholar

Rawluk, A., and Godber, A. (2011). Widening the scope of scenario planning in small communities: a case study use of an alternative method. Ecol. Soc. 16:11. doi: 10.5751/ES-03852-160111

CrossRef Full Text | Google Scholar

Reimann, L., Vollstedt, B., Koerth, J., Tsakiris, M., Beer, M., and Vafeidis, A. T. (2021). Extending the Shared Socioeconomic Pathways (SSPs) to support local adaptation planning—a climate service for Flensburg, Germany. Futures 127:102691. doi: 10.1016/j.futures.2020.102691

CrossRef Full Text | Google Scholar

Reisinger, A., Wratt, D., Allan, S., and Larsen, H. (2011). “The role of local government in adapting to climate change: lessons from New Zealand,” in Climate Change Adaptation in Developed Nations, Advances in Global Change Research, eds J. D. Ford and L. Berrang-Ford (Dordrecht: Springer Netherlands), 303–319. doi: 10.1007/978-94-007-0567-8_22

CrossRef Full Text | Google Scholar

Rosen, R. A. (2021). Why the shared socioeconomic pathway framework has not been useful for improving climate change mitigation policy analysis. Technol. Forecast. Soc. Change 166:120611. doi: 10.1016/j.techfore.2021.120611

CrossRef Full Text | Google Scholar

Sarkki, S., Heikkinen, H. I., Komu, T., Partanen, M., Vanhanen, K., and Lépy, É. (2020). How boundary objects help to perform roles of science arbiter, honest broker, and issue advocate. Sci. Public Policy 47, 161–171. doi: 10.1093/scipol/scz055

CrossRef Full Text | Google Scholar

Sarkki, S., Niemelä, J., Tinch, R., van den Hove, S., Watt, A., and Young, J. (2014). Balancing credibility, relevance and legitimacy: a critical assessment of trade-offs in science–policy interfaces. Sci. Public Policy 41, 194–206. doi: 10.1093/scipol/sct046

CrossRef Full Text | Google Scholar

Sarkki, S., Tinch, R., Niemelä, J., Heink, U., Waylen, K., Timaeus, J., et al. (2015). Adding ‘iterativity’ to the credibility, relevance, legitimacy: a novel scheme to highlight dynamic aspects of science–policy interfaces. Environ. Sci. Policy 54, 505–512. doi: 10.1016/j.envsci.2015.02.016

CrossRef Full Text | Google Scholar

Schmitt Olabisi, L., Ugochukwu Onyeneke, R., Prince Choko, O., Nwawulu Chiemela, S., Liverpool-Tasie, L. S. O., Ifeyinwa Achike, A., et al. (2020). Scenario planning for climate adaptation in agricultural systems. Agriculture 10:274. doi: 10.3390/agriculture10070274

CrossRef Full Text | Google Scholar

Simpson, N. P., Mach, K. J., Constable, A., Hess, J., Hogarth, R., Howden, M., et al. (2021). A framework for complex climate change risk assessment. One Earth 4, 489–501. doi: 10.1016/j.oneear.2021.03.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Smith, L. T. (2012). Decolonizing Methodologies: Research and Indigenous Peoples, 2nd Edn. London: Zed Books.

Google Scholar

Starfield, A. M., Smith, K. J., and Bleloch, A. L. (1994). How to Model It: Problem Solving for the Computer Age. Edina, MN: Burgess International.

Google Scholar

Stirling, A. (2008). “Opening up” and “closing down”: power, participation, and pluralism in the social appraisal of technology. Sci. Technol. Hum. Val. 33, 262–294. doi: 10.1177/0162243907311265

CrossRef Full Text | Google Scholar

Tangney, P. (2017). What use is CRELE? A response to Dunn and Laing. Environ. Sci. Policy 77, 147–150. doi: 10.1016/j.envsci.2017.08.012

CrossRef Full Text | Google Scholar

Uscinski, J. E., Enders, A. M., Klofstad, C. A., Seelig, M. I., Funchion, J. R., Everett, C., et al. (2020). Why do people believe COVID-19 conspiracy theories? Harvard Kennedy School (HKS) Misinf. Rev. doi: 10.37016/mr-2020-015

CrossRef Full Text | Google Scholar

Wesche, S. D., and Armitage, D. R. (2014). Using qualitative scenarios to understand regional environmental change in the Canadian North. Reg. Environ. Change 14, 1095–1108. doi: 10.1007/s10113-013-0537-0

CrossRef Full Text | Google Scholar

White, D. D., Wutich, A., Larson, K. L., Gober, P., Lant, T., and Senneville, C. (2010). Credibility, salience, and legitimacy of boundary objects: water managers' assessment of a simulation model in an immersive decision theater. Sci. Public Policy 37, 219–232. doi: 10.3152/030234210X497726

CrossRef Full Text | Google Scholar

Wynne, B. (1991). Knowledges in context. Sci. Technol. Hum. Val. 16, 111–121. doi: 10.1177/016224399101600108

CrossRef Full Text | Google Scholar

Wynne, B. (1992). Misunderstood misunderstanding: social identities and public uptake of science. Public Underst. Sci. 3, 281–304. doi: 10.1088/0963-6625/1/3/004

CrossRef Full Text | Google Scholar

Zandersen, M., Hyytiäinen, K., Meier, H. E. M., Tomczak, M. T., Bauer, B., Haapasaari, P. E., et al. (2019). Shared socio-economic pathways extended for the Baltic Sea: exploring long-term environmental problems. Reg. Environ. Change 19, 1073–1086. doi: 10.1007/s10113-018-1453-0

CrossRef Full Text | Google Scholar

Keywords: boundary work, climate change, cross-scale, integrated assessment models, local-parallel scenarios, multi-scale, research evaluation, SSPs

Citation: Cradock-Henry NA and Frame B (2021) Advancing Relevance, Credibility, Legitimacy, and Effectiveness as a Heuristic for Local-Parallel Scenarios. Front. Clim. 3:705229. doi: 10.3389/fclim.2021.705229

Received: 04 May 2021; Accepted: 10 June 2021;
Published: 02 July 2021.

Edited by:

Marina Baldissera Pacchetti, University of Leeds, United Kingdom

Reviewed by:

Sam Grainger, Maynooth University, Ireland
Hemen Mark Butu, Kyungpook National University, South Korea

Copyright © 2021 Cradock-Henry and Frame. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Nicholas A. Cradock-Henry, cradockhenryn@landcareresearch.co.nz

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.