Trustworthy Predictive Algorithms for Complex Forest System Decision-Making

Rana, Pushpendra; Varshney, Lav R.

doi:10.3389/ffgc.2020.587178

REVIEW article

Front. For. Glob. Change, 11 January 2021

Sec. People and Forests

Volume 3 - 2020 | https://doi.org/10.3389/ffgc.2020.587178

This article is part of the Research Topic Tree Restoration and Food Security: Trade-Offs and Co-Benefits View all 4 articles

Trustworthy Predictive Algorithms for Complex Forest System Decision-Making

$\nPushpendra Rana,$ Pushpendra Rana^1,2^*

Lav R. Varshney³

¹Indian Forest Service, Shimla, India
²Affiliated Researcher, University of Illinois at Urbana-Champaign, Urbana, IL, United States
³Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, 314 Coordinated Science Laboratory, Urbana, IL, United States

Advances in predictive algorithms are revolutionizing how we understand and design effective decision support systems in many sectors. The expanding role of predictive algorithms is part of a broader movement toward using data-driven machine learning (ML) for modalities including images, natural language, speech. This article reviews whether and to what extent predictive algorithms can assist decision-making in forest conservation and management. Although state-of-the-art ML algorithms provide new opportunities, adoption has been slow in forest decision-making. This review shows how domain-specific characteristics, such as system complexity, impose limits on using predictive algorithms in forest conservation and management. We conclude with possible directions for developing new predictive tools and approaches to support meaningful forest decisions through easily interpretable and explainable recommendations.

Introduction

Algorithmic decision-making is becoming ubiquitous. Predictive machine learning (ML) assists humans in natural language processing, speech, and image recognition, as applied in many sectors including healthcare and law (Jordan and Mitchell, 2015; Gómez et al., 2018; Mueller et al., 2019). Predictive algorithms help humans take effective and consistent decisions, assist them in prioritizing led attention (Varshney, 2016) through useful insights (Appel et al., 2014), process large-scale data into usable form (Simon, 1996), and monitor and control events in real-time. Algorithmic decisions are sometimes cast as an alternative to vague, noisy, and biased human decision-making (Appel et al., 2014). By augmenting human ability, algorithmic decisions may save time, energy, and resources in public delivery of services (Mehta et al., 2013; Appel et al., 2014; Varshney, 2016). When we use the term ML in this paper, we always refer to predictive algorithms, even though they are only a subset of ML. See Table 1 for a glossary of ML terms.

TABLE 1

Table 1. Terms and approaches in machine learning (definitions and references)^*.

Prediction, however, is not a new idea in forestry and is considered a critical component of forestry science along with knowledge and understanding (Kimmins et al., 2005). Forestry scholars have used forecasting and scenarios-based analyses (Kimmins et al., 2005; Heinonen et al., 2017), growth and yield models (Amaro et al., 2003; Burkhart and Tomé, 2012), and individual-based forest gap models to predict forest succession, composition, and effects of changes in the environment on forests (Botkin et al., 1972; Purves et al., 2008). They have also used Bayesian network models to predict forest fires (Sevinc et al., 2020), Markov chain models to predict forest dynamics (Feldman et al., 2005), and multilevel nonlinear mixed models to predict forest growth variables (Hall and Bailey, 2001). ML is a promising data-driven approach to prediction in forestry science, enabling better predictions about future forest states and assisting in forest decisions.

Inspired by success in other sectors, scholars have started exploring ML for forest conservation and management. Recent examples include predicting wildlife poaching (Gurumurthy et al., 2018), classifying drivers of global forest loss (Curtis et al., 2018), and predicting deciduous tree species composition using unmanned aerial vehicle multispectral data (Franklin and Ahmed, 2018). Other applications include identifying fire risk zones (Sakr et al., 2010; Rodrigues and de la Riva, 2014; Dutta et al., 2016), producing spatially explicit carbon stock maps to monitor forest-based climate change mitigation mechanisms such as reducing emissions from deforestation and forest degradation (REDD+) (Baccini et al., 2012; Mascaro et al., 2014), and detecting subtle changes in forests, forest types, and land use from hyperspectral imagery (Li et al., 2013; Curtis et al., 2018; Holloway and Mengersen, 2018). A variety of algorithms are used, including random forests and deep neural networks. Despite recent progress, however, there has been limited research on whether and to what extent predictive algorithms can assist decision-making processes in forestry.

This article reviews relevant ML studies in forestry to identify trends and patterns of existing literature in suggesting solutions to forest decision-making. Forest decision-making, in this review, includes all decisions related to management and conservation of forests, wildlife, and biodiversity. ML-based applications may assist forest managers, policymakers, and frontline forestry staff to make better decisions to protect forests and wildlife by providing subtle and deeper insights into the various dimensions of particular forest management decisions. We find that any meaningful endeavor to design ML applications may require algorithms appropriate to the domain-specific characteristics of forestry including scale-dependence of complex human-forest relationships (Moran and Ostrom, 2005), as well as system-level dynamics, interactions, feedback loops, nonlinearities, surprises, and unintended consequences (Liu et al., 2007; Ostrom, 2009; Hofman et al., 2017).

Forest decision-making is context-specific and influenced by power and regulatory structures, incentives, and professional norms. Many factors lead to an observed forestry outcome, and the importance of these factors and the interactions among them vary across different contexts (Fleischman, 2014). Competing land uses such as carbon storage, livelihoods, biodiversity conservation, and timber harvesting, as well as heterogeneous stakeholders further complicates forest decision-making in the face of difficult tradeoffs among these multiple uses (Chhatre and Agrawal, 2009; Persha et al., 2011) and user groups. Moreover, there are considerable limits to predictability (Liverman and Cuesta, 2008). We argue that such complexity in forestry systems and decision-making has limited the use of prediction in forestry and necessitates new tools and approaches to support meaningful forest decisions through easily interpretable and explainable recommendations (Hofman et al., 2017; Mueller et al., 2019; Selbst et al., 2019; Salganik et al., 2020) that engender trust.

Drawing on a traditional review method (Jesson et al., 2011), we identify relevant studies that use ML approaches in forest decision-making. These studies include primary studies and reviews. We searched in Google Scholar and arXiv for scholarly articles using keywords including combinations of “forests,” “forest decision making,” “forest management,” “wildlife,” “biodiversity,” and “forest conservation” with “machine learning” or “artificial intelligence” or “predictive algorithms.” We also searched for “accountability” or “fairness” or “interpretability” with “machine learning” or “artificial intelligence” or “predictive algorithms.” The review was open to all years of publication and not delimited to a select time period. The latest search was done in April-May, 2020. We further examined the citation list of published reviews covering various aspects of machine learning and artificial intelligence in various fields and selected relevant articles to expand our list of articles for this review. We found 81 articles as a result of our searches and all of them were reviewed.

Based on broader literature in forest management, we identified three critical dimensions related to forest decision-making: (a) forest system complexity, (b) interpretability, and (c) fairness and justice, which require adequate consideration in expanding the use of ML in forest management decision support. We categorized the reviewed papers into these three classes and synthesized their findings within each category through narrative synthesis to examine evidence on the limitations of predictive algorithms in forest conservation and management.

After characterizing the crosscutting challenges inherent in the forestry sector relating to the use of predictive algorithms in forest decision-making, the review concludes by highlighting some especially promising research frontiers for ML in forest decision-making. Given our focus on synthesizing available evidence on ML in forest conservation and management, we do not claim that this review comprehensively covers the literature on ML applications in forestry sciences, though we believe it does provide an accurate depiction of current trends.

Predictive Algorithms and Forest Decision-Making: Critical Dimensions

ML scholars have started developing a range of applications based on predictive algorithms to assist forest decision-making. Our review showed a recent increase in the number of these applications with work focused on supervised learning rather than other forms of machine learning such as unsupervised, semi-supervised, or reinforcement learning. ML scholars have used a range of approaches to assist forest decision-making (please refer to Table 1 for definitions of some of these ML approaches and terms).

Based on broader trends in these studies, we identified three major dimensions related to forest systems that impose limitations on the use of predictive algorithms in forest decision-making. Table 2 provides a comprehensive view of critical dimensions to support forest decision-making, possible strategies, and limits of predictive algorithms to support these strategies due to cross-cutting challenges. Papers listed in the last column of Table 2 represent only selected papers to highlight key limits of predictive algorithms in supporting forest decision-making. Below we detail each of these three dimensions: (a) forest system complexity, (b) interpretability, and (c) fairness and justice in algorithms, and synthesize relevant studies under each dimension through narrative syntheses to generate evidence on the limits of prediction in forest decision-making.

TABLE 2

Table 2. Critical dimensions of forest decision-making, possible strategies and limits of predictive algorithms to support these strategies.

Forest System Complexity and Algorithmic Decision-Making

Forests are complex social-ecological systems with system-level dynamics, interactions, and feedback loops (Liu et al., 2007; Ostrom, 2009; Hofman et al., 2017). Social and ecological variables in forestry systems show dynamic, nonlinear growth or relationships with other variables, and have thresholds where their value and plausible impact on the outcome of interest change direction. Interventions in forest ecosystems involve synergies and tradeoffs among multiple objectives that unfold at multiple scales (Persha et al., 2011), experience regular surprises and unintended consequences (Liu et al., 2007), and often have social and ecological processes operating at different scales (Baylis et al., 2016). The presence of time lags in social-ecological impacts of conservation interventions (Miller et al., 2017), varying degrees of resilience in social-ecological systems such as forests (Liu et al., 2007), and difficulty in modeling human behavior (Hofman et al., 2017; Salganik et al., 2020) further leads to poor understanding of these systems.

Forest managers can make sound decisions only if they understand problems, have access to relevant information, and know how to use this information, which is challenging in the face of complex forest dynamics. Any decision support in forest management requires understanding the type, scale, and depth of available information and knowledge about forest systems (Stock and Rauscher, 1996). Moreover, given large uncertainty in human behavior (Nishant et al., 2020), it is important to understand how people affected by a particular forest management application will react. In the absence of cognitive support, forest managers largely make decisions relying on subjective values, individual preferences, perceptions, and expectations. This results in incoherent decisions that do not meet mutually-agreed-upon standards (Stock and Rauscher, 1996). Developing algorithms to support such multifarious decision-making is challenging.

Forestry decisions may be especially poor for problems that are not uniformly perceived, prioritized, or processed (Ordóñez et al., 2020). For example, government officials perceive forestry threats differently than others (Yousefpour et al., 2017), and therefore collect forestry data in a particular way that reflects their biases. This may result in incomplete, inaccurate, and biased data, which may limit its utility in decision support systems. Moreover, there are a range of drivers and processes that determine forestry decisions (Fleischman, 2014). For example, external donors and environmental NGOs influence forestry decision-making around the world at the community and national levels (Ayana et al., 2018). ML-based predictions of forest growth in a changing climate may not be useful, as they rely on forest growth and yield models that abstract highly complex and nonlinear forest systems into simplistic forms (Ashraf et al., 2015). Similarly, ML-driven decisions to support wildlife habitat management may not be useful in areas with high faunal and floral diversity, since there is substantial forest complexity and dynamic relationships among species (Gonzalez et al., 2016). We argue that the complexity of forest systems and the factors that influence decisions require any predictive algorithm to incorporate domain-specific characteristics of forests. However, this may be daunting.

Limits to Prediction in Forest Systems

Due to dynamic, nonlinear relationships and thresholds, there may be uncertainty and limits to predictability, leading to ineffectual ML models (Gonzalez et al., 2016; Rey et al., 2017; Gholami et al., 2019). For example, Rana and Miller (2019) show that vegetation growth as measured by NDVI (Normalized Difference Vegetation Index) follows a nonlinear trend in Kangra district in northern India. Moreover, in the same district, different forest management units show different NDVI outcome trajectories, driven by varying social-ecological attributes and pathways, emphasizing that couplings between people and nature vary across space, time, and organizational units (Liu et al., 2007; Rana and Miller, 2019). As another example, increased variability in the biomass of big trees caused loss of accuracy and bias, under ML models that estimate biomass of tropical forest trees (Montano et al., 2017).

Even large datasets fail to capture the full range of outcomes due to geographic complexities, which can affect the class accuracies of a predictive algorithm. For example, despite large sample sizes comprising millions of 10 km × 10 km grid cells around the world and training sample cells (n = 5,000), Curtis et al. (2018) noticed considerable regional variation in accurately classifying drivers of global forest loss due to insufficient distinction of one land use and management category from another, as well as sparse training data in certain classes. There can also be extremely imbalanced data that makes accurate prediction difficult, e.g., in developing an ML pipeline to identify areas at high risk of poaching in the protected areas of Uganda (Gholami et al., 2019). The size of raw data can also be problematic, e.g., in recent attempts to monitor audio signals of African elephants with real-time ML methods to offer protection against poachers, network bandwidth limitations required efficient audio compression (Bjorck et al., 2019).

Quantifying uncertainty is also difficult. For example, in using deep learning to project Australia's forest cover dynamics, it was difficult to make uncertainty projections due to the large number of model parameters (Ye et al., 2019). Transfer of models trained with particular sets of conditions in a given forest system to a new system with different kinds of conditions is difficult (Hart et al., 2019). Similarly, transferring computer vision models for classifying animal species in camera trap images trained in one region to another is difficult due to the presence of previously-unseen species (Beery et al., 2019).

Simplification of Broader Contexts Limits ML Effectiveness in Forest Decision-Making

Predictive algorithms may face difficulty in encompassing all system-level processes such as spatial and temporal dynamics, interactions, and feedbacks (Struss, 2004; Liu et al., 2007; Gonzalez et al., 2016; Kroll et al., 2016; Rey et al., 2017; Curtis et al., 2018; Hethcoat et al., 2019). System-level information should include all factors that operate at the subsystem level (actor, governance systems, resource system, resource unit, and external influences) to influence a particular outcome (Ostrom, 2009; Bland et al., 2015). For example, the decision of private forest landowners to harvest trees from their farms is based on several factors including actor-level (e.g., education, age, and income), resource system (farm size), location (distance, elevation, and slope), and market (timber prices) (Silver et al., 2015; Snyder and Kilgore, 2018). Usually, predictive algorithms model a component of social-ecological systems while ignoring the social actors, institutions, and interactions within these systems, resulting in the elimination of larger context (Rodrigues and de la Riva, 2014; Dutta et al., 2016; Holloway and Mengersen, 2018; Selbst et al., 2019). Missing such factors, interactions, and feedback loops may abstract the larger context into a simple model that provides inadequate decision-support in forest and wildlife management (Holloway and Mengersen, 2018; Selbst et al., 2019). We present below two decision-making contexts, tree-planting and wildlife management, to emphasize this point further.

First, let us consider how ignoring broader contexts in tree planting can restrict its effectiveness as a natural climate solution (Figure 1) (Bastin et al., 2019). We have operationalized a social-ecological system (SES) framework to show the complex nature of tree planting site-selection decisions. The decision problem is where to plant trees in a landscape. This is complicated by the presence of multiple stakeholders, diverse governance and resource system contexts, along with interactions and feedbacks involved in tree-planting site selection. Various rules, acts, and cultural norms of forest department, scheme-specific planting and budgetary guidelines, land tenure rights, and participatory provisions govern these planting decisions. Selected enclosures for growing trees are part of the resource system (forests, grasslands, plantations, unproductive lands). The availability of blank patches, site quality constraints, and socio-economic factors set conditions for tree planting site selection decisions (Rana and Varshney, 2020).

FIGURE 1

Figure 1. Operationalizing a social–ecological system (SES) framework to show the complex nature of tree planting site-selection decisions in forest systems.

The final tree planting decisions on forests and or other types of lands determine the future social and ecological outcomes, which then influence each of the sub-systems (governance systems, actors, resource system and resource unit) through positive or negative feedback. For example, the local community may be using the planting site for grazing animals, organizing village events, or cultivating crops. Such interactions are highly dynamic, unpredictable, and influenced by seasonality and the changing livelihood needs of local communities. Also, there is a high likelihood that overgrazing in that planting site or planting a community-unfriendly tree species may lead to extensive forest degradation. Moreover, growing a tree plantation into a secondary forest usually takes 15 or more years. Due to this inherent temporal uncertainty in forestry outcomes, it is difficult for any data scientist to appropriately model such time lags and capture all interactions, feedback loops, and dynamics over the longer-term (Thompson et al., 2012).

Second, let us consider how it is difficult for data scientists to capture complex and dynamic contexts inherent in wildlife management while designing any ML-based applications. As an example, wildlife managers use habitat suitability models for individual wild animals to decide how to protect them. ML models can help create more general suitability models. However, developing such models to scale up to the population- or a landscape-level comprising multiple faunal and floral species is difficult due to their complex interactions (Debeljak et al., 2001). Modeling such complex wildlife systems requires information about forest structure, tree species composition, herbal and shrub layers, plant species distribution, habitat management activities, and feeding places of animals. Moreover, animal tracking must identify sex, seasonality, and diurnal characteristics to improve modeling outcomes (Debeljak et al., 2001). A recent ML application to support ranger patrol strategies in Zimbabwe to protect elephants from poachers required participatory modeling processes and accounted for observer bias in modeling through robust and regular data collection of patrol efforts at a relevant scale (Kuiper et al., 2020). However, obtaining such complex and dynamic data to build useful ML models to support wildlife decisions is difficult and may not be prioritized by field staff with other pressing responsibilities.

Interpretability and Algorithmic Decision-Making

Clear and easily explainable information is a must for forest decision-making: it may reduce the trust deficit between stakeholders and forest officials for particular forest conservation and management tasks, especially in the context of prevailing mistrust between foresters and local communities in several parts of the world (Springate-Baginski and Blaikie, 2013). On the other hand, uninterpretable decision support systems restrict the ability of forestry officials to persuade local communities and other stakeholders to support suitable forestry decisions. Forest managers and forest users are likely to feel alienated from decision-making processes without interpretability. Indeed, diffuse, inscrutable, and non-intuitive information can result in poor forestry outcomes. For example, if an ML tree planting support system fails to provide easily understood information to a forest official on why a particular site is preferred for growing trees, that forest guard will either ignore it or follow it unconvincingly, resulting in poor planting decisions. This would not only lead to poor survivorship of tree plantations, but also wasteful expenditure. There are several reasons predictive algorithms fail to produce interpretable explanations as detailed below.

Experts Design Algorithms as a Purely Technical Exercise

Experts design ML applications in isolation from the local social context, casting them as purely technical problems that end up yielding unusable and inexplicable recommendations (Wagstaff, 2012). As per a recent estimate, only 1% of ML papers interpret results in their specific contexts, as these interpretations are hard to make and further, there is little scholarly tradition within this field for reporting such interpretations (Wagstaff, 2012).

Limits to Designing Interpretable Algorithms Due to System Complexity

The complexity in social-ecological systems, such as forests, further restricts the ability of developers to produce standardized and interpretable algorithms (Hofman et al., 2017; Norouzzadeh et al., 2018; Ferraro et al., 2019; Mueller et al., 2019; Selbst et al., 2019). Many algorithms are based on simplistic assumptions about social actors, institutions, and their interactions, and may not serve forest officials due to their model choices (Rodrigues and de la Riva, 2014; Dutta et al., 2016). For example, an early fire detection model relied only on weekly climatic data and assumed humans have little influence on fire occurrences in Australia (Dutta et al., 2016). Often, algorithm developers, let alone policymakers, do not understand the mechanistic reasoning an algorithm has come up with, reasons behind certain assumptions about social-ecological systems, or choices of tuning and regularization parameters. For example, while using deep learning for wildlife species identification and counting from camera trap images, further explanation into choices made by data scientists in picking certain hyperparameters may improve modeling outcomes and their better understanding (Norouzzadeh et al., 2018). All of these phenomena make it difficult for people directly affected by implementing decisions from such algorithms to trust them or even to take appropriate decisions to support forest conservation and management (Mueller et al., 2019).

ML Models Often Lack Transparency, Restricting Their Deployment in Forest Decision-Making

ML models are often considered as black-box models that have highly entangled input features, which make their disaggregation into human understandable form difficult (Naidoo et al., 2012). For the same set of input features and prediction tasks, complex ML models can generate multiple accurate models with varying details of explanations (Adadi and Berrada, 2018). Simpler models on the other hand may find some variables as important predictors (Rodrigues and de la Riva, 2014) rather than incorporating the broader social-ecological context, which is necessary for meaningful ML-based decisions. Moreover, the absence of causal pathways from inputs to outputs in ML applications restricts their ecological interpretability and therefore limits their adoption in forestry decision-support systems (Drake et al., 2006; Aertsen et al., 2010; Nunes and Görgens, 2016). More importantly, causal relationships between predictors and outcomes may elude such algorithms that are only evaluated by predictive success and not optimized to answer causal questions. The problems of data overfitting further narrow the interpretability of such models, making their use in forestry decision-making difficult (Aertsen et al., 2010). Mascaro et al. (2014) find overfitting and spatial correlation of model errors as limitations of their model to map tropical forest carbon by upscaling LiDAR-based carbon estimates (Mascaro et al., 2014).

The lack of accurate and adequate data in forestry further limits developing interpretable models (Lippitt et al., 2008; Kar et al., 2017; O'Connor et al., 2017; Curtis et al., 2018; Franklin and Ahmed, 2018; Gurumurthy et al., 2018; Gholami et al., 2019; Hethcoat et al., 2019). Scholars have noticed significant class imbalance, sparsity, and noise in the patrolling datasets they use in predicting wildlife poaching (Bland et al., 2015; Kar et al., 2017; Gurumurthy et al., 2018; Gholami et al., 2019). They also identified geographic and language barriers in collecting and synthesizing data for forest conservation decisions (Gurumurthy et al., 2018). The absence of high-quality data (and lack of computing power and black-box nature of deep learning) is problematic in modeling the physical properties of forest ecosystems, as noticed during forest damage assessment in Bavaria, Germany (Hamdi et al., 2019). Moreover, while exploring convolutional neural networks to analyze biodiversity, lack of adequate training examples in existing datasets was a critical challenge that reduced model performance (Rodner et al., 2015).

Spatial and temporal correlation in data can limit the performance of ML prediction models as observed by Ashraf et al. (2013) while using NN-based growth model to predict volume increment of individual trees (Ashraf et al., 2013). Using thousands of fuel moisture content measurements, a state-of-the-art physics-assisted recurrent neural network model for Live Fuel Moisture Content (LFMC) failed to capture spatial and temporal variability of the outcome (Rao et al., 2020). Many parametric models work well with small datasets and yield interpretable results but are hard to automate and are not flexible. On the other hand, complex ML models may require a lot of data to distill knowledge in the form of interpretable suggestions. This suggests that in the absence of large-scale forestry data, algorithms may be limited in producing insights for effective forest decision-making (Gholami et al., 2019; Hethcoat et al., 2019; Molnar, 2019) without new algorithmic developments (Yu et al., 2019).

Fairness and Justice and Algorithmic Decision-Making

Scholars have found that predictive ML algorithms often deliver inaccurate, unfair, or unjustified results (Li et al., 2013; Mascaro et al., 2014; Kroll et al., 2016; Franklin and Ahmed, 2018), discriminate on the grounds of gender, health, or ethnicity (Hajian et al., 2016), and fail to learn and adapt to changing circumstances (Mueller et al., 2019). Results from other fields indicate that predictive ML models may be unfair and unjust. For example, studies of a widely used criminal risk assessment tool showed that its predictions were racially biased (Angwin et al., 2019) and not more accurate than predictions made by a person with little or no criminal justice expertise (Dressel and Farid, 2018). Predictive algorithm-based decision support systems for child and social work also indicate many problems especially related to the accuracy of the data, algorithms, and proposed decisions (Gillingham, 2019). ML experts fail to deeply consider fairness in forest decision-making owing to their narrow focus on readily available limited-use data, neglect of broader system dynamics, and incorporation of only simplistic notions of fairness (Selbst et al., 2019).

Lack of Data Restricts Development of Fair and Just ML Applications

Datasets used in ML applications for forest conservation and management lack critical socio-economic, political, and biophysical dimensions related to forest decisions. In many cases, due to lack of detailed data on human behavior, proxies such as zip code or language patterns are used to approximate socioeconomic position of an individual and then judge her suitability for a job, loan, or conservation program. Understanding relationships with such simplistic correlations may be discriminatory (O'neil, 2016). The available data products used in ML research are inherently uncertain due to error propagation when combining multiple sources of data, modeling relationships, extrapolating to new locations, or making educated guesses about variables of interest (Kugler et al., 2019). Moreover, there is little guidance on how knowledge related to historically disadvantaged social groups such as indigenous forest peoples and women can be integrated in these data systems given the abstraction traps inherent in ML-based applications, potentially leading to unfair outcomes in forest decision-making (Selbst et al., 2019).

Data scientists developing algorithms are often completely unaware of the importance and interplay of various social-economic and political factors that influence forest decision-making. Hidden power dynamics and structures, vested economic interests, and social biases are widespread in the forestry sector, with powerful elites controlling decision-making processes to serve their objectives at the cost of forests and communities (Persha and Andersson, 2014; Rana, 2014). Without extra care in developing and deploying algorithmic support, elites may alter algorithms to serve their objectives at the cost of the larger public (Selbst et al., 2019). This negatively impacts international goals aimed at ending poverty, hunger, and other forms of social and economic discrimination. Biased algorithms may fail to support poor forest-dependent communities if algorithms do not selectively include a wider range of concerns from these groups or incorporate elements of fairness and justice based on a system-level understanding of forestry contexts especially in developing countries (Selbst et al., 2019). Without considering these biases in any ML effort, it is not possible to achieve fair and just decision support in the forestry sector.

Neglect of Broader System-Level Contexts May Lead to Unfair and Unjust Algorithms

ML scholars often treat model development as an independent activity wherein only model parameters, inputs, and outputs matter. Such an approach omits broader system-level contexts from modeling efforts, and fails to produce fair and just machine learning algorithms (Rodrigues and de la Riva, 2014; Dutta et al., 2016; Selbst et al., 2019). Justice and fairness are properties of social systems and so measuring such concepts through simple metrics at the level of technical subsystems (ML algorithms) may lead to unethical and erroneous algorithms devoid of any meaningful insights into forest decision-making. Narrowing down broader concepts of justice and fairness to narrow technological tools leads to five major abstraction traps in modeling efforts (Selbst et al., 2019). These include failure to model the entire system where a fair concept is intended to be applied (framing trap), transferring one algorithmic solution developed in one social context to a different one (portability trap), simplifying fairness concepts (formalism trap), poor understanding of how an algorithm changes human behavior (ripple effect trap), and believing that algorithms provide solutions to all problems (solutionism trap) (Selbst et al., 2019). These traps potentially limit the use of ML algorithms in solving problems in forestry where concepts of fairness and justice are complex and multi-dimensional.

Lack of Standardization May Increase Bias and Uncertainty in Algorithmic Decision-Making

The absence of common reporting and lack of meaningful quantitative metrics to evaluate ML models are some of the critical factors that may lead to their limited adoption in forest decision-making. Individual researchers' decisions on the selection of questions, data, model, and evaluation metrics may result in a high level of subjectivity and bias, and therefore, a failure to replicate results (Drake et al., 2006; Hofman et al., 2017). Moreover, abstract metrics used in ML such as classification accuracy, R² (coefficient of determination), RMSE (root mean squared error), and AUC (areas under receiver operating characteristic) may not correspond to impact of forest conservation and management interventions (Wagstaff, 2012; Hofman et al., 2017; Gholami et al., 2019). Moreover, not only do many users fail to decipher decisions made by algorithms but even the developers often fail to understand how their system works (Mueller et al., 2019). These findings suggest that ML applications can have high model uncertainties (Gholami et al., 2019), and may lead to biased and unfair outcomes in the forestry sector.

Discussion and Future Directions

This review examines current trends in the use of ML applications in forest conservation and management. As evident from this review, ML can assist forest decision-making by characterizing numerous aspects of the contexts that shape forest decision-making or other social phenomenon by bringing forth new plausible hypotheses, patterns, and relationships, which are not readily apparent to social scientists or practitioners. ML algorithms are also quite valuable in exploring complex and composite patterns, identifying new features to model human-environment interactions, which are not easily discernible (National Research Council, 1998).

To realize the full potential of ML applications in forest management, this review calls for addressing three critical challenges that restrict the widespread adoption of ML in forest conservation and management: complexity, justice, and interpretability. First, any meaningful forest decision support system based on ML must characterize limits on prediction in complex, uncertain, and dynamic social-ecological systems such as forests (Hofman et al., 2017; Mueller et al., 2019; Salganik et al., 2020). Second, any ML application must maximize the chance of reducing potential social harm and achieving fairness rather than perpetuating past injustices associated with forest conservation and management practices (Corbett-Davies and Goel, 2018). Third, in the future, the adoption of predictive algorithms in forestry will depend on how interpretable and explainable such algorithms are to local forest officials and the general public (Holloway and Mengersen, 2018). The review further provides promising future directions for ML-based predictive algorithms to support forest decision-making.

Characterize Limits on Prediction in Complex, Uncertain, and Dynamic SES Systems

There should be research on incorporating system-level attributes, interactions, and feedback loops in any prediction endeavor in forest decision-making (Struss, 2004; Holloway and Mengersen, 2018; Selbst et al., 2019). In socio-ecological systems such as forests, there could be system level dynamics, regular surprises, unintended consequences, interactions, and feedback loops, which may lower the theoretical best performance of a given model (Liu et al., 2007; Hofman et al., 2017). In this scenario, we must devise interventions that do not require accurate predictions. Under conditions where ML models perform much below the theoretical limits, it is advisable to lower the expectations about the success of the proposed algorithmic decisions in terms of predictive accuracy accordingly (Hofman et al., 2017).

Although, how to define a theoretical limit to predictive accuracy in a given complex system, such as forests, is still under debate, scholars have advocated use of better data and model classes with more informative features to construct models. For example, if a hypothesized mechanism driving a particular outcome in a forest decision-support system explains less observed variance than the theoretical limit, it is apparent that other likely mechanisms must be identified. On the other hand, if the outcomes in forest systems are intrinsically unpredictable (theoretical limit is low), our expectations about the utility of the suggested ML-algorithm should be reduced accordingly (Hofman et al., 2017). Moreover, metrics that evaluate whether the model is capable enough to explain the complexities of social-ecological systems to suggest appropriate forest decisions might be justified (Hoffman et al., 2018; Kim, 2018). To get meaningful insights, ML scholars can use simple abstraction and stochastic analysis or exploit known scientific theories in forestry science to provide useful decisions using metrics that public officials or other stakeholders care about (Struss, 2004; Varshney, 2016; Karpatne et al., 2017).

There has been recent interest in capturing system dynamics in coupled social-ecological systems. As an example, in modeling lake temperature, without using the key physical relationships between the temperature, density, and depth of water in a physics-based loss function used by neural networks, scientifically-consistent physics-based solutions cannot be obtained (Karpatne et al., 2017). These findings suggest the importance of using physics-based equations in modeling complex social-ecological systems. In addition, some scholars have suggested combining traditional forestry science knowledge, whether from professional foresters or from indigenous peoples, with an ML classifier in the form of algorithm fusion to reduce epistemic uncertainty and maintain AI decision safety in forest decision-making (Kshetry and Varshney, 2019; Rana and Varshney, 2020).

ML Applications Must Maximize the Chance of Reducing Social Harm

Making algorithms in forestry transparent to allow more scrutiny and establishing clear governance frameworks including elements of regulatory oversight, awareness-raising, and accountability in the public sector may improve algorithmic decision-making processes. This may reduce the chances of human rights violations through unfair decision-making (Koene et al., 2019; Mueller et al., 2019). Any model developer should enable algorithmic verification, validation, security, and human control over ML systems to maximize the social benefits (Russell et al., 2015) including pre-registering their models with a designated agency, as well as disclosing all choices and assumptions. They should provide a detailed account of origins and use of training and test data, choice of models and other components used in their research so that users keep these facts in mind when judging the suitability of these algorithms for forest decision-making (Whittaker et al., 2018; Mueller et al., 2019). Moreover, they should consider the data-generating process and should increasingly use theories to guide the choice of variables and other regularization parameters to enhance user confidence in algorithmic decision-making (Rana and Miller, 2018). Even organizations that create algorithms should bear some responsibility for algorithmic decision-making and associated risks (Martin, 2019).

Forest decision-making can specifically be enhanced if algorithm developers follow specific standards, rules, and best practices to ensure fairness and nondiscrimination (Kroll et al., 2016; Corbett-Davies et al., 2017; Kehl and Kessler, 2017). While crafting any fair ML algorithm to support decision-making, it is important to include social scientists, indigenous peoples, forest management committees and other institutions, and their interactions to get a holistic idea of local decision-making cultures, regulatory norms, and incentive structures in a particular forest decision-making context (Gurumurthy et al., 2018; Selbst et al., 2019). Bringing different stakeholders on one platform may, however, be tedious. For example, data scientists participating in developing ML algorithms have little overlap with social scientists in their theoretical frameworks, terminology, or empirical and epistemological approaches.

New technical solutions can enable algorithms to avoid biased data, produce equitable outcomes under various contexts, and ensure procedural regularity such that a consistent set of decision rules are used in each case (Kroll et al., 2016). Some technical tools to ensure procedural regularity may include software verification, zero-knowledge proofs, cryptographic commitments, and fair random choices. We may need to measure the impact of ML algorithms and devise algorithmic audits to understand the assumptions embedded in these models and then score them for fairness to promote their use in forest decision-making (O'neil, 2016). ML algorithms may also benefit from improving validation, conducting uncertainty analysis, incorporating qualitative data at appropriate scales, and including interactions and feedbacks (Liverman and Cuesta, 2008).

Our review shows that ML algorithms are not as “objective” as one might outwardly think and are produced within power laden systems with negligible involvement of stakeholders managing the forests. ML algorithms may be unjust and unfair to local communities if data scientists design them only using data and expert input provided by national forestry agencies. As an example, providing predictive algorithms to foresters—who hold decision making power and ultimately interpret algorithm outputs—can centralize decision-making to national forestry agencies and further widen the power gap between state agencies and local communities with negative impacts on rural livelihoods. Moreover, as algorithms by data scientists have components that they decide to include or not to include based on their own subjective judgements, it is important that social safeguards are in place where such algorithms are to be implemented, and due legal process is carried out to evaluate the social and environmental impacts of such algorithms before they are tried on ground. Any ML-research involving any plausible threat to disadvantaged groups including women, smallholder landowners, or indigenous communities should involve strict adherence to confidential norms as prescribed by various universities or research institutions through institutional review boards.

Promote Interpretable ML Models to Improve Their Adoption for Forest Decision-Making

Researchers should proactively address explainability by promoting easily interpretable ML models to improve their adoption for forest decision-making (Hoffman and Klein, 2017; Herweijer and Waughray, 2018; Padarian et al., 2020). Explanations in the form of easy to understand “coherent stories” may also improve the performance of human-ML systems (Mueller et al., 2019). Others have emphasized responsible and accountable AI, interdisciplinary approach, and adequate funding to minimize environmental harms (Herweijer and Waughray, 2018), and to develop causal models to support explanations (Lake et al., 2017) in algorithmic decision-making in forestry. Efforts should also be made to develop techniques to audit black-box predictive models to have a deeper understanding of model behavior and to identify features important in model prediction (Ribeiro et al., 2016). Some have suggested model-agnostic interpretability tools as they scale much better and are easier to automate in terms of interpretability (Molnar, 2019). Others have noted that there will always be a tradeoff between interpretability and performance of models. But, there can be cases, where such tradeoff may not exist and an interpretable model may have the best performance (Kar et al., 2017).

Theory and System-Analysis Based ML Approaches and Use of Fine-Resolution Datasets

Forest decision-making can benefit if ML-based algorithms include underlying theory and prediction of human behavior (Nguyen et al., 2016; Fang et al., 2017; Gómez et al., 2018), complex system analysis approaches to manage and conserve forest resources (Coulson et al., 1987), spatial information through satellite or unmanned aerial vehicles (Mascaro et al., 2014; Ali et al., 2015; Gonzalez et al., 2016; Rey et al., 2017; Gewali et al., 2018) and ground truth data (O'Connor et al., 2017). Our review suggests that most applications prioritize supervised learning over other forms of machine learning such as unsupervised, semi-supervised, or reinforcement learning mainly because of the focus on labeled training data. We noted that the choice of best machine learning algorithm to assist forest decision-making depends upon the nature of available data, problem, and the solution sought.

While exploring e.g. hyperspectral remote sensing data for ML applications, researchers should focus on addressing the problem of high dimensionality of data, build models invariant under different conditions, promote the use of unsupervised classification in the absence of ground truth data, and create and use new public standardized datasets (O'Connor et al., 2017; Gewali et al., 2018; Bjorck et al., 2019; Rolnick et al., 2019). Given the requirements of data needed to capture the forest complexity, we argue that predictive ML applications in forest management must be developed at a very fine scale as used by scholars (Kelling et al., 2013; Curtis et al., 2018; Norouzzadeh et al., 2018). Therefore, to benefit from ML, scholars should explore finer spatial and temporal resolution datasets for ML (Kelling et al., 2013; Norouzzadeh et al., 2018) to improve the size of their datasets to identify and solve forest conservation problems and their drivers (Lippitt et al., 2008; Ali et al., 2015; Czimber and Gálos, 2016; Curtis et al., 2018; Gewali et al., 2018; Holloway and Mengersen, 2018; Rolnick et al., 2019). Moreover, scholars may need to employ GIS and spatial analytical approaches to integrate disparate data sources and should be careful of scale of analysis (Moran and Ostrom, 2005).

However, use of fine-resolution data may instill fear among some landowners, who may worry that ML combined with fine-resolution data may reveal secrets to government officials about their land-use practices, which may violate existing regulations. Such algorithms can therefore negatively affect rural livelihoods (National Research Council, 1998). Under such cases, governments must develop norms of accountability in using fine-resolution data from remote sensing satellites to ensure transparency and fairness in any ML-based decision support system to avoid any potential decline in rural income, loss of community rights over forest resources, unjust and inequitable forest decision-making, or civic unrest and legal complications (Molnar, 2019). A standardized system for data storage, geocoding, and processing data for algorithm development can be developed and it should be open to public scrutiny.

Conclusion

In conclusion, the performance of algorithms in supporting forestry decisions should be judged on metrics that directly affect human life such as time and money saved, effort reduced, and effectiveness of conservation interventions increased (Wagstaff, 2012). To explore how much these algorithms can contribute to forest conservation and management given theoretical and practical limits of prediction in the forestry sector, an interdisciplinary partnership between foresters, ecologists, data scientists, and local communities is a must (Struss, 2004; Czimber and Gálos, 2016; Kroll et al., 2016; Salganik et al., 2020). We must also establish verifiable and safe ML systems, create adaptable and flexible algorithms suitable to different social-ecological contexts, and improve the transportability or external validity of ML models. Progress on these research themes may help build robust, credible, and productive ML systems to support forest decision-making to effectively conserve and manage forests and wildlife.

Finally, acknowledging fundamental limits to predicting human decisions and activities and maintaining awareness about the multifaceted uncertainties in data can provide alternative and innovative ML algorithms in supporting useful and meaningful forest decisions (Liverman and Cuesta, 2008; Hofman et al., 2017; Kugler et al., 2019). Drawing lessons from this review, we argue that developing effective ML algorithms to support forest decision-making requires fusion of quite different scientific traditions of ML community and forest social science, which necessitate cross-fertilization of discipline-specific theories, and empirical/epistemological cultures.

Author Contributions

PR conceptualized the study and methodology, analyzed and interpreted the data, and wrote the original draft. LV helped in interpretation of the results, provided analytical insights, and in critical revision and editing of the manuscript.

Funding

This work was supported in part by the National Science Foundation under grant CCF-1717530.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

Adadi, A., and Berrada, M. (2018). Peeking inside the black-box: a survey on explainable artificial intelligence (XAI). IEEE Access. 6, 52138–52160. doi: 10.1109/ACCESS.2018.2870052