Skip to main content

ORIGINAL RESEARCH article

Front. Sustain. Cities, 09 November 2023
Sec. Sustainable Infrastructure
This article is part of the Research Topic New frontiers in evaluation, management, and technologies for sustainable cities View all 6 articles

Trading off sustainable development in Canadian cities: theoretical implications of SDG 11 indicator aggregation approaches

\r\nMuhammad Adil Rauf
Muhammad Adil Rauf1*Cameron McCordicCameron McCordic1James SgroJames Sgro2Bruce FrayneBruce Frayne1Jeffrey WilsonJeffrey Wilson1
  • 1School of Environment, Enterprise and Development (SEED), University of Waterloo, Waterloo, ON, Canada
  • 2Balsillie School of International Affairs, Waterloo, ON, Canada

Sustainable Urban Development requires an optimization of multi-dimensional targets across social, economic, and environmental pillars of development. These multi-dimensional targets are largely captured by the United Nations Sustainable Development Goals, which comprise 17 goals spread across pillars of sustainable development. The pursuit of these targets, however, often exposes synergies and trade-offs between the goals. Broader discussions of trade-offs between human and natural capital have been conceptualized along the contours of weak versus strong conceptualizations of sustainable development. This challenge is exposed not only in strategizing sustainable urban development but also in measuring progress toward that aim. With this background in mind, there is limited research to indicate how Canadian cities are progressing toward the achievement of the Sustainable Development Goals and the extent to which trade-offs in SDG performance should be treated. This investigation collected indicators for SDG 11, Sustainable Cities and Communities, on 18 Census Metropolitan Areas in Canada for the purpose of designing an index of SDG achievement. The resulting index aggregation measures compared performance depending on whether the CMAs were allowed to trade-off performance across the SDG 11 indicators. The results expose the significant role of non-compensatory aggregation methods (which do not allow the trade-off of performance) when measuring sustainable development. The implications of these findings demonstrate the need to consider policy pathways that address these trade-offs and consider how that progress is measured.

1. Introduction

Sustainable development has shifted to a governance approach that frames cities as a catalyst for sustainable development rather than as a cause of sustainability challenges (Parnell, 2016; Zinkernagel et al., 2018). The importance of the SDGs in the accomplishment of sustainable development is well-recognized. However, the adoption of the SDGs and their indicators are facing challenges of common interests, standardized methodology, availability of reliable data, performance benchmarking, consistent reporting, and lack of institutional capacity to operationalize indicators (Simon et al., 2015; Klopp and Petretta, 2017).

The SDGs provide a comprehensive guide to policy development and governance to achieve sustainable development. It provides a framework of 17 goals with over 230 indicators to operationalize actions and monitor progress toward greater sustainability (UN, 2015). However, contextual challenges, local objectives, and lack of understanding led to misunderstandings, inconsistent measurement, and largely unevaluated outcomes. Since the adoption of SDGs in 2015, disagreements and discrepancies have emerged between national and sub-national levels in setting priorities, measurement of outcomes, aggregation of indicators, and comparison of performance.

Different perspectives and objectives led to diverse paths for achieving sustainability. The sustainability concept may have inherited an operational fuzziness due to the relational complexity of its components, determination of facts, assertion of values, and operational constraints (Gladwin et al., 1995; Gibson et al., 2013). It will require a comprehensive set of core values based on theoretical knowledge and practical implications to guide perspective, problem identification, value judgment, setting priorities, and devising appropriate methodologies to guide the evaluation and decision-making process (Gibson et al., 2013).

The SDGs are set to achieve inclusive and sustainable development, but inconsistencies still exist in setting common objectives, selecting appropriate data, and adopting standardized measurement methodologies (Ruan and Yan, 2022). Despite growing academic literature on SDGs implementation in cities (Graute, 2016; Bibri and Krogstie, 2017), gaps persist in finding a commonly accepted method of implementing and monitoring SDGs (Fenton and Gustafsson, 2017; Allen et al., 2019, 2020; Krellenberg et al., 2019). Given this context, the present investigation has its pros and cons due to differences in methodologies available to measure and compare SDG indicators for Canadian municipalities.

Given the limited research available on SDG achievement within cities, this investigation provides insight into the relative achievement of SDG 11 (focused on sustainable cities and communities) among Canadian cities). In order to do so, this investigation constructs an index of SDG 11 achievement by setting targets for SDG 11 indicators and exploring the theoretical ramifications of aggregation approaches. The implications of these aggregation approaches are explored via a discussion of their link to synergies and trade-offs in sustainable urban development.

2. Literature review

Technological advancements and rapid economic growth in the past century have impacted on socioeconomic outcomes and the natural environment. Alongside improved social outcomes and rising incomes, we have seen the catastrophic impacts of global warming, degradation of natural ecosystems, depleting resources, and high risk of pandemic due to rapid urbanization and unsustainable consumption (Pörtner et al., 2022). Population growth, urbanization, and migration have raised concerns about human well-being due to diminishing natural resources, unequal distribution of wealth, lack of access to health and education, and growing food insecurity (Brundtland, 1987; Sachs, 2012; Pörtner et al., 2022). The scale of human activities has pushed the social and natural ecosystem to a dangerous threshold questioning the sustainability of the prevailing economic system. The gravity of challenges has led to the conceptual emergence of sustainable development that can ensure human survival today and tomorrow (Kumi et al., 2014; Fanning and Hickel, 2023; Rockström et al., 2023).

Concerns that have been previously introduced include the issue of the sustainable yield of natural resources (Smil, 2000). Nineteenth-century industrialization increased the demand for natural resources, completely changing socioeconomic and socio-ecological relationships (Devezas et al., 2008). It raised concerns about protecting the natural environment, the stability of the economic system, and human well-being. In the early twentieth century and following the great depression, the concept of sustainability adopted two approaches: the sustainability of natural resources within ecological limits and corporate social responsibility (Bansal and Song, 2017). However, separating the economy from the environment wasn't an appropriate path. It requires an integrated approach encompassing the broader system in which nature, society, and the market interact (Gladwin et al., 1995; Bansal and Song, 2017; Rockström et al., 2023).

Sustainability is about acknowledging ecological limits, fair distribution of resources, and social justice within and between generations (Rauf and Weber, 2021). It is about restricting human activities within the limits of the carrying capacity of the natural system (Odum et al., 1971; Costanza, 1989; Norde, 1997). The Brundtland Commission report “Our Common Future” consolidated the conceptual description of sustainable development by defining it as the development that meets the need of the present generation without compromising the future generation's ability to meet their needs (WCED, 1987). The world recognized the need and set a common agenda by creating the Millennium Development Goals (MDGs) in 2000. The lessons learned from the MDGs stressed human-centered development and environmental protection as a universal normative base (Arico, 2014; Jayasooria, 2016; Parnell, 2016). However, it was recognized to expand the focus on operational mechanisms and inclusion of all stakeholders for horizontal and vertical integration (Gellers, 2016). Sustainable Development Goals (SDGs) were introduced in 2015 to redefine priorities, define a monitoring framework, foster greater participation, and adopt an integrated approach to sustainable development (Sachs, 2012; Martinez and Mueller, 2015; Jayasooria, 2016). The SDGs emphasize the integration of environmental objectives into socioeconomic planning and development processes at local, national, and international levels (Martinez and Mueller, 2015). It provides a comprehensive framework for monitoring global targets (Ruhil, 2017). The SDGs incorporated a wide range of targets set to achieve human well-being while maintaining economic growth within the limits of planetary boundaries (Kates et al., 2005). Environmental resilience and socioeconomic well-being are inseparable (Rockström et al., 2023). For instance, it is well-recognized that an integrated approach to sustainable development is crucial to combat the climate change impacts (Pörtner et al., 2022). However, contextual challenges due to differences in socioeconomic conditions and access to natural resources make it difficult to achieve a global consensus of setting shared objectives and goals (Griggs et al., 2013). The differences in economic and ecological perspectives make it difficult to agree on setting priorities and trade-offs between economic, environmental, and social objectives resulting in slower progress in achieving SDGs (Ayres and Gowdy, 2001; Sachs, 2012).

Growing material demand due to increasing population influences the ecosystem and changes the relationship between the natural subsystems (Odum et al., 1971). Exponentially growing demand, depleting natural resources, and unequal distribution of resources demand a careful consideration of economic practices and growth models (Costanza, 1989; Jackson, 2017). To meet such challenges, it is necessary to reconsider production and consumption patterns, conserve natural capital, and enhance capacity to meet the growing population's needs (Costanza, 1989; Daly, 1990). The sustainability of the earth's natural system and human well-being are inseparable and require an integrated approach to ensure a safe and just future (Rockström et al., 2023).

Opinion on how to best address sustainability challenges is divided based on social and scientific perceptions, economic objectives, and environmental constraints. For instance, sociology, economics, and ecology take a different approach toward sustainability (Ayres and Gowdy, 2001). Economics approaches sustainable development through income equality between generations, considering income as a notion of human well-being (Dietz and Neumayer, 2007). The ecological approach emphasizes the preservation of the natural ecosystem as a pre-condition for human prosperity and intergenerational equity (Griggs et al., 2013; Rockström et al., 2023). Sociology focuses on preserving norms and values that define inter- and intra-generational relationships (Ayres and Gowdy, 2001). Human well-being and the resilience of the earth's ecosystem are inseparable and require an integrated approach (Rockström et al., 2023). Furthermore, interdisciplinary and geographical constraints add to the complexity of sustainable development (Rauf and Weber, 2021). In addition to interdisciplinary variations, there are differences in approaches due to operational priorities and circumstantial constraints. Hammer and Pivo (2017) summarized operational approaches into three categories: modes and means of economic growth, prosperity as a direct outcome, and preservation of natural capital as the basis of economic planning. Differences in conceptual and operational attitudes led to weak and strong sustainability.

The discussion of weak and strong sustainability concerns the stock of natural capital, its reproduction capacity, and its relationship to human well-being (Dietz and Neumayer, 2007; Rockström et al., 2023). A weak approach to sustainability weighs natural and manufactured capital equally in meeting intergenerational needs and technological advancement can provide a substitute for the depleting natural resources (Hartwick, 1977; Dietz and Neumayer, 2007). This approach to sustainability can only be valid if natural resources are available in abundance, producible, or substitutable (Costanza, 1989; Daly, 1990; Dietz and Neumayer, 2007). The irreversibility of natural resources and qualitative differences between natural and manufactured capital oppose substitution (Costanza, 1989; Ekins et al., 2003). Additionally, natural systems are not only for the supply of raw materials, but they also provide other critical environmental/ecological systems services such as waste absorption, and provision of amenity services necessary for human and natural life support functions (Barbier et al., 1994; Harte, 1995). At the same time, the life support function is the direct determinant of human well-being giving primary value to natural systems that embrace humans and the natural environment intact (Turner and Pearce, 1994; Harte, 1995; Dietz and Neumayer, 2007). These views provide the fundamental argument for strong sustainability to keep environmental protection at the center of development trajectories.

The debate between weak and strong sustainability viewpoints extends to setting priorities to trade-offs between socioeconomic and environmental objectives and inter- and intra-generational equity. According to Bromley (1998), adopting sustainable practices that can preserve natural resource capacity to flourish is better than the quantitative valuation of unknown future needs. Similarly, Ayres and Gowdy (2001) added that acknowledging the equitable rights of future generations on resources and subsequent opportunities can provide a development roadmap that may not require an emphasis on substitution and marginal trade-offs. However, this does not mean the present generation can dismiss the relevance of good practice and behavior (Rauf and Weber, 2021).

Development trajectories are subject to multiple factors, including perceptions, objectives, priorities, and capacity. Sustainable development is achievable subject to balancing political objectives and a complex trade-off between socioeconomic and environmental outcomes (Burch, 2010). Geographical and circumstantial changes set a unique context that influences perception about things, value judgment, and determination of needs. For instance, an operational capacity difference due to the quality of education, infrastructure, and financial capital leads to a significant policy variation between developed and underdeveloped nations (Nagendra et al., 2018; Swain and Yang-Wallentin, 2020). Furthermore, functional efficiency for sustainable development requires financial resources, basic infrastructure, education, health, national and regional connectivity, and strong governance. Therefore, contextual circumstances are vital to developing context-specific policies for relevant groups of sustainable development components to facilitate convergence across sustainability indicators (Ulucak et al., 2020; Wang, 2021; Fanning and Hickel, 2023).

Therefore, contextual policy trade-offs are inevitable to develop purposive strategies to address development challenges (Ulucak et al., 2020). However, socioeconomic demands are not the only objective of sustainability. It requires an integrated approach to governance and stability of urban and economic functions (While et al., 2004; Krueger and Gibbs, 2008). Interdisciplinary multi-level inclusive decision-making structure will ensure a sustainable trajectory rather than a narrow-focused unitary approach such as climate-specific policy development. Ayres and Gowdy (2001) highlighted the importance of recognizing the limitation of market solutions in developing context-specific policy development. Sustainable governance would require a cumulative approach for sustainable trade-offs and synergies between operations and governance. Furthermore, a well-defined operational structure will be required to identify context-specific challenges and priorities, set manageable targets, and deploy various tools to achieve the sustainable development goals (Burch et al., 2014).

Urban sustainable development is a broad and heterogeneous subject. It requires an integrated approach across urban functions and efficient governance to achieve context-specific managed growth (While et al., 2004; Krueger and Gibbs, 2008). A global development agenda evolved through Habitat I, II, and MDGs with an implicit focus on addressing global policies for complex urban functions. SDGs Agenda 2030, followed by the New Urban Agenda (Habitat III), clearly viewed the necessity of a broad and shared understanding of urban policy challenges (Parnell, 2016).

SDG 11 (sustainable cities and communities) is targeting to make cities inclusive, safe, resilient, and sustainable providing a comprehensive policy dimension for managing urban systems (Parnell, 2016; UN, 2017). It promotes equality and equity within cities by realizing everyone's right to adequate and affordable housing, transportation, and a safe and resilient environment. SDG 11 also pledges to reduce the environmental impact of cities, emphasizing strong and inclusive regional and national planning for efficient policy development and governance (Parnell, 2016). Urban challenges are sensitive to the city's local circumstances, including geographic location, natural environment, socioeconomic conditions, and governance structure. The respective factors require local knowledge and stakeholders to take the initiative to develop relevant policies (UCLG, 2018; Bates, 2022). For instance, housing and transportation affordability is a relative term varying geographically which may need to be adequately addressed with a universal definition of affordability (Noring et al., 2022). In contrast, urban policies treat subjects like housing and affordability with a single lens ignoring the rationality of varying socioeconomic structures. Addressing housing and transportation affordability requires the devolution of authority and initiatives at a local scale to adopt a holistic approach to policy development and implement accountability to achieve targets (Wakely, 2022).

Society, environment, and economy are hierarchically nested functions that can not be treated independently (Mori and Christodoulou, 2012; Rockström et al., 2023). The SDGs and their indicators are contextual that require synergies and trade-offs to balance circumstantial constraints and temporal requirements. The trade-offs may diverge or converge between goals, disciplines, or even geographically. The outcome of such negotiations is highly dependent on governance structure, path trajectories, and accumulation of policies. For instance, social policies may not favor equitable environmental outcomes. Similarly, financial capital leverage one group over the others in pursuing green agenda (Pradhan et al., 2017). Targets, indicators, and measuring outcomes rely on differing visions of sustainability, which can then define the inter-relationships among sustainability indicators (Károly, 2011; Meinherz et al., 2020).

Pradhan et al. (2017) conducted an indicators analysis for 227 countries and found a consequential relationship between 169 SDG targets. Despite synergies between the SDGs experienced in many countries, most deal with 40-50 percent of their targets, which can require trade-offs (Pradhan et al., 2017). An interdependence between targets and their conflicting outcomes (such as green energy vs. cost of production) is restricting progress in their goals (Pradhan et al., 2017). Nilsson et al. (2018) proposed a seven-point scale framework by characterizing a possible interaction between SDG indicators regarding complementing, ineffectual, and counteracting behaviors. ICSU (2017) adopted the framework proposed by Nilsson et al. (2016) to test the causal relationship between goals and targets. It is evident that trade-offs are not just limited to input values but equally reliant on the process followed and the valuation of corresponding outcomes.

Generally, local governments are more comfortable with the indicators and targets that emerged from local process groups [as exemplified by City of Surrey (2016) and OECD (2016)]. However, most local data and targets are imperative to local objectives, circumstantial challenges, and capacity that may differ from other communities. Furthermore, a local approach to setting targets and assigning data is generally vague due to defragmented approaches and a lack of measurability (Valencia et al., 2019). The complexity of the urban ecosystem increases uncertainty by considering a single indicator or adopting a composite index ignoring circumstantial variations (Allen et al., 2021). Similarly, SDG targets rely on cross-functional and geographic integration. It poses a further challenge to the management of cross-functional and inter-jurisdictional targets (GTF UN-Habitat, 2016; Ho and Runnalls, 2018; Edquist and Espey, 2019). A systematic and standardized methodology of measurement and reporting across communities will improve measurability, comparability, and alignment of local and national objectives (Weitz et al., 2018; Tremblay et al., 2020; Gustafsson and Krantz, 2021). Local governments, however, would require SDG-aligned complementary metrics that incorporate local objectives and circumstantial constraints (Valencia et al., 2019).

Various approaches and methodologies have been developed and adopted to measure SDG progress locally, nationally, and globally. Some of the methodologies include SDG indices and dashboards that serve as a facilitation tool to monitor performance at all tiers of governance (UNDP et al., 2015). The United Nations is leading by providing a quantitative assessment of SDGs and encouraging voluntary local reviews (Allen et al., 2017; UN, 2021). Similarly, a comparative assessment of institutional performance through various SDG indexes has also emerged recently (Schmidt-Traub et al., 2017; Lafortune et al., 2021; Sachs et al., 2021). Local efforts have been made to perform national and local volunteer reviews on SDGs' performance and to compare cities and provinces as well (McArthur and Rasmussen, 2017; Lynch et al., 2019).

City authorities possess local knowledge of circumstantial challenges and opportunities (Graute, 2016; Klopp and Petretta, 2017), but capitalization of the knowledge depends on their capacity to function (Tremblay et al., 2021). Furthermore, the complexity of urban functions and contextual diversity makes it harder for municipalities to set sustainability targets, choose appropriate indicators, and measure and monitor outcomes. SDGs provide a comprehensive framework to set development trajectories (Parnell, 2016; Kanuri et al., 2019). However, the measurement of SDG targets is methodologically complex due to their multiscale and multi-dimensional scope (Allen et al., 2021). It requires a vertical and horizontal integration of governing policies (Parnell, 2016; Kanuri et al., 2019). Policy integration, operational capacity, and responsiveness will impact progress toward achieving sustainability targets in a rapidly changing urban environment. At the same time, it would be hard to measure and monitor without efficient data collection, analysis, and reporting mechanisms. Despite having interests in pursuing sustainability agenda, local governments need help with the operational capacity to identify appropriate targets and their relevant indicators, a standardized methodology for data collection and analysis, and creating stakeholder interest (Klopp and Petretta, 2017). A research gap persists in determining the most acceptable methodology for adopting SDGs locally (Fox and Macleod, 2021; Leavesley et al., 2022).

3. Theoretical implications and research gap

It is difficult for a single organization to impact all SDGs. A further challenge is to aggregate socioeconomic and environmental outcomes. The complexity and lack of consensus on a unified approach to indicators and methods make monitoring progress difficult (Mook, 2019). The available tools lack a systems approach integrating interdisciplinary actions and outcomes (Joss et al., 2015). A sustainability framework defines strategic objectives, engages stakeholders at all levels, facilitates adoption in policy development, and provides tools to gauge progress (Roseland, 2012). SDGs are believed to provide a goalpost for national and local policy development (Mesa et al., 2019). However, it would require a specific framework to translate contextual objectives and constraints into indicators aligning with SDGs (Mesa et al., 2019; Spiliotopoulou and Roseland, 2021).

With the help of several federal departments, Statistics Canada developed the Canadian Indicator Framework (CIF) to measure and report SDG's national progress (Government of Canada, 2023b). For adaptability at a local or institutional level, SDGs measurement and monitoring would require consultation with other bodies such as Sustainability Accounting Standards Board (SASB) and the Global Reporting Initiative (GRI) (Mook, 2019). Canadian municipalities are facing difficulties in aligning master plans with SDGs. It is also because several documents in use, such as business plans, official community plans, sectoral plans, climate action plans, etc., are making it difficult to align with SDGs and maintain consistency (Ross, 2018). Some local frameworks, such as Sustainable Community Plan (SCP) and Community Capital Tool (CCT), are considered helpful in identifying indicators to measure local targets and alignment with SDGs (Spiliotopoulou and Roseland, 2021; Zhou et al., 2022). Although SCPs are widely developed across Canadian municipalities, a gap exists in planning and implementation due to methodological complexity and resource constraints (Zhou et al., 2022).

The literature on SDGs localization has grown since its emergence in 2015 (Weitz et al., 2018; Guha and Chakrabarti, 2019; Fox and Macleod, 2021; Taajamaa et al., 2022). Despite willingness, Canadian municipalities need help transforming locally developed Key Performance Indicators to goal level. The knowledge gap persists in finding a comprehensive approach to localizing SDGs in Canadian municipalities. Canadian municipalities face challenges in identifying measurable indicators to align local targets with SDGs (Ross, 2018; Zhou et al., 2022). Furthermore, targets set at local levels need priority criteria to trade off targets suitable to their context. The complexity of the urban system and the limited knowledge of evaluation techniques make it hard for municipalities to follow a defined approach. It causes operational challenges such as data collection, aggregation, and analysis of the outcomes. Therefore, most Canadian cities rely on relative evaluation rather than absolute numbers due to the lack of data and the measurability of indicators (Tremblay et al., 2021).

The Canadian Indicator Framework initiated the Canadian ambitions to Agenda 2030, setting several targets and indicators to measure progress toward development goals. However, over half of the indicators have no specific target assigned. Canada has defined eleven indicators for SDG 11 covering housing, air pollution, public transport, waste disposal, and a sense of belonging for local communities. Most of them are either without a target or missing data to report up-to-date progress (Government of Canada, 2023b). Without clear benchmarking and no concrete measurement and reporting framework, CIF is not helping to demonstrate a decisive move toward the progress necessary to realize the 2030 Agenda for sustainable development (Smith-Carrier, 2023). Therefore, developing a methodology capable of incorporating multidisciplinary and multicriteria aggregation and flexibility to accommodate contextual variations is crucial. Metrics and indicators based on reliable data streams should demonstrate initiatives and measure progress toward the goal (Mesa et al., 2019).

A further measurement challenge centers on the design of a theoretically appropriate index of sustainable development in cities. In order to effectively aggregate measures of sustainable development, each measure needs to be brought onto the same scale via a process known as normalization (Nardo et al., 2005). Normalization may be carried out by standardizing the scores according to their own relative distribution (measured in standard deviations from each score's mean), measuring the distance of each recorded score from a target value, or setting the upper and lower bounds for a score through min-max normalization (where the upper bound can represent a pre-defined target). If the normalization process includes a set of pre-defined targets, the scales for some scores may need to be reversed (e.g. where lower scores are actually closer to a target) in order to avoid introducing errors in the aggregation of the scores.

Beyond the normalization of scores, the method of aggregation has further theoretical implications for measuring sustainable development. These discussions primarily revolve around the concept of compensability (Munda and Nardo, 2009). Compensability refers to the extent to which scores in a given index can be traded off. As an example, arithmetic means allow for perfect compensability (a city with a poor score can compensate for this poor score with improved performance on another score), while certain ranking procedures, like Condorcet ranking, do not allow for compensability (when cities are compared against one another, a city must perform better on each score across these comparisons). Given that sustainable development conceptualizes the optimization of multidimensional goals, the extent to which those goals can be traded off can have significant theoretical implications for the measurement of sustainable development.

Given the limited research available on SDG achievement within Canadian cities, this investigation provides insight into the relative achievement of SDG 11 (focused on sustainable cities and communities) among Canadian cities. In order to do so, this investigation constructs an index of SDG 11 achievement by setting targets for SDG 11 indicators and exploring the theoretical ramifications of aggregation approaches. The implications of these aggregation approaches are explored via a discussion of their link to synergies and trade-offs in sustainable urban development.

4. Methods

4.1. Research objectives

• Create an index of SDG 11 achievements among Canadian urban areas

• Identify trade-offs in sustainable development via a comparison of aggregation methods for the collected SDG 11 indicators.

4.2. Indicators and data sources

In order to set a standard urban area for the comparison of SDG 11 indicators, this investigation used Census Metropolitan Areas (CMAs), as defined by Statistics Canada. Statistics Canada defines Census Metropolitan Areas as:

“an area formed by one or more adjacent municipalities that have a high degree of social and economic integration and that are situated around a core population center. A CMA must have at least 100,000 inhabitants, of which 50,000 or more must live in the core. Once an area becomes a CMA, it is retained as a CMA even if its population declines below 100,000 or the population of its core falls below 50,000. Integration with the core is measured by commuting flows from place of work data from the previous censuses or National Household Survey.” (Statistics Canada, 2016).

Using this common spatial definition for the urban boundaries of cities within Canada, the following 18 Census Metropolitan Areas were selected for inclusion in this investigation on the basis of the recency and completeness of the SDG 11 data available for each CMA:

• Calgary

• Edmonton

• Halifax

• Hamilton

• Kitchener–Cambridge–Waterloo

• London

• Montréal

• Quebec City

• Regina

• Saskatoon

• Sherbrooke

• St. Catharines–Niagara

• St. John's

• Toronto

• Vancouver

• Victoria

• Windsor

• Winnipeg

For each CMA identified, the investigation followed the following steps in the design of indices to measure SDG 11 performance (see Figure 1).

FIGURE 1
www.frontiersin.org

Figure 1. Sequence of indices development.

4.3. Indicator Selection

The first SDG 11 indicator collected for the index in this investigation is SDG Target: “11.1 by 2030, ensure access for all to adequate, safe and affordable housing and basic services and upgrade slums.” This target is measured via SDG Indicator 11.1.1: “Proportion of urban population living in slums, informal settlements or inadequate housing.” In order to localize this indicator within a Canadian context, the indicator is measured using the aligned concept of core housing need. Statistics Canada provides the following definition for core housing need:

“Core housing need refers to whether a private household's housing falls below at least one of the indicator thresholds for housing adequacy, affordability or suitability, and would have to spend 30% or more of its total before-tax income to pay the median rent of alternative local housing that is acceptable (attains all three housing indicator thresholds)” (Statistics Canada, 2021).

The data collected for this indicator were collected in 2016 by Statistics Canada using the 2016 census (Statistics Canada, 2017). Relying on the SDG principle “no-one left behind,” the target for this variable is 0% of the population.

The second SDG 11 indicator collected for this index is SDG Target: “11.2 by 2030, provide access to safe, affordable, accessible and sustainable transport systems for all, improving road safety, notably by expanding public transport, with special attention to the needs of those in vulnerable situations, women, children, persons with disabilities and older persons.” This SDG target is measured via the SDG Indicator 11.2.1: “Proportion of population that has convenient access to public transport, by sex, age and persons with disabilities.” This indicator has been localized using an existing Statistics Canada indicator, “Percentage of population <500 meters from public transit access point,” which was collected in 2020 (Statistics Canada, 2020).

Steg and Gifford (2005) note that sustainable transportation should be conceptualized across a host of multidimensional indicators to mirror to the social, economic, and ecological concerns of sustainable development, including concerns around the distribution of opportunities as conceptualized by social justice. More recently, in a review of sustainable transportation literature from 2000 to 2019, Zhao et al. (2020) noted the emerging importance of evaluating social sustainability issues, including accessibility, when determining the sustainability of transportation systems. Relying on the SDG principle “no-one left behind,” the target is 100% coverage of the population.

The third SDG 11 indicator collected for this index is Target: “11.3 by 2030, enhance inclusive and sustainable urbanization and capacity for participatory, integrated and sustainable human settlement planning and management in all countries.” This SDG target is measured by SDG Indicator 11.3.1: “Ratio of land consumption rate to population growth rate.” In localizing this SDG target and indicator, the ratio of land consumption rate to population growth rate was calculated from 1971 to 2011 by Statistics Canada upon request by the investigators (Statistics Canada, 2016).

The intensification of urban growth underpins Land Use Efficiency (LUW) describing the ratio of output to units of land within a given boundary (Cai et al., 2020). While the implementation of intensification has been associated with challenges and requires accessible transportation systems (Searle and Filion, 2011), the potential benefits of the compact city form for productivity, innovation and well-being should not be overlooked (Ahfeldt and Pietrostefani, 2017). That said, based on the literature review by Ahfeldt and Pietrostefani (2017), the potential negative outcomes also cannot be ignored (often occurring when intensification is not integrated within a wholistic urban strategy for transportation, service access, and the conservation of public spaces). In sum, this target is a significant component of sustainable urban development, but its positive outcomes can only be realized when implemented synergistically with other sustainability targets. Given this background, this investigation set the target for this indicator at 1, indicating that the land consumption rate is less than the population growth rate (indicating greater efficiency in land use).

Given a lack of complete, comparable, and accurate data, SDG 11.4 and 11.5 were not included in this index. Instead, the fourth SDG 11 indicator collected for this index is Target: “11.6 by 2030, reduce the adverse per capita environmental impact of cities, including by paying special attention to air quality and municipal and other waste management.” This target is measured by the SDG Indicator “11.6.2 Annual mean levels of fine particulate matter (e.g., PM2.5 and PM10) in cities (population weighted).” The Government of Canada collects data on the average annual fine particulate matter concentrations (PM 2.5) in CMAs across the country (Government of Canada, 2023a). The data integrated into this index was collected in the year 2016.

Air pollution in cities can be driven by challenges associated with rising emissions stemming from transportation, among other sources, and can have a profound long-term implications for human health and wellbeing (Zhang et al., 2022). That said, the management of urban air quality is a function of the management of urban development. As a result, as with other indicators, urban air quality is a necessary sustainable urban development target but is also dependent upon progress in other sectors of urban development. According to recommendations from the World Health Organization (World Health Organization, 2021), the target set for this indicator is 5 ug/m3.

The final SDG 11 indicator collected for this index is SDG Target: “11.7 By 2030, provide universal access to safe, inclusive and accessible, green and public spaces, in particular for women and children, older persons and persons with disabilities.” This SDG target is measured by the SDG Indicator “11.7.2 Proportion of persons victim of physical or sexual harassment, by sex, age, disability status, and place of occurrence, in the previous 12 months.” A subset of this indicator was collected in 2018 by Statistics Canada as the sexual assault rate per 100,000 in Canadian CMAs (Statistics Canada, 2022).

The preservation of safety and security is critical to human well-being in cities. There is a growing consensus that crime prevention can be a function of the urban form and that there are critical links between crime prevention and broader sustainable urban development (Cozens, 2002). Relying on the SDG principle “no-one left behind,” the target is 0% of the population affected.

4.4. Indicator normalization

The localized SDG indicators were normalized using Min-Max normalization in order to bring all of the indicators onto the same scale from 0 to 1. This method of normalization transforms each indicator value from “0” (representing the lowest achievable value on a scale) and “1” (representing the highest achievable value on a scale). In order to track the progress of CMAs toward the SDG target, the “1” value indicates the target for each indicator and the “0” value indicates the value for the CMA that is farthest from achieving the SDG target (for each SDG indicator included in the scale).

4.5. Indicator aggregation

4.5.1. Arithmetic mean

This is a simple average of the SDG indicator values for each CMAs. In other words, the sum of the normalized SDG indicator values divided by the number of SDG indicators. This average score is easy to interpret but the score also allows CMAs to trade off performance across the SDG indicators. In other words, CMAs with poor performance on one SDG indicator can trade off that performance with strong performances on other SDG indicators. This phenomenon is called compensability and the arithmetic mean offers perfect compensability.

4.5.2. Geometric mean

The geometric mean is calculated by multiplying the normalized indicator scores and then taking the nth root of the product (where n represents the number of normalized SDG indicators included in the scale). The geometric mean allows imperfect compensability in that it is more sensitive to improvements among low indicator scores when compared to shifts in high indicator scores. Given that Geometric means cannot be calculated for any values that are 0, a 1 was added to all values before the Geometric mean was calculated and then 1 was subtracted from the calculated Geometric mean.

4.5.3. Condorcet ranking

The Condorcet method ranks CMAs according to the extent to which each CMA wins or losses the majority of head-to-head comparisons with other CMAs. This method is more difficult to interpret but it does not allow CMAs to trade-off performance. In other words, the Condorcet method is perfectly non-compensable. The Condorcet ranking was carried out using the votesys R package. As with other Condorcet ranking calculations, there is the possibility to multi-way ties.

5. Results

The raw SDG indicator achievement, according to the targets set in this investigation, varied substantially across the CMAs included in this investigation (Table 1). While none of the selected CMAs achieved the targets set for 11.1.1 and 11.2.1, two CMAs (Calgary and Vancouver) achieved the target set for 11.3.1 (a ratio of land consumption rate to population growth rate that is equal to 1) and Halifax, Sherbrooke, Vancouver, and Victoria achieved the target set for 11.6.2 (an average annual fine particulate matter concentration of 5 ug/m3).

TABLE 1
www.frontiersin.org

Table 1. Raw SDG indicators collected for each Census Metropolitan Area.

Once normalized, the SDG indicator scores achieved by the selected CMAs reveal further details regarding the heterogeneity of SDG achievement across the CMAs (Table 2). Relative to the other CMAs included in the analysis, on SDG 11.1.1, the highest score (62% progress toward the target) was shared by Quebec City and Sherbrooke while the lowest score was observed in Toronto. Montreal received the highest score (79%) on SDG 11.2.1 while St. John's received the lowest score on this indicator relative to the other CMAs. While Calgary and Vancouver achieved the target set for SDG 11.3.1, the lowest score was achieved by St. Catharines-Niagara (followed closely by Windsor). Halifax, Sherbrooke, Vancouver, and Victoria achieved the target set for 11.6.2 while Windsor received the lowest score on this indicator relative to the other CMAs included in this analysis. Finally, the highest score on SDG 11.7.2 was received by Vancouver (68%) while the lowest score was received by Halifax relative to the CMAs included in this investigation.

TABLE 2
www.frontiersin.org

Table 2. Normalized scores of SDG indicator achievement across Census Metropolitan Areas.

As is evident from the previous table, there is a considerable range in performance on the SDG indicators across the included CMAs. Figure 2 provides an example of the relative performance of CMAs via a Leader-Laggard chart demonstrating the range of performance across all included CMAs in the analysis (the min and max values represented in each bar of the chart) as well as the relative performance of the Kitchener-Cambridge-Waterloo CMA relative to this performance (the black line positioned within each bar in the chart). This chart demonstrates the heterogeneity in the success of the selected CMAs in reaching their target (1) in each indicator (only the targets for SDG 11.3.1 and SDG 11.6.2 were achieved) as well as the heterogeneity exemplified by the Kitchener-Cambridge-Waterloo CMA (the CMA only came close to achieving the target for SDG 11.3.1).

FIGURE 2
www.frontiersin.org

Figure 2. Leader-Laggard Bar Chart of Kitchener-Cambridge-Waterloo CMA performance on Normalized SDG Indicators.

When these normalized scores were aggregated into index rankings, some interesting patterns began to emerge (Table 3). First, the ranking of CMAs between the Arithmetic and Geometric ranking calculations did not vary substantially (although there are examples of CMAs that made dramatic movements between these rankings, as observed in the case of Toronto which fell 4 spots between the two calculations). Greater deviations were observed when comparing the arithmetic and geometric ranking procedures against the Condorcet ranking procedure. As an example, Montreal (which ranked 10 and 13 according to the arithmetic and geometric ranking procedures respectively) fell to the lowest ranking in the Condorcet ranking procedure. Alternatively, Toronto, Vancouver, Kitchener-Cambridge-Waterloo, and Sherbrooke all experienced significant gains in their rankings under the Condorcet ranking procedure. As with other Condorcet ranking calculations, there is the possibility to multi-way ties. In these instances—such as with Quebec City, St. John's and Winnipeg—the average between all tied ranks was assigned to all cities equally.

TABLE 3
www.frontiersin.org

Table 3. Arithmetic, geometric and Condorcet rankings of CMA SDG achievement (Sorted by Condorcet ranking).

When the mean arithmetic and geometric values are provided for each CMA according to their Condorcet ranking, the disconnect between these ranking procedures becomes more apparent (Table 4). While Toronto received middling arithmetic and geometric means, the CMA still ranked in the top 3 according to the Condorcet rankings. Similarly, while Montreal actually received very similar arithmetic and geometric mean scores to Toronto, the CMA was ranked at the bottom in the Condorcet ranking procedure. The differentiation of these storylines highlights the differential compensability of these ranking procedures, where Condorcet rankings do not allow for performance to be traded off across the indicators.

TABLE 4
www.frontiersin.org

Table 4. Comparison of arithmetic and arithmetic means of CMA SDG achievement by Condorcet rankings.

6. Discussion

This investigation demonstrated how trade-offs, inherent in weak vs. strong sustainability conceptualizations of sustainable development, can create significant differences in the monitoring and evaluation of sustainable development. Allowing goals to be traded off, theoretically premised on weak sustainability and methodologically implemented via simple arithmetic means for indicator aggregation, will portray a significantly different set of outcomes when compared to non-compensable aggregation methods premised on notions of strong sustainability. Given the significant heterogeneity of Canadian cities in the achievement of SDG 11 indicators, these differences can result in either masking or skewing sustainability challenges, leaving municipal strategic plans meant to address those sustainability challenges open to political manipulation.

Even as the 2030 deadline looms for the Sustainable Development Goals, the concept of sustainability and sustainable development still faces challenges of understanding and measurement. The translation of sustainability into policy can be biased by narrow interpretations of sustainability targets and hampered by limited operational capacity. The operational challenge of sustainability aggravates further by the fact that the measurement of sustainable development relies on both paths followed (economic policies) and outcomes (poverty) (Sachs et al., 2017). The normative approach to sustainability helps to set a universal approach to the foundation of the concept and determine appropriate means to achieve objectives.

It is generally recognized that sustainable development requires assessing actions and outcomes from three dimensions: society, economy, and the environment. People may adopt different paths or arrive at diverse conclusions due to changes in perspectives and temporal objectives. Therefore, a normative agreement on greater interests and scientifically acceptable methods to measure outcomes are inevitable to progress toward common agenda. Meadows (1998) was convinced of the necessity of the inclusion of a broader set of indicators and following a continuous learning process to find an adequate and effective methodology to measure them. Competing priorities and subsequent trade-offs are well recognized while setting a sustainability agenda (Pörtner et al., 2022; Rockström et al., 2023). However, a theoretically appropriate means of measurement is crucial for informed decision-making (Nardo et al., 2005).

Methodological challenges faced by urban sustainability indicators are technical and conceptual. Technical issues include normalization, weighting, and aggregation, whereas conceptual challenges revolve around ambiguities due to dimensional heterogeneity, operational jurisdiction, and strong vs. weak sustainability (Huang et al., 2015). The debate of weak and strong sustainability is about the degree of substitutability of natural resources with manufactured capital, and the role of technology as a solution in sustainable development (Daly, 1990; Ekins et al., 2003; Dietz and Neumayer, 2007). Sustainability indicators are used to assign limits and targets and measure human actions from all three dimensions (society, economy, and environment) and assertion of normative perspective: weak and strong sustainability (Meadows, 1998). For instance, SDGs incorporate multiple sustainability dimensions, if equal weightage is adopted for the aggregation of variables it promotes a weak sustainability perspective (Huang et al., 2015). Within this context, the application of strong and weak sustainable development in municipal governance is a challenge because it is premised on the way in which the various pillars of sustainable development are valued (and a recognition of how current trade-offs could impact future opportunities). One option for addressing this tension may be via the use of futures thinking methods like scenario planning where, instead of forecasting the possible outcomes of current trade-off decisions, municipalities begin with the preferred future scenario and then backcast to the present in order to identify the various policy avenues that could be followed to achieve that future (and identify the trade-offs that would be allowed among those possible avenues).

The performance rankings displayed in a SDG index are defined by the weighting and aggregation of the indicators in the index. The relative ranking has important implications due to different weightings based on circumstantial relevance (Booysen, 2002). Likewise, the aggregation of different variables by allowing a simple substitution can have an important implication on ranking cities and countries (Rickets et al., 2014). Ignoring compound changes in various goals would allow a loss in one indicator offset by a gain in another variable. For instance, arithmetic mean allows a perfect substitution without limits which tends to take a path of weak sustainability (Rickets et al., 2014; Sachs et al., 2017). Whereas, strong sustainability occurs when indicators are not substitutable, as we have seen in the case of the Condorcet method.

The United Nations emphasize treating all goals equally. Under conditions where indicator performance could be traded off, as in the case of compensable aggregation methods like the arithmetic mean, the equal weighting of indicator performance could allow cities to engage in unsustainable methods for boosting economic and social wellbeing. For example, if a city could generate sufficiently strong performances on measures of social and economic development, that city may be able to conceal a poor performance on climate action in their aggregate score or ranking (when indicators are equally weighted and aggregated using an arithmetic mean). In this case, the index would have little utility in exposing unsustainable practices and motivating effective policies in favor of sustainable development (Sachs et al., 2017).

7. Conclusion

There was considerable variation in SDG target achievement across the CMAs included in this analysis. Only the targets set for SDG 11.3.1 (a ratio of land consumption rate to population growth rate that is equal to 1) and 11.6.2 (an average annual fine particulate matter concentration of 5 ug/m3) were achieved by the CMAs included in this investigation. When the normalized scores were aggregated into rankings, the performance of these CMAs across the rankings varied substantially. While Calgary received the top ranking under the Geometric and Arithmetic ranking procedure, Vancouver received the top ranking via Condorcet rankings. Similarly, while Windsor received the lowest ranking according to the Geometric and Arithmetic ranking procedures, Montreal received the lowest ranking via the Condorcet ranking procedure. Given the relative compensability of these ranking procedures (Arithmetic means allowing perfect compensability while Condorcet ranking do not allow compensability), the differences observed between these ranking procedures highlight how the trade-off of achievement across domains of sustainability can impact sustainable development among Canadian cities.

These findings need to be interpreted according to the limitations of this study. Given the scale of the indicators at the federal-level, the localization of these indicators at the municipal-level involved a re-interpretation of those indicators. This process was heavily informed by the availability of municipal indicators from Statistics Canada that could align with the SDG indicators set in the original indicator framework. Furthermore, the heterogeneous availability of indicators across municipalities shifted the scale of the investigation to Census Metropolitan Areas and reduced the number of cases that could be included in this investigation. As a result, further statistical analysis was not reliably feasible beyond the comparisons of the aggregation methods presented here. Together, these limitations note the continued need to carefully address data gaps in SDG measurement and localization within cities. Future research can apply a similar approach to other goals and targets corresponding to the SDG 11 targets in the city domain.

Data availability statement

Publicly available datasets were analyzed in this study. This data can be found here: https://www.statcan.gc.ca/en/start.

Ethics statement

This study has been reviewed and received ethics clearance through the University of Waterloo Research Ethics Committee (ORE #41177).

Author contributions

MR: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing—original draft, Writing—review & editing. CM: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Supervision, Writing—review & editing. JS: Data curation, Formal analysis, Software, Writing—review & editing. BF: Funding acquisition, Project administration, Resources, Validation, Writing—review & editing. JW: Investigation, Project administration, Supervision, Validation, Writing—review & editing.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This research was funded by the Social Sciences and Humanities Research Council of Canada under Grant No. 435-2019-0594 and Economic and Social Development Canada under Project No. 16556557.

Acknowledgments

The authors are grateful for the individuals and city administrations who participated in their time and knowledge sharing for this project. Additionally, we would like to thank the Sustainable Development Solution Network (SDSN) Canada for its guidance and support.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Ahfeldt, G. M., and Pietrostefani, E. (2017). The Compact City in Empirical Research: A Quantitative Literature Review. London: Spatial Economics Research Centre (SERC), London School of Economics.

Google Scholar

Allen, C., Meternicht, G., and Wiedmann, T. (2019). Prioritising SDG targets: assessing baselines, gaps and interlinkages. Sustain. Sci. 14, 421–438. doi: 10.1007/s11625-018-0596-8

CrossRef Full Text | Google Scholar

Allen, C., Metternicht, G., and Wiedmann, T. (2021). Priorities for science to support national implementation of the sustainable development goals: a review of progress and gaps. Sustain. Dev. 29, 635–652. doi: 10.1002/sd.2164

CrossRef Full Text | Google Scholar

Allen, C. R., Thwaites, J., Glover, R., and Kestin, T. (2020). Assessing national progress and priorities for the Sustainable Development Goals (SDGs): experience from Australia. Sustain. Sci. 15, 521–538. doi: 10.1007/s11625-019-00711-x

CrossRef Full Text | Google Scholar

Allen, J., Grieder, T., Peterson, B., and Roberts, T. (2017). The impact of macroprudential housing finance tools in Canada. J. Finan. Intermediation. 000, 1–14. doi: 10.1016/j.jfi.2017.08.004

CrossRef Full Text | Google Scholar

Arico, S. (2014). The contribution of the sciences, technology and innovation to sustainable development: the application of sustainability science from the perspective of UNESCO's experience. Sustain. Sci. 9, 453–462. doi: 10.1007/s11625-014-0256-6

CrossRef Full Text | Google Scholar

Ayres, R. U., and Gowdy, J. M. (2001). Strong versus weak sustainability: Economics, natural sciences, and consilience. Environ. Ethics 23, 155–168. doi: 10.5840/enviroethics200123225

CrossRef Full Text | Google Scholar

Bansal, P., and Song, H. C. (2017). Similar but not the same: differentiating corporate responsibility from sustainability. Acad. Manag. Annals 11, 105–149. doi: 10.5465/annals.2015.0095

CrossRef Full Text | Google Scholar

Barbier, E., Burgess, J., and Folke, C. (1994). Paradise Lost? - The Ecological Economics of Biodiversity. London: Earthscan.

Google Scholar

Bates, L. (2022). Housing for people, not for profit: models of community-led housing. Plan. Theory Pract. 23, 267–302. doi: 10.1080/14649357.2022.2057784

CrossRef Full Text | Google Scholar

Bibri, S. E., and Krogstie, J. (2017). Smart sustainable cities of the future: an extensive interdisciplinary literature review. Sustain. Cities Soc. 31, 183–212. doi: 10.1016/j.scs.2017.02.016

CrossRef Full Text | Google Scholar

Booysen, F. (2002). An overview of evaluation of composit indices of development. Soc. Indicat. Res. 59, 115–151. doi: 10.1023/A:1016275505152

CrossRef Full Text | Google Scholar

Bromley, D. W. (1998). Searching for sustainability: the poverty of spontaneous order. Ecol. Econ. 24, 231–240. doi: 10.1016/S0921-8009(97)00145-6

CrossRef Full Text | Google Scholar

Brundtland, G. (1987). Our Common Future. Oxford, NY: Oxford University Press.

Google Scholar

Burch, S. (2010). Transforming barriers into enablers of action on climate change: Insights from three case studies in British Columbia, Canada. Glob. Environ. Change 20, 287–297. doi: 10.1016/j.gloenvcha.2009.11.009

CrossRef Full Text | Google Scholar

Burch, S., Shaw, A., Dale, A., and Robinson, J. (2014). Triggering transformative change: a development path approach to climate change response in communities. Clim. Pol. 14, 467–487. doi: 10.1080/14693062.2014.876342

CrossRef Full Text | Google Scholar

Cai, G., Zhang, J., Du, M., Li, C., and Peng, S. (2020). Identification of urban land use efficiency by indicator-SDG 11.3. 1. PLoS ONE 15, e0244318. doi: 10.1371/journal.pone.0244318

PubMed Abstract | CrossRef Full Text | Google Scholar

City of Surrey (2016). Sustainability Charter 2.0. Surrey, BC: City of Surrey.

Google Scholar

Costanza, R. (1989). What is ecological economics? Ecol. Econ. 1, 1–7. doi: 10.1016/0921-8009(89)90020-7

CrossRef Full Text | Google Scholar

Cozens, P. (2002). Sustainable urban development and crime prevention through environmental design for the British City. Towards an effective urban environmentalism for the 21st century. Cities 19, 129–137. doi: 10.1016/S0264-2751(02)00008-2

CrossRef Full Text | Google Scholar

Daly, H. E. (1990). Toward some operational principles of sustainable development. Ecol. Econ. 2, 1–6. doi: 10.1016/0921-8009(90)90010-R

CrossRef Full Text | Google Scholar

Devezas, T., LePoire, D., Matias, J. C., and Silva, A. M. (2008). Energy scenarios: toward a new energy paradigm. Futures 40, 1–16. doi: 10.1016/j.futures.2007.06.005

CrossRef Full Text | Google Scholar

Dietz, S., and Neumayer, E. (2007). Weak and strong sustainability in the SEEA: concepts and measurement. Ecol. Econ. 61, 617–626. doi: 10.1016/j.ecolecon.2006.09.007

CrossRef Full Text | Google Scholar

Edquist, M., and Espey, J. (2019). A Pathway to Sustainable American Cities: A Guide to Implementing the SDGs. New York, NY: Sustainable Development Solutions Network (SDSN).

Google Scholar

Ekins, P., Simon, S., Deutsch, L., Folke, C., and De-Groot, R. (2003). A framework for the practical application of the concepts of critical natural capital and strong sustainability. Ecol. Econ. 44, 165–185. doi: 10.1016/S0921-8009(02)00272-0

CrossRef Full Text | Google Scholar

Fanning, A., and Hickel, J. (2023). Compensation for atmospheric appropriation. Nat Sustain. 6, 1077–1086. doi: 10.1038/s41893-023-01130-8

CrossRef Full Text | Google Scholar

Fenton, P., and Gustafsson, S. (2017). Moving from high-level words to local action—Governance for urban sustainability in municipalities. Curr. Opin. Environ. Sustain. 26, 129–133. doi: 10.1016/j.cosust.2017.07.009

CrossRef Full Text | Google Scholar

Fox, S., and Macleod, A. (2021). Localizing the SDGs in cities: Reflections from an action research project in Bristol, UK. Urban Geography 42, 1–21. doi: 10.1080/02723638.2021.1953286

CrossRef Full Text | Google Scholar

Gellers, J. (2016). Crowdsourcing global governance: sustainable development goals, civil society, and the pursuit of democratic legitimacy. Int. Environ. Agree. Pol. Law Econ. 16, 415–432. doi: 10.1007/s10784-016-9322-0

CrossRef Full Text | Google Scholar

Gibson, R., Hassan, S., Hltz, S., Tansey, J., and Whitelaw, G. (2013). Sustainability Assessment: Criteria Process and Applications. London: Earthscan.

Google Scholar

Gladwin, T. N., Kennelly, J. J., and Krause, T.-S. (1995). Shifting paradigms for sustainable development: implications for management theory and research. Acad. Manag. Rev. 20, 874–907. doi: 10.2307/258959

CrossRef Full Text | Google Scholar

Government of Canada (2023a). Environmental Indicators. Air Quality. Available online at: https://www.canada.ca/en/environment-climate-change/services/environmental-indicators/air-quality.html (accessed February 2, 2023).

Google Scholar

Government of Canada (2023b). Sustainable Development Goals Data Hub. Government of Canada. Available online at: https://www144.statcan.gc.ca/sdg-odd/index-eng.htm (accessed June 12, 2023).

Google Scholar

Graute, U. (2016). Local authorities acting globally for sustainable development. Reg. Stud. 50, 1931–1942. doi: 10.1080/00343404.2016.1161740

CrossRef Full Text | Google Scholar

Griggs, D., Stafford-Smith, M., Gaffney, O., Rockström, J., Öhman, M. C., Shyamsundar, P., et al. (2013). Policy: sustainable development goals for people and planet. Nature 495, 305. doi: 10.1038/495305a

PubMed Abstract | CrossRef Full Text | Google Scholar

GTF UN-Habitat (2016). Roadmap for Localization the SDGs: Implementation and Monitoring at Subnational Level. UN Habitat and Global Task Force. Available online at: https://unhabitat.org/roadmap-for-localizing-the-sdgs-implementation-and-monitoring-at-subnational-level/ (accessed January 15, 2023).

Google Scholar

Guha, J., and Chakrabarti, B. (2019). Achieving the Sustainable Development Goals (SDGs) through decentralisation and the role of local governments: a systematic review. Commonwealth J. Local Govern. 22, 1–20. doi: 10.5130/cjlg.v0i22.6855

CrossRef Full Text | Google Scholar

Gustafsson, S., and Krantz, V. (2021). Localizing the sustainable development goals through an integrated approach in municipalities: early experiences from a Swedish forerunner. J. Environ. Plan. Manag. 64, 2641–2660. doi: 10.1080/09640568.2021.1877642

CrossRef Full Text | Google Scholar

Hammer, J., and Pivo, G. (2017). The triple bottom line and sustainable economic development theory and practice. Econ. Dev. Q. 31, 25–36. doi: 10.1177/0891242416674808

CrossRef Full Text | Google Scholar

Harte, M. J. (1995). Ecology, sustainability, and environment as capital. Ecol. Econ. 15, 157–164. doi: 10.1016/0921-8009(95)00043-7

CrossRef Full Text | Google Scholar

Hartwick, J. (1977). Intergenerational equity and the investing of rents of exhaustible resources. Am. Econ. Rev. 67, 972–974.

Google Scholar

Ho, E., and Runnalls, J. (2018). Generation SDG: Empowering Canadians Through Sustainable Development. Waterloo, ON: Waterloo Global Science Initiative (SGSI).

Google Scholar

Huang, L., Wu, J., and Yan, L. (2015). Defining and measuring urban sustainability: a review of indicators. Landscape Ecol. 30, 1175–1193. doi: 10.1007/s10980-015-0208-2

CrossRef Full Text | Google Scholar

ICSU (2017). A Guide to SDG Interactions: From Science to Implementation. Paris: International Council for Science.

Google Scholar

Jackson, T. (2017). Prosperity Without Growth: Foundations for the Economy of Tomorrow. 2nd ed. New York, NY: Routledge.

Google Scholar

Jayasooria, D. (2016). Sustainable development goals and social work: opportunities and challenges for social work practice in Malaysia. J. Hum. Rights Soc. Work 1, 19–29. doi: 10.1007/s41134-016-0007-y

CrossRef Full Text | Google Scholar

Joss, S., Cowley, R., de Jong, W., Muller, B., Park, B., Rees, W., et al. (2015). Tomorrow's City Today: Prospects for Standardising Sustainable Urban Development. London: University of Westminster.

Google Scholar

Kanuri, C., Revi, A., Espey, J., and Kuhle, H. (2019). Getting Started With the SDGs in Cities: a Guide for Stakeholders. Sustainable Development Solutions Network (SDSN). Available online at: https://www.environmentandurbanization.org/ge..ng-started-sdgs-cities (accessed February 15, 2023)

Google Scholar

Károly, K. (2011). Rise and fall of the concept sustainability. J. Environ. Sustain. 1:1. doi: 10.14448/jes.01.0001

CrossRef Full Text | Google Scholar

Kates, R. W., Parris, T. M., and Leiserowitz, A. A. (2005). What is sustainable development? Environ. Sci. Pol. Sustain. Dev. 47, 8–21. doi: 10.1080/00139157.2005.10524444

CrossRef Full Text | Google Scholar

Klopp, J., and Petretta, D. (2017). The urban sustainable development goals: indicators, comlexity and the politcas of measuring cities. Cities. 63, 92–97. doi: 10.1016/j.cities.2016.12.019

CrossRef Full Text | Google Scholar

Krellenberg, K., Bergsträßer, H., Bykova, D., Kress, N., and Tyndall, K. (2019). Urban sustainability strategies guided by the SDGs-A tale of four cities. Sustainability 11, 1116. doi: 10.3390/su11041116

CrossRef Full Text | Google Scholar

Krueger, R., and Gibbs, D. (2008). Third wave sustainability? Smart growth and regional development in the USA. Region. Stud. 49, 1263–1274. doi: 10.1080/00343400801968403

CrossRef Full Text | Google Scholar

Kumi, E., Arhin, A., and Yeboah, T. (2014). Can post-2015 sustainable development goals survive neoliberalism? A critical examination of the sustainable development–neoliberalism nexus in developing countries. Environ. Dev. Sustain. 16, 539–554. doi: 10.1007/s10668-013-9492-7

CrossRef Full Text | Google Scholar

Lafortune, G., Cortés Puch, M., Mosnier, A., Fuller, G., Diaz, M., Riccaboni, A., et al. (2021). Europen Sustainable Development Report 2021: Transforming the European Union to achieve the Sustainable Development Goals. France: SDSN, SDGS Europe and IEEP.

Google Scholar

Leavesley, A., Trundle, A., and Oke, C. (2022). Cities and the SDGs: realities and possibilities of local engagement in global frameworks. Ambio 51, 1416–1432. doi: 10.1007/s13280-022-01714-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Lynch, A., LoPresti, A., and Fox, C. (2019). The 2019 US Cities Sustainable Development Report. New York, NY: Sustainable Development Solutions Network (SDSN).

Google Scholar

Martinez, C., and Mueller, M. (2015). The SDGs: opportunities for sonservation. Environ. Pol. Law 45, 239–245. doi: 10.3233/EPL-45602

CrossRef Full Text | Google Scholar

McArthur, J., and Rasmussen, K. (2017). Who and What Gets Left Behind? Assessing Canada's domestic status on the Sustainable Development Goals. Global Economy and Development, Working Paper 108. Washington, DC: Brookings Institute.

Google Scholar

Meadows, D. (1998). Indicators and Information Systems for Sustainable Development. Hartland: The Sustainability Institute.

Google Scholar

Meinherz, F., Fritz, L., and Schneider, F. (2020). “How values play into sustainability assessments: challenges and a possible way forward” in Sustainability Assessment of Urban Systems, eds C. Binder, R. Wyss, and E. Massaro (Cambridge: Cambridge University Press), 65–86.

Google Scholar

Mesa, N., Edquist, M., and Espey, J. (2019). A Pathway to Sustainable American Cities: A Guide to Implementing the SDGs. Sustainable Development Solution Network (SDSN). Available online at: https://irp-cdn.multiscreensite.com/be6d1d56/files/uploaded/190123-2019-us-cities-guide-INT.pdf (accessed February 2, 2023).

Google Scholar

Mook, L. (2019). The sustainable development goals: a tipping point for impact measurement? Can. J. Nonprofit Soc. Econ. Res. 10, 81–87. doi: 10.29173/cjnser.2019v10n2a343

CrossRef Full Text | Google Scholar

Mori, K., and Christodoulou, A. (2012). Review of sustainability indices and indicators: towards a new City Sustainability Index (CSI). Environ. Impact Asses. Rev. 32, 94–106. doi: 10.1016/j.eiar.2011.06.001

CrossRef Full Text | Google Scholar

Munda, G., and Nardo, M. (2009). Noncompensatory/nonlinear composite indicators for ranking countries: a defensible setting. Appl. Econ. 41, 1513–1523. doi: 10.1080/00036840601019364

CrossRef Full Text | Google Scholar

Nagendra, H., Bai, X., Brondizio, E., and Lwasa, S. (2018). The urban south and the predicament of global sustainability. Nat. Sustain. 1, 341–349. doi: 10.1038/s41893-018-0101-5

CrossRef Full Text | Google Scholar

Nardo, M., Saisana, M., Saltelli, A., Tarantola, S., Hoffman, A., and Giovannin, E. (2005). Handbook on Constructing Composit Indicators. Ispra: Joint Research Center; European Commission, 108.

Google Scholar

Nilsson, M., Chisholm, E., Griggs, D., Howden-Chapman, P., McCollum, D., Messerli, P., et al. (2018). Mapping interactions between the sustainable development goals: lessons learned and ways forward. Sustain. Sci. 13, 1489–1503. doi: 10.1007/s11625-018-0604-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Nilsson, M., Griggs, D., and Visbeck, M. (2016). Policy: map the interactions between sustainable development goals. Nature 534, 320–322. doi: 10.1038/534320a

PubMed Abstract | CrossRef Full Text | Google Scholar

Norde, W. (1997). Energy and entropy: a thermodynamic approach to sustainability. Environmentalist 17, 57–62. doi: 10.1023/A:1018535529785

CrossRef Full Text | Google Scholar

Noring, L., Struthers, D., and Grydeho, A. (2022). Governing and financing affordable housing at the intersection of the market and the state: Denmark's private non-profit housing system. Urban Res. Pract. 15, 258–274. doi: 10.1080/17535069.2020.1798495

CrossRef Full Text | Google Scholar

Odum, E. P., Odum, H. T., and Andrews, J. (1971). Fundamentals of Ecology. 3rd ed. Philadelphia, PA: Saunders Philadelphia.

Google Scholar

OECD (2016). An SDG-Based Results Framework for Development Co-operation. Paris: Organization of Economic Cooperation & Development (OECD).

Google Scholar

Parnell, S. (2016). Defining a global urban development agenda. World Dev. 78, 529–540. doi: 10.1016/j.worlddev.2015.10.028

CrossRef Full Text | Google Scholar

Pörtner, H.-O., Roberts, D., Poloczanska, E., Mintenbeck, K., Tignor, M., Alegría, A., et al. (2022). “Summary for policymakers” in Climate Change 2022: Impacts, Adaptation and Vulnerability. Contribution of Working Group II to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change. eds H.-O. Pörtner, D. Roberts, M. Tignor, E. Poloczanska, K. Mintenbeck, A. Alegría, et al. (Cambridge; New York, NY: Cambridge University Press), 3–33.

Google Scholar

Pradhan, P., Costa, L., Rybski, D., Lucht, W., and Kropp, J. (2017). A systematic study of Sustainable Development Goal (SDG) interactions. Earths Future 5, 1169–1179. doi: 10.1002/2017EF000632

PubMed Abstract | CrossRef Full Text | Google Scholar

Rauf, M. A., and Weber, O. (2021). “Sustainability management – a conceptual trade-off,” in Sustainable Development in Africa. World Sustainability Series, eds W. P. Filho, W. Leal Filho, R. Pretorius, and L. de Sousa (Cham: Springer).

Google Scholar

Rickets, W., Quaas, M., and Visbeck, M. (2014). How healthy is the human-ocean system? Env. Res. Let. 9, 044013. doi: 10.1088/1748-9326/9/4/044013

CrossRef Full Text | Google Scholar

Rockström, J., Gupta, J., Qin, D., Lade, S., Abrams, J., Andersen, L., et al. (2023). Safe and just Earth system boundaries. Nature. 619, 102–111. doi: 10.1038/s41586-023-06083-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Roseland, M. (2012). Toward Sustainable Communities: Solutions for Citizens and Their Governments. 4th ed. Gabriola Island, BC: New Society Publishers.

Google Scholar

Ross, D. (2018). Sustainability Planning and Assessment: Identifying and Evaluating Community Capital in the District of North Vancouver. Master Thesis. Vancouver, BC: Simon Fraser University.

Google Scholar

Ruan, F., and Yan, L. (2022). Challenges facing indicators to become a universal language for sustainable urban development. Sustain. Dev. 30, 41–57. doi: 10.1002/sd.2227

CrossRef Full Text | Google Scholar

Ruhil, R. (2017). Millennium development goals to sustainable developemnt goals: challenges in the health sector. Int. Stud. 52, 118–135. doi: 10.1177/0020881717725926

CrossRef Full Text | Google Scholar

Sachs, J. (2012). From millennium development goals to sustainable development goals. Lancet 379, 2206–2211. doi: 10.1016/S0140-6736(12)60685-0

CrossRef Full Text | Google Scholar

Sachs, J., Schmidt-Traub, G., Kroll, C., Durand-Delacre, D., and Teksoz, K. (2017). SDG Index and Dashbords Report 2017: Global Responsibilities. New York, NY: Bertelsmann Stiftung and Sustainable Development Solutions Network (SDSN).

Google Scholar

Sachs, J., Traub-Schmidt, G., Kroll, C., Lafortune, G., and Fuller, G. (2021). Sustainable Development Report 2021: Sustainable Development Goals includes the SDG Index and Dashboards. Cambridge: Cambridge University Press.

Google Scholar

Schmidt-Traub, G., Kroll, C., Teksoz, K., Duran-Delacre, D., and Sachs, J. D. (2017). National baselines for the sustainable development goals assessed in the SDG index and dashboards. Nat. Geosci. 10, 547–555. doi: 10.1038/ngeo2985

CrossRef Full Text | Google Scholar

Searle, G., and Filion, P. (2011). Planning context and urban intensification outcomes: Sydney versus Toronto. Urban Stud. 48, 1419–1438. doi: 10.1177/0042098010375995

CrossRef Full Text | Google Scholar

Simon, D., Arfvidsson, H., Anand, G., Bazaz, A., Fenna, G., and Foster, K. C. (2015). Developing and testing the Urban Sustainable Development Goals targets and indicators - a five-city study. Environ. Urban. 28, 49–63. doi: 10.1177/0956247815619865

CrossRef Full Text | Google Scholar

Smil, V. (2000). Energy in the twentieth century: Resources, conversions, costs, uses, and consequences. Annual Rev. Energy Environ. 25, 21–51. doi: 10.1146/annurev.energy.25.1.21

CrossRef Full Text | Google Scholar

Smith-Carrier, T. O. (2023). Ambitious for change? A critical appraisal of the Canadian indicator framework of the sustainable development goals. J. Hum. Rights Pract. 15, 204–231. doi: 10.1093/jhuman/huac049

CrossRef Full Text | Google Scholar

Spiliotopoulou, M., and Roseland, M. (2021). Making the SDGs relevant for cities: using the community capital tool in British Columbia. in Promoting the Sustainable Development Goals in North American Cities. Sustainable Development Goals Series. eds D. B. Abraham, and S. D. Iyer (Cham: Springer).

Google Scholar

Statistics Canada (2016). The Changing Landscape of Canadian Metropolitan Areas. Appendix C. Glossary. Available online at: https://www150.statcan.gc.ca/n1/pub/16-201-x/2016000/app-ann_c-eng.htm#cma-e (accessed June 12, 2023).

Google Scholar

Statistics Canada (2017). Data Products, 2016 Census. Core Housing Need, 2016 Census. Available online at: https://www12.statcan.gc.ca/census-recensement/2016/dp-pd/chn-biml/index-eng.cfm (accessed March 10, 2023).

Google Scholar

Statistics Canada (2020). The Daily. Table 1 Convenient Access to Public Transportation by Metropolitan Area. Available online at: https://www150.statcan.gc.ca/n1/daily-quotidien/200602/t001a-eng.htm (accessed March 10, 2023).

Google Scholar

Statistics Canada (2021). Definitions, Data Sources and Methods. Core Housing Need of Private Household. Available online at: https://www23.statcan.gc.ca/imdb/p3Var.pl?Function=DECandId=1230313 (accessed March 10, 2023).

Google Scholar

Statistics Canada (2022). Data. Incident-Based Crime Statistics, by Detailed Violations, Canada, Provinces, Territories, Census Metropolitan Areas and Canadian Forces Military Police. Available online at: https://www150.statcan.gc.ca/t1/tbl1/en/tv.action?pid=35100 (accessed March 10, 2023).

Google Scholar

Steg, L., and Gifford, R. (2005). Sustainable transportation and quality of life. J. Trans. Geography 13, 59–69. doi: 10.1016/j.jtrangeo.2004.11.003

CrossRef Full Text | Google Scholar

Swain, R. B., and Yang-Wallentin, F. (2020). Achieving sustainable development goals: predicaments and strategies. Int. J. Sust. Dev. World Ecol. 27, 96–106. doi: 10.1080/13504509.2019.1692316

CrossRef Full Text | Google Scholar

Taajamaa, V., Joensuu, M., Karanian, B., and Bettercourt, L. (2022). Serven steps to strategic SDG sensemaking for cities. Admin. Sci. 12, 33. doi: 10.3390/admsci12010033

CrossRef Full Text | Google Scholar

Tremblay, D., Fortier, F., Boucher, J., Riffon, O., and Villeneuve, C. (2020). Sustainable development goal interactions: an analysis based on the five pillars of the 2030 agenda. Sustain. Dev. 28, 1584–1596. doi: 10.1002/sd.2107

CrossRef Full Text | Google Scholar

Tremblay, D., Gowsy, S., Riffon, O., Boucher, J., Dube, S., and Villeneuve, C. (2021). A Systemic approach for sustainability implementation planning at the local level by SDG target prioritization: the case of Quebec City. Sustainability 13, 2520. doi: 10.3390/su13052520

CrossRef Full Text | Google Scholar

Turner, R. K., and Pearce, W. (1994). Environmental Economics: An Elementary Introduction. Hemel Hempstead: Harvester.

Google Scholar

UCLG (2018). Towards the Localization of the SDGs. Local and Regional Governments Report to the 2018 HLPF. Barcelona: United Cities and Local Governments. Available online at: https://www.global-taskforce.org/sites/default/files/2018-07/Towards_the_localization_of_the_SDGs.pdf (accessed February 2, 2023).

Google Scholar

Ulucak, R., Kassouri, Y., Ilkay, S., Altintas, H., and Garang, A. (2020). Does convergence contribute to reshaping sustainable development policies? Insights from Sub-Saharan Africa. Ecol. Indicat. 112, 106140. doi: 10.1016/j.ecolind.2020.106140

CrossRef Full Text | Google Scholar

UN (2015). The Millennium Development Goals Report. New York, NY: United States.

Google Scholar

UN (2017). UN Sustainable Development Goals Report 2017. New York, NY: United States.

Google Scholar

UN (2021). The Sustainable Development Goals Report 2021. New York, NY: United States.

Google Scholar

UNDP UN-Habitat, and GTF (2015). Localizing the Post-2015 Development Agenda-Dialogues on Implementation. New York, NY: United States.

Google Scholar

Valencia, S. C., Simon, D., Croese, S., Nordqvist, J., Oloko, M., Sharma, T., et al. (2019). Adapting the Sustainable Development Goals and the new urban agenda to the city level: Initial reflections from a comparative research project. Int. J. Urban Sustain. Dev. 11, 4–23. doi: 10.1080/19463138.2019.1573172

CrossRef Full Text | Google Scholar

Wakely, P. (2022). Sustainable urban housing policies in the era of post-covid climate change mitigation. Int. J. Urban Sustain. Dev. 14, 416–424. doi: 10.1080/19463138.2022.2055298

CrossRef Full Text | Google Scholar

Wang, X. (2021). Determinants of ecological and carbon footprints to assess the framework of environmental sustainability in BRICS countries: a panel ARDL and causality estimation model. Environ. Res. 197, 111111. doi: 10.1016/j.envres.2021.111111

PubMed Abstract | CrossRef Full Text | Google Scholar

WCED (1987). Our Common Future. New York, NY: United States; World Commission on Environment and Development (WCED).

Google Scholar

Weitz, N., Carlsen, H., and Nilsson, M. S. (2018). Towards systemic and contextual priority setting for implementing the 2030 agenda. Sustain. Sci. 13, 531–548. doi: 10.1007/s11625-017-0470-0

PubMed Abstract | CrossRef Full Text | Google Scholar

While, A., Jonas, A., and Gibbs, D. (2004). The environment and the entrepreneurial city: searching for the ‘urban sustainability fix' in Manchester and Leeds. Int. J. Urban Region. Res. 28, 549–569. doi: 10.1111/j.0309-1317.2004.00535.x

CrossRef Full Text | Google Scholar

World Health Organization (2021). WHO Global Air Quality Guidelines: Particulate Matter (PM2.5 and PM10), Ozone, Nitrogen Dioxide, Sulfur Dioxide and Carbon Monoxide. World Health Organization. Available online at: https://apps.who.int/iris/handle/10665/345329 (accessed March 2, 2023).

Google Scholar

Zhang, X., Han, L., Wei, H., Tan, X., Zhou, W., Li, W., et al. (2022). Linking urbanization and air quality together: a review and a perspective on the future sustainable urban development. J. Clean. Prod. 346, 130988. doi: 10.1016/j.jclepro.2022.130988

CrossRef Full Text | Google Scholar

Zhao, X., Ke, Y., Zuo, J., Xiong, W., and Wu, P. (2020). Evaluation of sustainable transport research in 2000–2019. J. Clean Prod. 256, 120404. doi: 10.1016/j.jclepro.2020.120404

CrossRef Full Text | Google Scholar

Zhou, Y., Clarke, A., and Cairn, S. (2022). Toward achieving local sustainable development: market-based instruments (MBIs) for localizing UN sustainable development goals. Urban Sci. 6, 24. doi: 10.3390/urbansci6010024

CrossRef Full Text | Google Scholar

Zinkernagel, R., Evans, J., and Neij, L. (2018). Applying the SDGs to cities: business as usual or a new dawn? Sustainability 10, 3201. doi: 10.3390/su10093201

CrossRef Full Text | Google Scholar

Keywords: sustainability, Sustainable Development Goals, SDG index, normalization, aggregation

Citation: Rauf MA, McCordic C, Sgro J, Frayne B and Wilson J (2023) Trading off sustainable development in Canadian cities: theoretical implications of SDG 11 indicator aggregation approaches. Front. Sustain. Cities 5:1264710. doi: 10.3389/frsc.2023.1264710

Received: 22 August 2023; Accepted: 23 October 2023;
Published: 09 November 2023.

Edited by:

Francesco Sica, Sapienza University of Rome, Italy

Reviewed by:

Richard Kotter, Northumbria University, United Kingdom
Gabriella Maselli, University of Salerno, Italy

Copyright © 2023 Rauf, McCordic, Sgro, Frayne and Wilson. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Muhammad Adil Rauf, YWRpbC5yYXVmJiN4MDAwNDA7dXdhdGVybG9vLmNh

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.