Skip to main content

REVIEW article

Front. Neurorobot., 30 November 2022
This article is part of the Research Topic The Roles of Self-organization and Sensory Adaptation for Locomotion in Animals and Robots View all 7 articles

Odor source localization of multi-robots with swarm intelligence algorithms: A review

\nJunhan WangJunhan WangYuezhang LinYuezhang LinRuirui LiuRuirui LiuJun Fu
Jun Fu*
  • Artificial Intelligence of Things and Robotics Laboratory, School of Computer Science and Information Engineering, Zhejiang Gongshang University, Hangzhou, China

The use of robot swarms for odor source localization (OSL) can better adapt to the reality of unstable turbulence and find chemical contamination or hazard sources faster. Inspired by the collective behavior in nature, swarm intelligence (SI) is recognized as an appropriate algorithm framework for multi-robot system due to its parallelism, scalability and robustness. Applications of SI-based multi-robots for OSL problems have attracted great interest over the last two decades. In this review, we firstly summarize the trending issues in general robot OSL field through comparing some basic counterpart concepts, and then provide a detailed survey of various representative SI algorithms in multi-robot system for odor source localization. The research field originates from the first introduction of the standard particle swarm optimization (PSO) and flourishes in applying ever-increasing quantity of its variants as modified PSOs and hybrid PSOs. Moreover, other nature-inspired SI algorithms have also demonstrated the diversity and exploration of this field. The computer simulations and real-world applications reported in the literatures show that those algorithms could well solve the main problems of odor source localization but still retain the potential for further development. Lastly, we provide an outlook on possible future research directions.

Introduction

What is robot OSL?

In nature, finding, locating, and recognizing odor information is a fundamental skill for organisms. For example, foraging ants can use residues of pheromones to establish the shortest route back from a food source (Hölldobler et al., 1990), and male moths discover and find mates by tracking the odor released by female moths (Charlton and Cardé, 1990). Inspired by the biological phenomena, since the 1990's, some scholars have started to study how to use mobile robots equipped with chemical sensors to “actively” sniff out odor for various tasks, such as odor map construction, odor source localization, and odor source classification. This type of research can be referred to as active olfaction in a broad sense. Odor source localization (OSL) is a process in which single or multiple mobile robots use sensors to “proactively” discover chemical plumes in the environment, track them, and identify the source of the odor.

The gas molecules released by the odor source are blown away by the wind and will flutter in the air like a feather to form a trajectory, which is called a plume (Murlis et al., 1992). Typically, locating odor source can be divided into three subtasks (Hayes et al., 2002): plume finding, plume traversal, and source declaration. Plume finding is a process of initial contact with the odor. Due to the stochasticity of plumes, plume finding mainly uses a random search strategy. Plume traversal is a process of making robots follow the plume to the odor source. It requires robots to have more “professional” behavior. It should move toward the odor source, and simultaneously, it cannot detach from the coverage of the odor plume. Odor source declaration refers to the robot's confirmation that the current location is the odor source rather than a local optimum. This process does not necessarily use odor information, as typical odor sources can also be determined by other means (such as vision) at short distances. Additionally, a plume reacquiring stage (Li et al., 2006) was proposed to be activated when the robots appear to lose contact with the odor for a given period during tracking plume. Figure 1 shows a male moth (Spodoptera frugiperda) locates its mate by detecting and tracing the sex pheromone emitted from the female, experiencing four stages.

FIGURE 1
www.frontiersin.org

Figure 1. A male moth (Spodoptera frugiperda) (a) locates its mate by detecting and tracing the sex pheromone emitted from the female (g), experiencing four stages: Plume finding (b), plume reacquiring (d) after detaching from the odor coverage (c), plume traversal (e), and source declaration (f).

In the early years, active olfaction for odor source localization by mobile robots did not perform as well as the fixed sensor approach. An essential reason is that under general indoor ventilation conditions, odor diffusion is influenced by turbulence, making the distribution of plumes show complex characteristics such as time-varying, interval, and multi-extremum. However, mobile robots only used chemotaxis to collect concentration information for plume tracking, making them easily trapped in the maximum local odor concentration or too long to converge, leading to failure. Over the last two decades, many studies have been conducted to make the robot avoid local optima and improve the search performance of algorithms in turbulent plumes.

Currently, there are four mainstream methods for locating odor sources (Jing et al., 2021), viz., reactive methods, heuristic search methods, probabilistic inference methods, and learning methods. The heuristic search method treats odor source localization as a functional optimization problem, that is, finding the optimal odor concentration in a particular region. Therefore, the OSL problem can be transformed into an optimal optimization problem. Among heuristic search methods, the swarm intelligence (SI) algorithms have been considered as a promising approach for the following advantages:

• Swarm intelligence algorithms mainly complete the work of complex tasks through self-organization by a population of individuals with simple behavior. The simple search behavior of a single robot is the continuation of a reactive robot based on odor concentration.

• Swarm intelligence algorithms can coordinate multiple robots to search for odor sources and effectively solve the defects of a single robot in the process of odor source localization, such as poor robustness and quickly falling into a locally optimal solution.

• In contrast to probabilistic inference methods and learning methods, the swarm intelligence algorithm mainly achieves the optimal position of odor concentration by multiple iterations of multi-robot individuals. It does not require the continuity and derivability of odor concentration to fit with the plume concentration's discontinuous and multi-local optimal characteristics in a natural turbulent environment.

Therefore, since 2006, researchers have begun to apply swarm intelligence algorithms to odor source localization in mobile robots. This paper gives an overview of odor source localization, focusing on swarm intelligence algorithms applied to this area.

Why this review?

So far, several investigations report on robot odor source localization have been published. Lilienthal et al. (2006) sorted out the literatures and published a review. However, the review was published more than a decade ago. The experiments mentioned were carried out in the indoor scenario, mainly considering the two-dimensional search space and classifying the applicable environmental conditions. The experimental conditions considered are still significantly different from those expected in most typical applications. It shows that the challenge in the future is to evaluate how to effectively combine different algorithms and test the corresponding implementation in a natural environment. Kowadlo and Russell (2008) pointed out that 3D localization will be further developed in the future, and more consideration will be given to obstacles and unstructured environments. Ishida et al. (2012) reviewed three subtasks of robotic odor localization. They argued that robotic OSL research has moved from the simulation and experimental stage to a more practical application-oriented stage, which is instructive for subsequent research. Chen and Huang (2019) used a new classification approach in their review: using algorithmic principles at the top level of the classification hierarchy, such as how to handle input signals (such as chemotaxis and anemotaxis), classified existing OSL algorithms into four categories, and noted that gradient-based algorithms currently lack attention and that probability and map-based algorithms are more attractive for research. In a recent review, Jing et al. (2021) pointed out that the classification method of the former may lead to some overlap between different categories and proposed a stricter classification method based on the principle of method according to the literatures published in recent years, and also emphasized some aspects not discussed in previous studies: in-situ sensing and simulator development for odor source direction and distance prediction. Meanwhile, they pointed out that the algorithm extensions to 3D environments, multiple robots, and their mixing situation have progressed in the past 10 years. Francis et al. (2022) recently published a review to overview the research on gas distribution mapping and source localization for both controlled and uncontrolled environments with robots, focusing on probabilistic algorithms developed for both single robot and multi-robot applications.

In recent years, more and more researchers have started to solve the OSL problem with swarm intelligence, and many significant research results have been achieved. However, to the best of our knowledge, review literature related to this has not been seen reported yet, so in this paper, we review multi-robot algorithms applied to odor source localization from the perspective of swarm intelligence. We review and discuss the main issues of odor source localization in turn in the last decade. The application of particle swarm optimization (PSO) algorithm and its improved algorithms are emphasized. Hybrid particle swarm algorithms combined with other independent algorithms will also be discussed. Various bio-inspired meta-heuristic optimization methods, which were not highlighted in the past reviews and are hot research trends in recent years, will be discussed separately.

How to categorize algorithms?

The existing swarm intelligence algorithms mainly applied to multi-robot system for odor source localization (Figure 2) are classified as follows according to the algorithm principle:

The standard PSO algorithm for OSL heavily relies on chemotaxis. Its inherent algorithm principle allows it to coordinate multiple robots, using current information, individual history information, and global history information to localize the target.

The modified PSO algorithms realize the optimization of the standard PSO to adjust particle position in the next iteration mainly by introducing more environment information (such as wind direction or velocity) or other useful characteristics (such as repulsion or sensor denoise), so that the PSO algorithms can be faster out of local optimum or suitable for multi-odor source localization, and so on.

The hybrid PSO algorithms are obtained through concatenating and incorporating PSO with other swarm intelligence algorithms in order to solve PSO defects such as premature convergence, falling into local optimum, slow convergence speed, and so on.

Other nature-inspired SI algorithms mainly imitate the behavioral strategies of individuals in certain groups of organisms in nature through local perception and behavioral communication to achieve foraging, migrating, and escaping from natural enemies, to implement collaborative discovery, tracking, and localizing of odor sources in multi-robot systems.

FIGURE 2
www.frontiersin.org

Figure 2. The diagram of existing swarm intelligence algorithms applied to multi-robot system for odor source localization.

The rest of this paper is organized as follows. Section Trending issues of robot OSL: An overview briefly discusses the trending issues of robot OSL. Section PSO and its variants in OSL: Origins and progress reviews the OSL methods based on PSO and its variants in detail. Section Other nature-inspired SI algorithms in OSL: Diversity and exploration reviews other swarm intelligence algorithms applied to robot OSL. Section Trends and challenges presents some trends and challenges in the future development of the robot active olfaction research. Finally, in last section, Conclusions are drawn.

Trending issues of robot OSL: An overview

After more than two decades of development, the researches on mobile robots' odor source localization have gone through a process from simplicity to complexity, theory to application, broadly in the following aspects.

Odor source: From single to multiple

Most robot OSL studies were conducted in the early years for single-point odor source environments. However, in a realistic situation, there may be point or surface odor sources with unknown numbers and locations emitting the same gas in the search area (Li et al., 2015).

Unlike the case of a single odor source, using multiple robots to locate multiple sources faces the following new problems.

How to maintain the exploration-exploitation balance in the search process

In earlier approaches, studies tended to emphasize exploitation, which would lead to premature convergence of the robot population once the extrema were found. Too many robots gathered in the same region tend to lose the diversity of individuals (Ghalia, 2008). However, if too much emphasis is placed on exploration, the algorithm will slow down the convergence. The dilemma is an extremely challenge faced by all multi-robot systems and swarm intelligence is advantageous but still need strictly assess in vastly different circumstances (Kwa et al., 2022).

How to search multiple odor sources in parallel

Traditional methods often take a sequential approach to locate multiple odor sources (Luo et al., 2008). In other words, only a single odor source can be located in a complete cycle (Zhang et al., 2015a), which affects the efficiency of odor source search.

How to avoid repeated searches for the same odor source

Such as how to issue a uniqueness statement for a specific odor source (Jatmiko et al., 2009b), determine whether the robot finds an existing odor source (Zhang J. et al., 2014), and how the robot swarm that finds an odor source continues searching for other odor sources.

To address the above shortcomings, some scholars have introduced the Niche technique into the OSL, which will be described in detail in the subsequent sections.

Airflow environment: From diffusion to turbulence

The difference in the airflow environment signifies that the primary way of odor transmission is different. The current studies mainly focus on two types of environments: diffusion-dominated environment and turbulence-dominated environment.

In diffusion-dominated environment, where there is no turbulence, molecular diffusion becomes the determining factor for odor propagation, such as in the subsurface. Therefore, a simple gradient search can approach the odor source along the plume—most of the early studies used diffusion-dominated environment settings for simulation experiments.

In a turbulence-dominated environment, turbulent diffusion mainly affects odor transport, while molecular diffusion can be neglected (Smyth and Moum, 2001). The odor source forms a plume under the wind effect. The chaotic character of turbulence tends to cause random bending of the plume, producing vortices of different sizes. Large-scale vortices cause the entire plume to twist and wind, making tracking more complex (Yee et al., 1994), while small-scale vortices tear the plume into many filaments. Localized high concentration odor filaments can lead to localized abrupt concentration changes and concentration discontinuities (Kowadlo and Russell, 2008). In this environment, available wind speed/direction sensors can detect relatively accurate values, such as in general outdoor and ventilated indoor environments.

Another environment type is the weak fluid environment under turbulent dominance. In this environment, turbulence controls odors, but existing wind speed/direction sensors cannot obtain reliable data. For example, closed indoor environments do not exchange fluids with the outside world but generate weak convection through temperature differences. This environment is more demanding than others, and less relevant research is available.

In a turbulence-like dominant environment, discontinuous concentration gradients and sudden concentration shifts make it difficult for chemotaxis strategies to locate the odor source effectively anymore. Therefore, more sophisticated search strategies and algorithms are needed to escape the local optimum. The algorithms applicable to various airflow environments are described in more detail in the following section.

Reactive principle: From chemotaxis to chemotaxis-anemotaxis

Chemotaxis and anemotaxis are two ways mobile robots utilize environmental information.

Chemotaxis refers to a method of mimicking organisms to rely on the concentration of the pheromone to reach the odor source. The robot uses the concentration measurements at different locations to calculate the concentration gradient and locates the odor source by climbing the odor concentration gradient. Plume dispersion is a steady process when the odor source is placed in a laminar (i.e., low Reynolds number) environment, which results in spatially coherent plume trajectories (Wang and Pang, 2021). In this case, the chemotaxis is effective. However, the odor concentration gradient in the actual case is not as smooth as expected because turbulence-dominated odor plumes are usually produced with vortices, and vortices of different sizes disrupt the shape of the plume with a smooth concentration gradient, which renders chemotaxis ineffective in this environment (Wang and Pang, 2021). Therefore, the utilization of wind information becomes an essential clue for odor source localization.

Anemotaxis is the process of some organisms in nature (e.g., dung beetles and silkworm moths) approaching an odor source against the wind or upstream in foraging and eventually locating the odor source. Inspired by this, earlier researchers have proposed to use wind information of organisms for OSL studies, mainly the Zigzag approach (Ishida et al., 1994), Silkworm moth algorithm (Russell et al., 2003), and Spiral Surge algorithm (Hayes et al., 2002). However, these studies are conducted in specific environments such as wind tunnels. The localization of odor sources cannot be effectively performed in a natural turbulent environment. In the last decade, the methods of anemotaxis have gradually changed from using wind information to using wind speed information combined with wind direction information. The upwind search ensures that the robot does not waste time searching in the wrong direction, and the wind speed helps the robot to adapt to the dynamic turbulent environment, which improves the search efficiency. Representative methods include the WUI and WUII methods (Jatmiko et al., 2016), adding upwind terms (Feng et al., 2019b), etc. The swarm intelligence algorithms utilizing both chemotaxis and anemotaxis will be described in detail in Sections PSO and its variants in OSL: Origins and progress and Other nature-inspired SI algorithms in OSL: Diversity and exploration.

Agent: From individual to swarm

Embryonic single-robot active olfaction used a reactive principal to locating hazardous odor sources. Such robots acquire odor concentration signals through sensors, which trigger a preset sequence of behaviors for odor source search. The behavior of mobile robots often does not involve historical information, and the subsequent behavior of the robot is directly related to the sensor measurements in the present moment.

The benefits of using multiple robots in odor source localization are very intuitive. The OSL problem can be considered as the problem of finding the location of the maximum odor concentration in the target space. Therefore, it can be transformed into an optimization problem (Genovese et al., 1992). The global search in the target area can be completed faster and with a better multi-odor source search capability by using multiple agents. Compared to single robot, multiple robots require more “intelligent” algorithms to better plan robot swarm and avoid collisions with each other. Otherwise, multiple robots without mutual collaboration would instead cause degradation of search performance (Chen and Huang, 2019).

The following limitations are still present when using multi-robots to deal with the actual odor finding problem:

• Sensor cost limitations. The odor sensors employed in multi-robot systems cannot be too expensive. The response and recovery time of the sensors is slow, and the accuracy is not high.

• Working environment limitations. In the natural environment, there are often differences between the coordinate position values given by the robot positioning system and the actual position the robot is in, and the robots are prone to collision with each other;

• Sensor installation location limitations. Robots often can only detect the odor concentration at a vertical height.

Due to these factors, the odor concentration measurements are often inaccurate and contain noise. Under the influence of noise, the robot search process often appears to be prematurely stalled or meandered and sometimes even misled so that the robot is trapped in a pseudo-odor source location (Zhang Y. et al., 2014). In the subsequent sections, we will discuss how the improved PSO algorithm and the hybrid PSO algorithm weaken the effect of noise.

Experimental validation: From computer simulation to real-life scenario

At present, three means are mainly used in active olfaction research, viz., simulation experiments, wind tunnel experiments, and field experiments to validate the OSL method. Experiments in a natural environment are the closest to the application scenarios. However, the experiments are difficult and costly to reproduce. They cannot meet the requirements of the high frequency of experiments and many changes in experimental conditions in the early research stage. Therefore, simulation was an essential tool in the initial research stage of OSL. Simulation can provide arbitrary configuration and reproducible virtual airflow environment for accurate simulation of odor plume and flow field, which helps to compare and verify the effect between different algorithms and between different improvements of the same algorithm and solve the problem of difficult reproduction and accurate comparison of odor experiments (Fan et al., 2017).

The distribution of the odor plume in the natural environment presents complex characteristics such as time-varying, interval, and multiple values (Meng et al., 2011), which are difficult to describe by constructing an accurate model. Therefore, most studies use relatively simplified numerical computational models. The plume models currently used in the OSL field mainly include the static Gaussian dispersion model (Ishida et al., 2005, 2006), Filament-based atmospheric dispersion model (Farrell et al., 2002), Lattice plume model (Balkovsky and Shraiman, 2002), Plume model based on CofinBox software package (Marques et al., 2006), etc.

PSO and its variants in OSL: Origins and progress

Standard PSO

Particle swarm optimization is an iterative optimization algorithm based on a simplified social population, inspired by the swarm behavior of a bird's flock: a flock of birds is searching for food randomly. There is only one piece of food in the area. All birds do not know where the food is, but they know the distance between their current position and the food. The best strategy in such a situation is to search the area around the bird that is currently closest to the food. Kennedy and Eberhart (1995) firstly proposed this algorithm for non-linear function optimization. In each iteration of PSO, every particle updates itself by tracking two “extremes” through experiences of individual and population which mean local optima and global optima, respectively. The PSO algorithm exhibits the weak computational properties of a single particle and the strong coordination of a population of particles. Therefore, it is considered as one of the most suitable optimization algorithms for multi-robot odor source localization.

The target search space is assumed to be D-dimensional in the standard PSO, and the position of the ith particle at time t can be represented as a D-dimensional vector Xi(t) = (xi1, xi2, …, xiD). The optimal position of the ith particle so far is Pi(t) = (pi1, pi2, …, piD). The best position searched by the whole particle swarm so far is Pg(t) = (pg1, pg2, …, pgD), Equation 1 gives the velocity of the ith particle in the D-dimensional search space. The three terms on the right-hand side represent the motion direction of the original, the individual optimal, and the population optimal, respectively. Equation 2 updates particles' new position. Learning factors c1 and c2 are weights for options if the system is designed to tend to individual optimal or population optimal; r1 and r2 are two random numbers ranging from 0 to 1, w is the inertial factor, which tends to maintain the original direction with larger values.

Vi(t+1)=wVi(t)+c1r1(Pi(t)-Xi(t))                    +c2r2(Pg(t)-Xi(t))    (1)
Xi(t+1)=Xi(t)+Vi(t+1)    (2)

Marques et al. (2006) first applied PSO to multi-robot collaboration to locate odor sources. In the plume discovery stage (which the author calls global search), they adopt a global random search strategy, integrating the repulsive force between agents and the biased crosswind motion. Once the local plume is found, it enters the local search stage, and the PSO algorithm is used for plume tracking. In this process, the fitness value of the particle is the concentration value of the pollutant where the particle is located. In the simulation experiment, the author compared the time of finding all odor sources in different atmospheric stability environments with three search algorithms: BRW local search, concentration gradient tracking, and particle swarm local search. The experiment showed that the PSO algorithm performs worst in a stable atmospheric molecular diffusion environment. However, in an unstable airflow environment with turbulence, i.e., the most realistic situation, the particle swarm search algorithm has an excellent advantage. Chen et al. (2017) proposed a multi-robot search method based on the PSO algorithm, incorporating a divergence search strategy for plume discovery and a mass flux divergence method for odor source declaration. The method was validated in a time-varying source environment with different ventilation environments, intensity variations, and obstructions.

The PSO algorithm can organize robots for search behavior but still has some drawbacks that need improvement, such as easily falling into local optima in non-ideal environments, inability to perform a multi-source search, and requiring a certain number of robots to ensure convergence speed. For better performance, scholars have made many improvements, which will be presented in the following subsection.

Modified PSOs

Table 1 summarizes various of modified PSOs for odor source localization. The column names and their meanings are as follows: the aim of the study (Aim), the name of the modified algorithm (Algorithm), authors of the work (Author), the principal modification of the study (Modification), the reactive principle (Rec), the validation method (Val), the number of odor source being located (Odor), and the airflow environment (Air).

TABLE 1
www.frontiersin.org

Table 1. Summary of the modified PSOs for odor source localization.

How agents escape from local optima

In the ventilated indoor environment, the odor plume fluctuates and is intermittently influenced by turbulence. Larger vortices may easily lead to lengthy local maxima. To solve this problem, Jatmiko et al. (2007) were the first to exploit the chemotaxis with wind information by introducing the angle θ between the wind vector W(t) and the robot motion vector Vi*(t). Two WU-PSO methods are proposed for odor source localization in turbulent environments with obstacles. WUI is to set a forbidden area opposite the upstream direction of the turbulent flow, as shown in Equation 3, to ensure that particles move against the wind direction. WUII uses θ to calculate parameters χθ and then calculates the next updated position of particles through Equation 4.

Vi(t+1)={0 if θ<|θforbidden |Vi(t+1) Otherwise     (3)
Vi(t+1)=χθ·Vi*(t+1)    (4)

Ferri et al. (2007) proposed an explorative PSO algorithm (E-PSO) in an environment without strong winds, using an index based on the peak and average of historical odor concentrations as fitness and increasing the degree of exploration of the search area. Gong et al. (2012) proposed a modified PSO algorithm (RW-PSO) through introducing repulsive force and wind factors, which was validated in a time-varying simulation environment. Li et al. (2008) proposed a probabilistic particle swarm optimization (P-PSO) algorithm. The odor source probabilities estimated by Bayesian inference and variable universe fuzzy inference are used as expressions of the adaptation function. In P-PSO, they used wind information for constructing local probabilities of odor sources based on Bayesian inference, used concentration information for local probability maps of odor sources based on fuzzy inference, and then fused local probability distribution maps of odor sources from multiple robots to form a global raster probability map. Therefore, Pi(t) and Pg(t) in Equation 1 changed to the grid of the local maximum odor source probability up to the point in time and the global maximum odor source probability grid, respectively. Meng et al. (2011) proposed a plume estimation-searching framework based on P-PSO (Li et al., 2008) for slowly varying airflow environments (e.g., a slightly wandering large-scale advection-diffusion plume). It fuses the odor source probability distribution maps estimated independently by different robots at different times into a combined map based on the superposition of distances. The combined odor source probability distribution map expresses the adaptation function. The experimental simulation results show that it can approach the odor source with fewer robots.

How agents adapt to turbulent environments

Most studies have been conducted in a mechanically ventilated, steady turbulent environment. However, winds in realistic scenarios tend to be time-varying, with unstable wind direction and speed, making the robot more susceptible to local optima due to large-scale vortices. In order to get out of the local optimum in a dynamically turbulent environment with obstacles, Li et al. (2010) further refined the proposed Probability-fitness-function based particle swarm optimization (P-PSO) algorithm, which integrates information on the size of odor concentration, concentration variation, and wind direction.

Pg(t)=argmaxmxy(pgnom(mxy,t))    (5)
Pi(t)=argmaxmxy(pL(mxyzi,1:t))    (6)

where zi, 1:t is the detection event of the ith robot from moment 1 to moment t. pL(mxyzi,1:t) denotes the detection event of the raster mxy passing the ith robot at time t. pgnom(mxy, t) denotes the normalized odor source probability value of the raster mxy at time t. Jatmiko et al. (2009a) proposed an modified PSO algorithm (Niche-PSO) incorporating the Niche technique, considering chemotaxis and anemotaxis. They later proposed two improved PSO methods (Jatmiko et al., 2006a,b), Detect and Respond PSO (DR-PSO) and Charged PSO. In the Charged PSO algorithm, the robot is divided into neutral and charged robots. The repulsive force between the charged robot and other charged robots obeys Coulomb's law, as shown in Figure 3, to ensure the diversity of some robots.

FIGURE 3
www.frontiersin.org

Figure 3. Interaction of the charged swarm robots (Jatmiko et al., 2007).

For a neutral robot, its position and velocity updating method are the same as Equations 1, 2; for charged robots, its position updating method refers to the Equation 2, and the velocity updating position method is like the Equation 7, ai(t) represents the total repulsive force of the robot at time t.

Vi(t+1)=wVi(t)+c1r1(Pi(t)Xi(t))                  +c2r2(Pg(t)Xg(t))+ai(t)repulsive force    (7)

Lu et al. (2014a,b) proposed a finite-time particle swarm optimization (FPSO) algorithm based on a continuous-time model and a discrete-time version of the FPSO algorithm. In order to make particles converge in a finite time interval, a non-linear damping term is introduced. The simulation results show that the discrete-time version of FPSO can successfully locate the odor source.

In order to adapt to the dynamic turbulence environment, Feng et al. (2019b) proposed a PSO algorithm with an upwind term and obstacle avoidance algorithm (UOA-PSO), which adds an upwind term to the standard PSO algorithm to utilize wind information for locating time-varying attenuation sources and time-varying periodic sources with higher success rate than standard PSO and WUII methods. In the algorithm, an upwind velocity Viu(t) at moment t is added to the Equation 1 for the ith robot position and velocity, as shown in Equation 5, where c3 reflects the effect of airflow on the robot velocity and r3 is a random number in [0, 1].

Vi(t+1)=wVi(t)+c1r1(Pi(t)-Xi(t))                  +c2r2(Pg(t)-Xi(t))+c3r3Viu(t)    (8)

Subsequently, Feng et al. (2019a) proposed a comprehensive particle swarm optimization (CPSO) method that combines a source identification algorithm and a strategy to escape from local extremal regions based on the previous UOA-PSO method (Feng et al., 2019b). The effectiveness of method was realistically verified by three robots in a typical time-varying airflow environment and compared with standard PSO and WUII methods in an experimental setting, concluding that the CPSO has higher source localization efficiency. To avoid successive local extrema, Feng et al. (2019c) proposed another multi-robot sniffing approach (URPSO) based on an adaptive particle swarm optimization algorithm. This method incorporates an upwind term and a random interference term, and combines a divergence search strategy and a maximum concentration method. Feng et al. (2020) further proposed a modified PSO algorithm (ED-PSO) introducing extremum disturbance factors, which can be independent of any airflow information. The individual optimal position Pi(t) and the global optimal position Pg(t) are updated as follows:

Pi(t)=Pi(t)+c3VmaxPir    (9)
Pg(t)=Pg(t)+c4VmaxPgr    (10)

where Vmax is the maximum magnitude of the velocity vector of each robot, namely, the maximum step length of each robot. Pir and Pgr are two disturbance vectors uniformly distributed in [−1, 1]. c3 and c4 are dimensionless parameters that reflect the disturbance magnitudes of two disturbance vectors on Pi(t) and Pg(t), respectively. The method consists of three core algorithms: an improved PSO algorithm introducing extreme value disturbance factors, a maximum concentration method for plume source declaration, and a dispersion search strategy for plume finding and escape from local extreme value regions. The robustness of method was demonstrated in an experimental environment with indoor mechanical ventilation.

How agents find multiple odor sources

Jatmiko et al. (2009b) proposed a modified PSO algorithm (RS-PSO), where they used niche and parallel search characteristic to deal with multi-peak and multi-source problems. In addition, a range subgroups method was introduced to improve the efficiency of the search capability. Zhang J. et al. (2014) proposed a Niching PSO-based method for cooperative localization of odor sources by robots. A random search algorithm is used to search for the plume in the global search phase. After finding the plume, the particle and the particles within the neighboring radius R form a niche, and all particles inside the niche will track the same plume while different niches are applied to locate different odor sources simultaneously. To locate different odor sources efficiently, a dynamic adjustment strategy of niche size based on the degree of aggregation and a merging strategy based on optimal similarity are applied. In addition, practical conditions such as the sampling/recovery time of the sensor and the speed limit of the robot are also considered.

The particle velocity update method is as follows:

Vk(t+T)=wVk(t)+c1r1(Pk(t)-Xk(t))                   +c2r2(Pg(t)-Xg(t))    (11)

The difference with Equation 1 is that k = 1, 2, …, Ni, Ni in Equation 11 is the size of the ecotone, and T is the sum of sensor sampling and recovery time. The method was simulated in a naturally ventilated indoor environment with obstacles, and the results show that the algorithm can locate several odor sources simultaneously with a high success rate.

How to coordinate agents

In previous literature, robots were often treated as mass points. However, in reality, they are not. In order to coordinate the movement between multiple robots and prevent collisions between robots, Lu and Han (2010) designed a distributed coordination control method (PSO-S-Consensus) consisting of an artificial layer and a control layer. Trajectory level has been employed in the proposed control scheme. Lu et al. (2016) designed a cooperative control framework for the PSO algorithm implementing a collective decision mechanism for the ordered motion behavior of the particles. The cooperative control framework consists of a position coordination term, a velocity coordination term, and a motion direction coordination term. Based on this framework, the PSO-CCF algorithm was proposed for the OSL problem, which can coordinate the relative positions between robots and ensure the orderly motion of robots to avoid collision and capture time-varying plumes. Jain et al. (2019) proposed a cooperative multi-robot localization method based on diverse-PSO and introduced four kinds of robot formation operation. Five different robot behaviors are added in the plume tracking phase. In the three-dimensional turbulent simulation environment with and without errors, the experimental results show that the diverse-PSO algorithm is superior to the Modified PSO, Niche-PSO, and R-PSO (Yan et al., 2018).

Searching with swarms of unmanned aerial vehicles (UAVs) can be regarded as odor source localization in three-dimensional space, allowing odor source detection in more complex contaminated environments than employing ground-based robotic teams to search for odor sources. Traditionally, particle swarm optimization algorithms treat robots as prime points, and this concept obviously cannot be applied to UAV search. Fu et al. (2019) proposed an APF-PSO algorithm using an artificial potential field method for generating safe and smooth UAV swarm flight paths, which improves the safety of the algorithm. Meanwhile, adaptive inertia weights and exclusion zones are introduced to help particles escape from the local optimum. Simulation experiments show that the adoption of this algorithm has a significant impact on the search success rate and efficiency.

How to improve other performances

To better balance local search with global search at different stages, Yan et al. (2018) introduced a “request and reset” strategy into the Guaranteed Convergence PSO (Van den Bergh and Engelbrecht, 2002) and Dissipative PSO (Xie et al., 2002) and both added a modified learning factor and inertia weight, to form two modified PSOs (RR-GC-PSO and MD-PSO). The “Request and Reset” strategy can remove the low-fitness particles and re-incorporate them into the global search to enhance the algorithm's global search capability. The simulation results show that the RR-GC-PSO algorithm converges faster and has a higher success rate for robots in a large environment with small population size. The velocity update equation of robot in “optimal group” in RR-GC-PSO, as shown in Equation 12, is quite different from that in standard PSO.

Vi(t+1)=wVi(t)-Pi(t)+Pφg+ρ(1-2r2)    (12)

where pφg is the global optimal position detected by robot φ, and ρ is a scaling factor related to the size of the search area.

To improve the localization accuracy of the algorithm, Wang et al. (2017) proposed a combined approach using both static and mobile sensors, using modified genetic algorithms (MGA), Markov Chain Monte Carlo (MCMC), and MGC-PSO algorithms. In this study, OSL was divided into three stages: static sensors for data acquisition, a rough calculation of the search area, and a mobile robot swarm for odor source localization. First, the MGA algorithm estimates a possible source of leakage as the initial sampling point for MCMC sampling. The MCMC then calculates search areas that are likely to contain odor sources. Finally, the mobile robot uses the MGC-PSO algorithm to locate the leakage source accurately. Simulation results show that the method can locate the odor source within one meter.

The odor concentration sensors measured by robots during source localization commonly contain noise. Zhang Y. et al. (2014) proposed a collaborative multi-robot search method based on Bare-Bones PSO (BB-PSO) to solve this problem. Dynamic statistics estimates the noise intensity of odor concentration measured by the robot, and the fitness value of particles in a noisy environment is expressed by interval number. Particles' position update based on the defined particle probability dominance relation. Let the measured odor concentration value of the robot at position Xi(t) be f(aj), and the intensity of the measured odor concentration value of the robot at the current position Xi(t) affected by noise is estimated as follows:

ρi(t)=1mj=1m|f(aj)-0.5(f(aj-1)+f(aj+1))|    (13)

where t is the number of iterations, the absolute difference is calculated by the measured odor concentration value and the estimated value (the average of the measured odor concentration values at adjacent positions on both sides of position j). The true odor concentration value of the location Xi(t) of will fall with a high probability in the interval [f(Xi(t)) − ρi(t), f(Xi(t)) + ρi(t)]. This interval is used as the fitness of the particles in the current position for particle update, and the probability interval method is used to avoid the influence of noise. In the turbulent simulation environment, the experimental results show the excellent performance of the method.

To enable robots to find odor cues quickly, Lu et al. (2013) introduced finite-time parallel and cyclic controllers for parallel motion and circular motion of robot groups and designed a PSO method based on two-layer decision-control system (DCS-PSO) for a hierarchical response. The wind information is introduced in the decision layer. The convergence of the finite-time algorithm is analyzed by using the Lyapunov method, and simulation experiments verify the effectiveness of the proposed method.

In order to locate the odor source faster for effective decision making under communication and computational resource constraints, Sinha et al. (2020) proposed a PSO algorithm based on a hierarchical cooperative control strategy (SMC-PSO) including a group decision layer and a robust collaborative control layer. In the group decision layer, the modified PSO, which introduces odor concentration information and wind information, is used to make a group decision and send it to the robust collaborative control layer. The robust collaborative control layer implements a sliding mode controller in an event-triggered fashion, which ensures that the robot can converge to the equilibrium point in a limited time.

Hybrid PSOs

The simulated annealing algorithm (SA) is derived from the simulation of the solid annealing process (Kirkpatrick et al., 1983) and is a kind of heuristic Monte Carlo method. It can be applied to optimization problems, namely to locate an excellent approximation to the global minimum of a given function in a vast search region. To prevent premature convergence of the particle swarm, Gong et al. (2012) proposed a SA-RWPSO algorithm that combines SA algorithm and multiple dynamic factors (here RWPSO is PSO based on repulsive force and wind). In the standard PSO algorithm, if the current position of a particle is better than the historical best position Pbest, the current position will become the new best position Pbest. The direct replacement strategy will result in a tendency for the particles to converge to the optimal position Pbest prematurely, and particles are more likely to lose diversity. In SA, the algorithm can accept deteriorating solutions with a certain probability and accept optimized solutions. The particle will accept the new position Xi(t+1) of the ith particle at moment t with probability δpro in the case that Xi(t+1) is inferior to Pi(t). Moreover, δpro will decrease as the number of temperature iterations increases. This indicates that particle diversity can be preserved in the initial stage of the algorithm, and convergence is guaranteed in the later stages, which represents that the simulated annealing algorithm can both jump out of the local optimum and converge to the vicinity of the global optimum solution. Therefore, the SA algorithm is feasible for solving the OSL problem with multi-polar concentration functions indoors. Simulation results in four typical scenarios show that the proposed algorithm can guide the multi-robot system to quickly and accurately locate the odor source.

Also, to prevent particles from being trapped locally, Zhang et al. (2015b) proposed a refined hybrid PSO algorithm that combines two bacterial foraging optimization (BFO) operations for odor source localization in robot swarms. In the proposed algorithm, the authors integrate the convergence operation into the PSO algorithm to guide the robot to track the plume and employ the elimination-dispersion operation to avoid particles falling into local minima. In standard PSO algorithm, if the current position of a particle is very close to the individual optimal position and the globally optimal position in the late iteration, the velocity of all particles will drop to very small, or even zero, which will cause all particles to stop updating prematurely and the algorithm will converge to a false local optimum. Hence, the authors adopt a better approach by proposing an improved BFO elimination and diffusion method that searches for a better solution near the wrong local optimum instead of stopping the movement. In the BFO-PSO algorithm, the particle swarm, after being updated by Equations 1, 2, will be updated again using the chemotactic equation as:

Xi(t+1)=Xi(t)+S(i)Vi(t+1)Vi(t+1)TVi(t+1)    (14)

where S(i) is the unit travel length of the agents. From Equation 14 it can be seen that the agent will move further along the velocity direction. This is followed by an improved elimination and dispersion of BFO to prevent convergence to localization, as follows:

Xi(t+1)={Xi(t)+S(i)Δ(i)(Δ(i))TΔ(i)   if rand ( ) <PedXi(t),                                         otherwise     (15)

where Δ(i) is the random direction vector and Ped is the probability of elimination and dispersion.

To balance exploration and exploitation in multi-robot target search, Jain et al. (2018) used the gray wolf optimization (GWO) in concatenation with the PSO algorithm. In the GWO algorithm, the prey's surrounding behavior will help keep the robot within the plume area. Two GWO-PSO and PSO-GWO plume tracking algorithms are proposed by the concatenated method for multi-robot collaboration and prevention of premature local convergence. However, this method cannot locate multiple odor sources in parallel.

Nevertheless, the BFO-based PSO algorithm, the GWO-based PSO algorithm, and most of the hybridization algorithms require the tuning of control parameters to achieve the best efficiency. This represents a difference in the search efficiency of the algorithms in different environments. Gaurav et al. (2020) proposed a parameter-free hybrid teaching learning particle swarm algorithm (HTLPSO). In this method, the teaching phase of TBLO is merged with the PSO algorithm, which helps to improve the computational speed and efficiency. Simulation results in single odor source and multiple odor source environments demonstrate the search effectiveness of HTLPSO and its high accuracy convergence even with a small number of agents.

Table 2 summarizes various of hybrid PSOs for odor source localization. The column names and their meanings are as follows: the name of the hybrid algorithm (Algorithm), the purpose of the study (Aim), authors of the work (Author), the algorithm combined with PSO (Com), the reactive principle (Rec), the validation method (Val), the number of odor source being located (Odor), and the airflow environment (Air).

TABLE 2
www.frontiersin.org

Table 2. Summary of the hybrid PSOs for odor source localization.

Other nature-inspired SI algorithms in OSL: Diversity and exploration

Table 3 summarizes various of nature-inspired SI algorithms applied to odor source localization. The column names and their meanings are as follows: the name of SI algorithm (Algorithm), authors of the work (Author), the principal operation of the work (Operation), the reactive principle (Rec), the validation method (Val), the number of odor source being located (Odor), and the airflow environment (Air).

TABLE 3
www.frontiersin.org

Table 3. Summary of other nature-inspired SI algorithms applied to odor source localization.

Cuckoo search optimization

Cuckoo search optimization (CSA; Yang and Deb, 2009) is inspired by the parasitic brooding behavior of cuckoo populations and the Lévy flight behavior during nest migration. The cuckoo search algorithm has the advantages of simplicity, few parameters, and easy implementation. In dealing with complex optimization problems, there is no need to set many parameters in CSA. In fact, in addition to the population number n, there is only one parameter P in CSA. Lévy flight and preference random walk are two critical components of the cuckoo search algorithm, which makes the CSA better global searchability and have solid local searchability. They can get better results for almost all optimization problems.

Wang et al. (2016) proposed a method for locating odor source based on the CSA algorithm. In the plume discovery phase, this method introduces the concept of a taboo position. The distance of the robot's new target location should be greater than the distance between the taboo position and the distance threshold. In the plume tracking phase, a master-slave robot search mechanism is employed. It uses the robot that detects the highest odor concentration among all robots to guide the other robots to search for the odor source in its upwind direction. Let the serial number of the master agent at the gth iteration be Nbest, and the location be Xbest. At the g+1th iteration, all agents will be updated at the position Xbest of the master agent with Equation 16:

Xg+1,i=Xg,best+Li,(i=1,2,,N)    (16)

where Xg+1, i represents the updated position of the ith robot at the g+1st iteration, Li(i = 1, 2, …, N) is the step vector whose modulus d obeys the Lévy distribution and N is the number of robots. To improve the search efficiency, the method incorporates upwind search and a local odor concentration optimization mechanism. In a simulated environment with indoor ventilation, it is verified that the method can guide multiple robots to search for odor sources faster compared with the U-ACO algorithm.

In order to further improve the cuckoo algorithm source finding efficiency with an extensive range search for multiple scent sources, Wu and Wang (2021) proposed an improved CSA. The forbidden areas were introduced as the cuckoo's territory to prevent the cuckoo from falling into local optimal positions. When a certain number of cuckoos are close to the same scent source, the best local cuckoo in the area acts as the center of the area, declared as the forbidden area. The area is no longer repeatedly searched by other robots. The concept of forbidden area merging was introduced to prevent repeated discovery of the same odor source. Simulation results show that the method can accurately locate multiple odor sources in a Gaussian diffusion model environment.

Ant colony optimization

Ant colony optimization (ACO) is proposed to simulate the foraging behavior of ant colonies in nature (Dorigo et al., 1996). It has the characteristics of positive feedback, parallel computing, good robustness, etc. Ants will continuously secrete pheromones during their out-feeding walk, and as the pheromones accumulate, most ants later will follow this shortest path. The traditional ant system consists of three main parts: initialization, solution construction, and pheromone update. Through the accumulation of pheromones, its search results have strong robustness, but there are still many shortcomings. For example, in the early stage of global search, the uniform distribution of pheromones may slow down the iteration speed and make ants search blindly. Meanwhile, the algorithm is prone to fall into local optimal solutions. Meng et al. (2006) were the first to use an improved ACO combined with a genetic algorithm for solving the OSL problem: in the iterative process, the genetic algorithm is first used for local search, then the ACO for global search, and finally pheromone updates. In the global search phase, under appropriate conditions, robot i performs a global search with probability p(i, j) for the region where robot j is located for a certain number of steps as follows:

p(i,j)=τα(j)edijβj=1mτα(j)edijβ, (j=1,2,,m)    (17)

where dij = C(j)−C(i) is the difference between robot j and the locally optimal concentration in the region where robot i is located, τα(j) is the pheromone of robot j, α and β are the weight parameters, and m is the number of robots. After all robots have completed the global search, if n robots move toward the region where robot i is located and increase their concentration, the pheromone in the region where robot i is located will be updated as follows:

τ(i)=λ·τ(i)+j=1nC(j)    (18)

where λ is a coefficient describing the degree of pheromone decay, in (0, 1). This method can find the location of an odor source with fewer iterations, but the effectiveness of the method for searching multiple odor sources has not been verified. Zou and Luo (2008) and Zou et al. (2009) proposed an improved search strategy for the ACO by redefining the pheromone and heuristic functions, adding two search modes, local traversal search and global random search, and including a validation procedure for recording multiple odor sources in a single iteration. Simulation results demonstrate the effectiveness of the improvement. However, the method causes the robot to repeatedly converge to the searched odor sources, which reduces the search efficiency of multiple odor sources. Meng et al. (2010) will propose an improved ant colony algorithm (US-ACO) combined with an upwind search algorithm for a time-varying indoor odor environment and validate its effectiveness in a natural indoor turbulent environment. Further, Cao et al. (2013) introduced the concept of selective olfaction based on the US-ACO algorithm and proposed an asynchronous ant colony optimization algorithm (SoACO) for fast localizing multiple odor sources. Specifically, the concentration sensor will selectively stop working during the search to jump out of the local optimum and the multi-source search. This approach successfully found multiple odor sources continuously within fewer robots in the simulation experiments. Che et al. (2018) divided the robots into two groups according to the pheromone concentration to perform the tasks of upwind search and improved ant colony algorithm search, respectively. In the process of global pheromone update, the influence of time-varying wind field on odor plume was considered, in which the wind speed determines the update frequency. Simulation results show that the algorithm has a high success rate and search efficiency.

Glowworm swarm optimization

Glowworm swarm optimization (GSO) can be employed to compute multiple optimal values of multimodal functions simultaneously. The algorithm was originally proposed by Krishnanand and Ghose (2009) as a variant of the ACO algorithm, but several significant modifications exist. Like the ACO, where each motion area is associated with a pheromone value, the agents in the glowworm algorithm also carry a luminous quantity. Agents are considered to be glowworms, which emit light of an intensity proportional to the associated quantity of luminescence and have a circular sensor range. The glowworm k has a circular sensor range rsk, to define the variable local decision domain rdk(0<rdk<rsk) for computing motion (as shown in Figure 4). As with the ACO, each agent i has a certain probability pj(t) to move to the region where neighbor j is located, and the discrete-time model for an agent position update is as follows:

Xi(t+1)=Xi(t)+s(Xj(t)-Xi(t)Xj(t)-Xi(t))    (19)
s={ δ,   if d(i,j)δd(i,j), otherwise       (20)

where d(i, j) denotes the distance between robot i and robot j. To simulate the decay of fluorescein with time, the rule for updating the fluorescein of robot j at moment t is as follows:

j(t+1)=max{0,(1-ρ)j(t)+γJj(t+1)}    (21)

where Jj(t) denotes the value of the luciferin level of agent j at moment t, γ is the proportionality constant used to increase the luciferin level, and ρ is the luciferin decay constant (0 < ρ < 1 ).

FIGURE 4
www.frontiersin.org

Figure 4. Glowworm i is in the sensor range of (and is equidistant to) both j and k. However, j and k have different local-decision domains, and only j uses the information of i (rdk<rdj<rsk<rsj). Figure modified from Krishnanand et al. (2006).

Benefiting from the property that the GSO can find the optimal solution of multiple optimal continuous functions (Krishnanand and Ghose, 2005; Krishnanand et al., 2006; Zainal et al., 2013) used the GSO for solving the multi-source localization problem. Variable local decision domains are also applied to glowworms. The variable local decision domain update formula for glowworm i at time t+1 is as follows, and the explicit threshold parameter nt is introduced to attenuate the oscillatory behavior of the decision domain:

rdi(t+1)={rdit+β1|Ni(t)|, if |Ni(t)|ntrdit-β2|Ni(t)|, otherwise     (22)

where β1 and β2 are constant parameters. This algorithm proved its superiority over the ACO in a multi-source environment through simulation and field experiments. Zhang et al. (2011) proposed a multi-robot cooperation strategy based on a modified GSO (M-GSO). The concept of forbidden area was introduced, and they argued that the forbidden area setting has two goals. One is to ensure that the robots inside the forbidden area are released so that they have the opportunity to find another odor source. The other is to ensure that robots outside the forbidden area do not repeatedly locate this odor source. Simulation results in a benchmark environment of multiple odor source localization show that M-GSO can find all indoor odor sources with fewer iterations than the traditional GSO algorithm.

Gray wolf optimization

Gray wolf optimization is a population intelligence optimization algorithm inspired by gray wolf populations (Mirjalili et al., 2014). The method mimics the strict four social classes and hunting behaviors within the gray wolf population. Different social classes of gray wolves will be responsible for decision-making, training, hunting, scouting and patrolling, and other divisions of the wolf pack.

To improve the speed of early plume search and the reliability of plume tracking, Shen et al. (2021) made the autonomous mobile robot simulate the social mechanism and hunting behavior of gray wolf populations to plan the robot path and find the optimal value in plume tracking. Using the four different classes of gray wolf groups, a hierarchical structure suitable for robot search is constructed. The four levels decrease from top to bottom as alpha, beta, delta, and omega, respectively (Figure 5). The field experimental results show that this method can successfully locate the leakage odor source in some three-dimensional diffusion environments, but only a single robot is employed. Mamduh et al. (2018) tried to propose a cooperative multi-robot strategy based on GWO that uses the prey search phase of gray wolves to track plumes. Before approaching the odor source, the robots will surround the odor source, thus avoiding the searched odor source being different from the actual location, as in other algorithms. Robots are divided based on social hierarchy in the process. Robots with the three best solutions are defined as alpha(α), beta(β), and delta(δ) based on the sampled concentration data. The other robots are assumed to be omega (ω). The ω robots generally are guided by the α, β, and δ robots. After the wolves have surrounded the searched scent source, the wolves will hunt and update the location as Equations 23–25:

Dμ=|C1·Xμ-X|Dβ=|C2·Xβ-X|Dδ=|C3·Xδ-X|    (23)
X1=Xα-A1·DαX2=Xβ-A2·DβX3=Xδ-A3·Dδ    (24)
X(t+1)=X1+X2+X33    (25)

where Dα denotes the encirclement vector of the robot α, Xα denotes the target position vector of the robot α, X denotes the movement vector of the robot, and A* and C are the computed coefficient vectors.

FIGURE 5
www.frontiersin.org

Figure 5. Schematic diagram of the hierarchy of GWO.

Moreover, in the literature already reviewed in the previous section, Jain et al. (2018) proposed a multi-robot system with two algorithms in tandem. It achieved good results by concatenating the gray wolf optimizer with the particle swarm optimizer.

Whale optimization

Whale optimization (WOA) finds the optimal solution by imitating the search process of whales catching food in the ocean (Mirjalili and Lewis, 2016). The algorithm has the characteristics of a simple structure and few parameters. It is faster and more accurate than standard PSO and genetic algorithm in solving multivariate functions and can jump out of local optimization (Mirjalili and Lewis, 2016).

To rapidly locate indoor time-varying pollution sources, Yang et al. (2019) pioneered standard WOA (SWOA) for multi-intelligence active olfaction and proposed an improved WOA method by introducing an upwind term. In the plume tracking phase, the WOA algorithm simulates the hunting behavior of the humpback whale by three operators, namely, the encircling prey operator, bubble-net attacking operator, and searching for prey operator. The operation of the encircling prey operator is similar to the GWO algorithm. For the robot position at the moment t+1 will be updated as Equation 26:

X(t+1)=Pg(t)-A·DD=|C·Pg(t)-X(t)|    (26)

where A and C are the computed coefficient vectors. The bubble-net attacking operator imitates the prey attacking behavior of humpback whales, which consists of Shrinking encircling and Spiral updating processes. The Shrinking encircling process is similar to the previous stage, and each iteration of Spiral updating has a certain probability of indicating the simulated real situation with Equation 27:

X(t+1)={Pg(t)-A·Dp<0.5D ·ebl·cos(2πl)+Pg(t)p0.5    (27)

where D′ is the distance between a robot and the current global maxima location, b is a constant for defining the shape of the logarithmic spiral, p and l are random numbers in the range of [0, 1] and [−1, 1], respectively. For IWOA, the upwind term Vu(t) is added to the position update. The update process being improved as Equation 28:

X(t+1)=D·ebl·cos(2πl)+X*(t)+Vu(t)    (28)

Searching for prey operator is the global search phase of the robot, and the t-moment algorithm randomly selects the robot position Xrand(t) as a reference for updating the position to maintain diversity. Compared with the standard PSO and IPSO, simulation results show that the success rate of the SWOA method for locating time-varying pollution sources is within the acceptable level only. However, the cost is lower, and the IWOA success rate is higher than the improved PSO (IPSO), but the localization efficiency is worse than IPSO.

Jiang et al. (2022) experimentally validated and compared the SWOA and IWOA algorithms with standard PSO and IPSO in a natural field. The experiments considered two typical time-varying sources (periodic and decaying sources) and two source locations (downwind zone and recirculation zone). The results show that IWOA has a significantly higher success rate and positioning accuracy in locating odor sources than IPSO. Zhou et al. (2022) made further experimental verification and compared the above algorithms. The results show that the IWOA method requires fewer average steps to locate the periodic source, has a higher success rate, and is more challenging to locate the decay source.

Artificial ecosystem-based optimization

Artificial ecosystem-based optimization (AEO; Zhao et al., 2020) was inspired by the phenomenon of energy flowing along the food chain between producers, consumers, and decomposers in the ecosystem. This mechanism of maintaining a stable energy transfer for optimization algorithms has excellent potential, and experiments have shown that AEO outperforms its advanced counterparts in terms of optimization performance (Zhao et al., 2020). Especially for real-world engineering problems, AEO is more competitive than other reported methods in terms of convergence speed and calculation cost. In our previous work (Fu et al., 2021), we proposed an improved AEO algorithm through incorporating a discrete wind direction system to solve the uncertainty of concentration thresholds in different odor source environments during odor source localization. Producers, consumers, and decomposers share concentration and wind direction information throughout the process. The algorithm combines individual stochasticity and consumption factors to perform plume tracking strategies in low concentration regions, enhancing the algorithm's robustness.

In this algorithm, the producer is mainly employed for global search, and the ith robot position update equation in a population of n robots is as follows:

Xi(t+1)=(1-a)Xn(t)+aXrand(t)    (29)

where Xrand is a random position in the search space and a is a linear weighting coefficient. There are three consumption strategies for consumers to become herbivores, carnivores, or omnivores, and the consumer. Robot will randomly choose to become one of them. Position change occurs after consumers “eat” different types of robots. The consumption process adds a consumption factor to avoid local optima. Subsequently, the decomposer will decompose the organisms to obtain concentration information, location information, and wind direction information to update the location of robot i as:

Xi(t+1)=Xn(t)+D[eXn(t)-hXi(t)]                  +Rd×Wor×r4×-wi|wix|+|wiy|    (30)

where D is the decomposition factor, e and h are the weight coefficients, and r4 random coefficients in the range of [0, 1]. Rd is the decomposer wind direction factor, wi is the wind speed vector at the current robot, wix and wiy are the x-axis wind speed component vectors and y-axis wind speed component vectors at the current robot. Wor is the adaptive step size factor.

Finally, wind chasers are added and divided into two levels to perform different operations according to anemotaxis, with the following equation:

{Xi(t+1)=Xi(t)+Rw×Wor ×r5×-wi|wix|+|wiy|,   i=[1,,Pw]Pw=Cwn    (31)
Xi(t+1)=Xi(t)+Rw×Wor ×r5×-wi|wix|+|wiy|,  r6>Le    (32)

where Rw is the wind direction factor of the wind chaser, r5 and r6 are uniformly distributed random numbers in the range of [0, 1], Pw is the number of robots that become chasers, Cw is the proportion chasers among all robots, and Le is the stratification factor. The simulation results show that the time spent and success rate of odor source locating has a greater advantage than CPSO and WU-PSO when the number of robots is small.

Trends and challenges

Other SI algorithms to be explored

In addition to the swarm intelligence and extension algorithms mentioned above, many widely discussed swarm intelligence algorithms have not been applied to odor source localization. The artificial fish swarm algorithm (AFS) is mainly based on fish foraging behavior in the natural environment. It adopts the bottom-up design idea, mainly using the three operators of artificial fish's foraging, clustering, and tailing finding, to construct the bottom behavior of individuals, which has the advantages of reliable global search ability and fast convergence (Tang et al., 2021). The bat algorithm is a random search algorithm that simulates the prey detection and obstacle avoidance behavior of bats in nature using echolocation. It can achieve single and multiple target search and localization in continuous space (Yang and Hossein Gandomi, 2012). The artificial bee colony optimization (ABC) algorithm simulates bees' foraging behavior. In addition to the primary selection mechanism of bees and simple interactions between bees, the ABC algorithm introduces local and global search mechanisms, making the algorithm capable of solving search problems in multi-objective fields (Karaboga and Basturk, 2007). Those algorithms have their own advantage to deal with different kinds of problems in various scenarios and are worthy to be considered for exploring in OSL applications according to No Free Lunch Theorem.

From 2D to 3D

The study of OSL methods in three-dimensional space is more in line with the propagation characteristics of odors in the natural environment compared to that in two-dimensional plane. Therefore, it is more conducive to solving the needs of practical application. As far as equations are concerned, most swarm intelligence algorithms mentioned above can easily switch from 2D plane to 3D space. The difficulties may lie mainly in three aspects. (1) How to achieve the 3D spatial dynamic simulation of the sniffing robots. Robots in three-dimensional space can no longer be considered as mass points, and the large-scale flight operations of rotorcraft swarms will change the odor distribution on a macroscopic scale. How to simulate the change of odor distribution also needs to be taken into account. (2) How to solve the effect of UAV rotor blades on odor diffusion. The plume above the UAVs will be sucked by the rotor blades and emitted from below when UAVs passed through the smoke plume. In this case, the concentration, wind direction, and wind speed of the plume cannot be accurately measured. How to install the sensor at the right position to measure the accurate value will be the key consideration of scholars. (3) How to avoid mutual collision of UAVs in 3D turbulent space. Swarms of drones flying in dynamic turbulence will be susceptible to position shifts and collisions, so more conservative strategies to avoid mutual collisions need to be considered. To solve these problems, some researchers have turned to study airflow in 3D environments to extend the chemical sensing capabilities of mobile robots to 3D environments (Ishida et al., 1999; Feng et al., 2018). The rapid development of UAV technology has provided an excellent platform, which has led to the 3D spatial OSL problem based on the UAV platform receiving the attention of most researchers (Jing et al., 2021). Preliminary research results have been achieved (Neumann et al., 2013; Pobkrut et al., 2016; Villa et al., 2016; Luo et al., 2018; Gunawardena et al., 2021; Liu et al., 2022). However, compared with OSL in two dimensions, these results are still far from adequate and need further exploration.

Fusion of multimodal sensing information

Biological evidence proves that other sensing modalities also play an essential role in odor source localization of organisms. Sensing inputs of odor concentration information and wind information are now widely used for odor source localization. Nevertheless, odor sensors have certain information blindness. The sensor accuracy sometimes cannot meet the operational requirements, and the slow response and prolonged recovery time of sensors limit the localization efficiency. On the other hand, wind direction information cannot independently apply to odor source localization. When the chemical concentration sensor is not working, the fusion of information from multiple sensing modules ensures the iterative process. This will enhance the search performance and accuracy of the system. There have been few results in visual research (Jing et al., 2021), and Ishida et al. (2006) proposed a new method for locating odor sources using a combination of visual, odor, and wind direction information. The method assembles a mobile robot with CMOS cameras, odor sensors, and airflow sensors. It employs a behavior-based navigation strategy to successfully locate a bottle containing the source of a leaking odor in an indoor experiment. Shen et al. (2021) designed a multi-sensor information fusion decision strategy and incorporated the vision and olfactory sensor fusion for tracking plumes and declaring the odor source in a partial 3D diffusion environment. In addition to visual sensors, we hope that sensors related to temperature gradient, wind speed and hearing as well as other complex sensors [IMU, Insect-behavior-based Olfactory Sensor (Horibe et al., 2021), Lidar] can be further investigated in the future for applications in certain special situations, such as fire scenes, narrow caves, etc. Corresponding to multimodal sensing information fusion is a multi-source, asynchronous decision framework. How to develop an optimal strategy based on this requires in-depth study.

Conclusion

Swarm intelligence algorithms solve complex optimization problems through the communication and collaboration of multiple simple individuals, emerging as a distributed, self-organizing group intelligence. Multi-robot odor source localization is for searching the optimal odor concentration in the target space by multiple robots. It is coherent in purpose with the swarm intelligence optimization algorithm. Therefore, employing swarm intelligence optimization algorithms to solve OSL problems has become mainstream in the last two decades. This review briefly reviews the history and basic concepts of OSL research and summarizes the core issues and trends in OSL field. Multi-robotics for localizing multiple odor sources in natural environments using chemotaxis-anemotaxis of multi-sensing information is the leading research direction. To achieve this goal, scholars have introduced standard PSO and its various variant versions into the research field, including applicability improvements to standard PSO and hybrid algorithms that combine other optimization algorithms. Further, various nature-inspired SI algorithms have also been introduced into OSL, such as CSA, ACO, GWO, GSO, WOA, and AEO. SI-based multi-robots for odor source localization is on the rise. Finally, we believe that based on the principle of no free lunch theorem, other swarm intelligence algorithms, through adaptive modifications, also have the potential to be introduced into this research area to solve specific problems.

Author contributions

JW and JF: conceptualization and writing—review and editing. JW, YL, RL, and JF: methodology and investigation. JW, YL, and RL: writing—original draft preparation. JW: visualization. JF: supervision and project administration. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the National Natural Science Foundation of China, Grant No. 61305030 and Xinmiao Talents Program of Zhejiang Province, Grant No. 2021R408028.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Balkovsky, E., and Shraiman, B. (2002). Olfactory search at high Reynolds number. Proc. Natl. Acad. Sci. U. S. A. 99, 12589–12593. doi: 10.1073/pnas.192393499

PubMed Abstract | CrossRef Full Text | Google Scholar

Cao, M.-L., Meng, Q.-H., Wang, X.-W., Luo, B., Zeng, M., and Li, W. (2013). “Localization of multiple odor sources via selective olfaction and adapted ant colony optimization algorithm,” in Proceedings of the 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO) (Shenzhen: IEEE), 1222–1227. doi: 10.1109/ROBIO.2013.6739631

CrossRef Full Text | Google Scholar

Charlton, R. E., and Cardé, R. T. (1990). Orientation of male gypsy moths, Lymantria Dispar (L.), to pheromone sources: the role of olfactory and visual cues. J. Insect Behav. 3, 443–469. doi: 10.1007/BF01052011

CrossRef Full Text | Google Scholar

Che, H., Shi, C., Xu, X., Li, J., and Wu, B. (2018). “Research on improved ACO algorithm-based multi-robot odor source localization,” in Proceedings of the 2018 2nd International Conference on Robotics and Automation Sciences (ICRAS) (Wuhan: IEEE), 1–5. doi: 10.1109/ICRAS.2018.8443237

CrossRef Full Text | Google Scholar

Chen, X., and Huang, J. (2019). Odor source localization algorithms on mobile robots: a review and future outlook. Robot. Auton. Syst. 112, 123–136. doi: 10.1016/j.robot.2018.11.014

CrossRef Full Text | Google Scholar

Chen, Y., Cai, H., Chen, Z., and Feng, Q. (2017). Using multi-robot active olfaction method to locate time-varying contaminant source in indoor environment. Build. Environ. 118, 101–112. doi: 10.1016/j.buildenv.2017.03.030

PubMed Abstract | CrossRef Full Text | Google Scholar

Dorigo, M., Maniezzo, V., and Colorni, A. (1996). Ant system: optimization by a colony of cooperating agents. IEEE Trans. Syst. Man Cybern. B Cybern. 26, 29–41. doi: 10.1109/3477.484436

PubMed Abstract | CrossRef Full Text | Google Scholar

Fan, H., Arain, M. A., Bennett, V. H., Schaffernicht, E., and Lilienthal, A. J. (2017). “Improving gas dispersal simulation for mobile robot olfaction: using robot-created occupancy maps and remote gas sensors in the simulation loop,” in Proceedings of the 2017 ISOCS/IEEE International Symposium on Olfaction and Electronic Nose (ISOEN) (Montreal: IEEE), 1–3. doi: 10.1109/ISOEN.2017.7968874

CrossRef Full Text | Google Scholar

Farrell, J. A., Murlis, J., Long, X., Li, W., and Carde, R. T. (2002). Filament-based atmospheric dispersion model to achieve short time-scale structure of odor plumes. Environ. FLUID Mech. 2, 143–169. doi: 10.1023/A:1016283702837

CrossRef Full Text | Google Scholar

Feng, Q., Cai, H., Chen, Z., Yang, Y., Lu, J., Li, F., et al. (2019a). Experimental study on a comprehensive particle swarm optimization method for locating contaminant sources in dynamic indoor environments with mechanical ventilation. ENERGY Build. 196, 145–156. doi: 10.1016/j.enbuild.2019.03.032

PubMed Abstract | CrossRef Full Text | Google Scholar

Feng, Q., Cai, H., Li, F., Liu, X., Liu, S., and Xu, J. (2019b). An improved particle swarm optimization method for locating time-varying indoor particle sources. Build. Environ. 147, 146–157. doi: 10.1016/j.buildenv.2018.10.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Feng, Q., Cai, H., Li, F., Yang, Y., and Chen, Z. (2018). Locating time-varying contaminant sources in 3D indoor environments with three typical ventilation systems using a multi-robot active olfaction method. Build. Simul. 11, 597–611. doi: 10.1007/s12273-017-0424-6

CrossRef Full Text | Google Scholar

Feng, Q., Cai, H., Yang, Y., Xu, J., Jiang, M., Li, F., et al. (2020). An experimental and numerical study on a multi-robot source localization method independent of airflow information in dynamic indoor environments. Sustain. Cities Soc. 53, 101897. doi: 10.1016/j.scs.2019.101897

CrossRef Full Text | Google Scholar

Feng, Q., Zhang, C., Lu, J., Cai, H., Chen, Z., Yang, Y., et al. (2019c). Source localization in dynamic indoor environments with natural ventilation: an experimental study of a particle swarm optimization-based multi-robot olfaction method. Build. Environ. 161, 106228. doi: 10.1016/j.buildenv.2019.106228

CrossRef Full Text | Google Scholar

Ferri, G., Caselli, E., Mattoli, V., Mondini, A., Mazzolai, B., and Dario, P. (2007). “Explorative particle swarm optimization method for gas/odor source localization in an indoor environment with no strong airflow,” in Proceedings of the 2007 Ieee International Conference on Robotics and Biomimetics, Vols 1-5 (New York, NY: IEEE), 841–846. doi: 10.1109/ROBIO.2007.4522272

CrossRef Full Text | Google Scholar

Francis, A., Li, S., Griffiths, C., and Sienz, J. (2022). Gas source localization and mapping with mobile robots: a review. J. Field Robot. 2022, 22109. doi: 10.1002/rob.22109

CrossRef Full Text | Google Scholar

Fu, J., Shen, L., and Liu, R. (2021). An indoor odor source locating method for multi-robot active olfaction based on improved AEO. Chin. J. Sens. Actuators 34, 1406–1411. doi: 10.3969/j.issn.1004-1699.2021.10.020

CrossRef Full Text | Google Scholar

Fu, Z., Chen, Y., Ding, Y., and He, D. (2019). Pollution source localization based on multi-UAV cooperative communication. IEEE Access 7, 29304–29312. doi: 10.1109/ACCESS.2019.2900475

CrossRef Full Text | Google Scholar

Gaurav, K., Kumar, A., and Singh, R. (2020). Single and multiple odor source localization using hybrid nature-inspired algorithm. Sādhanā 45, 83. doi: 10.1007/s12046-020-1318-3

CrossRef Full Text | Google Scholar

Genovese, V., Dario, P., Magni, R., and Odetti, L. (1992). “Self organizing behavior and swarm intelligence in a pack of mobile miniature robots in search of pollutants,” in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (Raleigh: IEEE), 1575–1582. doi: 10.1109/IROS.1992.594225

CrossRef Full Text | Google Scholar

Ghalia, M. B. (2008). “Particle swarm optimization with an improved exploration-exploitation balance,” in 2008 51st Midwest Symposium on Circuits and Systems (Knoxville, TN: IEEE), 759–762. doi: 10.1109/MWSCAS.2008.4616910

CrossRef Full Text | Google Scholar

Gong, D.-W., Zhang, Y., and Qi, C.-L. (2012). Localising odour source using multi-robot and anemotaxis-based particle swarm optimisation. IET Control Theory Appl. 6, 1661–1670. doi: 10.1049/iet-cta.2011.0513

CrossRef Full Text | Google Scholar

Gunawardena, N., Leang, K. K., and Pardyjak, E. (2021). Particle swarm optimization for source localization in realistic complex urban environments. Atmos. Environ. 262, 118636. doi: 10.1016/j.atmosenv.2021.118636

CrossRef Full Text | Google Scholar

Hayes, A. T., Martinoli, A., and Goodman, R. M. (2002). Distributed odor source localization. IEEE Sens. J. 2, 260–271. doi: 10.1109/JSEN.2002.800682

CrossRef Full Text | Google Scholar

Hölldobler, B., Hölldobler, R., Wilson, E. O., and Wilson, H. C. (1990). The Ants. Cambridge, MA: Harvard University Press. doi: 10.1007/978-3-662-10306-7

CrossRef Full Text | Google Scholar

Horibe, J., Ando, N., and Kanzaki, R. (2021). Odor-searching Robot with Insect-behavior-based Olfactory Sensor. Sens. Mater. 33, 4185. doi: 10.18494/SAM.2021.3369

CrossRef Full Text | Google Scholar

Ishida, H., Kobayashi, A., Nakamoto, T., and Moriizumi, T. (1999). Three-dimensional odor compass. IEEE Trans. Robot. Autom. 15, 251–257. doi: 10.1109/70.760346

CrossRef Full Text | Google Scholar

Ishida, H., Nakayama, G., Nakamoto, T., and Moriizumi, T. (2005). Controlling a gas/odor plume-tracking robot based on transient responses of gas sensors. IEEE Sens. J. 5, 537–545. doi: 10.1109/JSEN.2004.839597

CrossRef Full Text | Google Scholar

Ishida, H., Suetsugu, K., Nakamoto, T., and Moriizumi, T. (1994). Study of autonomous mobile sensing system for localization of odor source using gas sensors and anemometric sensors. Sens. Actuators Phys. 45, 153–157. doi: 10.1016/0924-4247(94)00829-9

CrossRef Full Text | Google Scholar

Ishida, H., Tanaka, H., Taniguchi, H., and Moriizumi, T. (2006). Mobile robot navigation using vision and olfaction to search for a gas/odor source. Auton. Robots 20, 231–238. doi: 10.1007/s10514-006-7100-5

CrossRef Full Text | Google Scholar

Ishida, H., Wada, Y., and Matsukura, H. (2012). Chemical sensing in robotic applications: a review. IEEE Sens. J. 12, 3163–3173. doi: 10.1109/JSEN.2012.2208740

CrossRef Full Text | Google Scholar

Jain, U., Tiwari, R., and Godfrey, W. W. (2018). “Odor source localization by concatenating particle swarm optimization and grey wolf optimizer,” in Proceedings of the Advanced Computational and Communication Paradigms (Singapore: Springer), 145–153. doi: 10.1007/978-981-10-8237-5_14

CrossRef Full Text | Google Scholar

Jain, U., Tiwari, R., and Godfrey, W. W. (2019). Multiple odor source localization using diverse-PSO and group-based strategies in an unknown environment. J. Comput. Sci. 34, 33–47. doi: 10.1016/j.jocs.2019.04.008

CrossRef Full Text | Google Scholar

Jatmiko, W., Jovan, F., Dhiemas, R. Y. S., Alvissalim, M. S., Febrian, A., Widiyanto, D., et al. (2016). PSO algorithm for single and multiple odor sources localization problems: progress and challenge. Int. J. Smart Sens. Intell. Syst. 9, 1431–1478. doi: 10.21307/ijssis-2017-925

CrossRef Full Text | Google Scholar

Jatmiko, W., Nugraha, A., Efendi, R., Pambuko, W., Mardian, R., Sekiyama, K., et al. (2009a). Localizing multiple odor sources in a dynamic environment based on modified niche particle swarm optimization with flow of wind. WSEAS Trans. Syst. 8, 1187–1196. Available online at: http://www.wseas.us/e-library/transactions/systems/2009/32-562.pdf

Google Scholar

Jatmiko, W., Pambuko, W., Mursanto, P., Muis, A., Kusumoputro, B., Sekiyama, K., et al. (2009b). “Localizing multiple odor sources in dynamic environment using ranged subgroup PSO with flow of wind based on open dynamic engine library,” in Proceedings of the 2009 International Symposium on Micro-NanoMechatronics and Human Science (Nagoya: IEEE), 602–607. doi: 10.1109/MHS.2009.5351761

CrossRef Full Text | Google Scholar

Jatmiko, W., Sekiyama, K., and Fukuda, T. (2006a). “A mobile robots PSO-based for odor source localization in extreme dynamic advection-diffusion environment with obstacle,” in Proceedings of the 2006 IEEE SENSORS (Daegu: IEEE), 526–529. doi: 10.1109/IROS.2006.282092

CrossRef Full Text | Google Scholar

Jatmiko, W., Sekiyama, K., and Fukuda, T. (2006b). “A particle swarm-based mobile sensor network for odor source localization in a dynamic environment,” in Proceedings of the Distributed Autonomous Robotic Systems 7 (Tokyo: Springer Japan), 71–80. doi: 10.1007/4-431-35881-1_8

CrossRef Full Text | Google Scholar

Jatmiko, W., Sekiyama, K., and Fukuda, T. (2007). A PSO-based mobile robot for odor source localization in dynamic advection-diffusion with obstacles environment: theory, simulation and measurement. IEEE Comput. Intell. Mag. 2, 37–51. doi: 10.1109/MCI.2007.353419

CrossRef Full Text | Google Scholar

Jiang, M., Liao, Y., Guo, X., Cai, H., Jiang, W., Yang, Z., et al. (2022). A comparative experimental study of two multi-robot olfaction methods: towards locating time-varying indoor pollutant sources. Build. Environ. 207, 108560. doi: 10.1016/j.buildenv.2021.108560

CrossRef Full Text | Google Scholar

Jing, T., Meng, Q., and Ishida, H. (2021). Recent progress and trend of robot odor source localization. IEEJ Trans. Electr. Electron. Eng. 16, 938–953. doi: 10.1002/tee.23364

CrossRef Full Text | Google Scholar

Karaboga, D., and Basturk, B. (2007). A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J. Glob. Optim. 39, 459–471. doi: 10.1007/s10898-007-9149-x

CrossRef Full Text | Google Scholar

Kennedy, J., and Eberhart, R. (1995). “Particle swarm optimization,” in Proceedings of the ICNN'95 - International Conference on Neural Networks, vol.4 (Perth: IEEE), 1942–1948.

Google Scholar

Kirkpatrick, S., Gelatt, C. D., and Vecchi, M. P. (1983). Optimization by simulated annealing. Science 220, 671–680. doi: 10.1126/science.220.4598.671

PubMed Abstract | CrossRef Full Text | Google Scholar

Kowadlo, G., and Russell, R. A. (2008). Robot odor localization: a taxonomy and survey. Int. J. Robot. Res. 27, 869–894. doi: 10.1177/0278364908095118

CrossRef Full Text | Google Scholar

Krishnanand, K. N., Amruth, P., Guruprasad, M. H., Bidargaddi, S. V., and Ghose, D. (2006). “Glowworm-inspired robot swarm for simultaneous taxis towards multiple radiation sources,” in Proceedings of the 2006 Ieee International Conference on Robotics and Automation (icra), Vols 1-10 (New York, NY: IEEE), 958–963. doi: 10.1109/ROBOT.2006.1641833

CrossRef Full Text | Google Scholar

Krishnanand, K. N., and Ghose, D. (2005). “Detection of multiple source locations using a glowworm metaphor with applications to collective robotics,” in Proceedings of the 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005. (Pasadena: IEEE), 84–91. doi: 10.1109/SIS.2005.1501606

CrossRef Full Text | Google Scholar

Krishnanand, K. N., and Ghose, D. (2009). Glowworm swarm optimization for simultaneous capture of multiple local optima of multimodal functions. Swarm Intell. 3, 87–124. doi: 10.1007/s11721-008-0021-5

CrossRef Full Text | Google Scholar

Kwa, H. L., Leong Kit, J., and Bouffanais, R. (2022). Balancing collective exploration and exploitation in multi-agent and multi-robot systems: a review. Front. Robot. AI 8, 771520. doi: 10.3389/frobt.2021.771520

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, F., Meng, Q.-H., Bai, S., Li, J.-G., and Popescu, D. (2008). “Probability-PSO algorithm for multi-robot based odor source localization in ventilated indoor environments,” in Proceedings of the Intelligent Robotics and Applications (Berlin; Heidelberg: Springer), 1206–1215. doi: 10.1007/978-3-540-88513-9_128

CrossRef Full Text | Google Scholar

Li, F., Meng, Q.-H., Li, J.-G., and Zeng, M. (2010). P-PSO algorithm based multi-robot odor source search in ventilated indoor environment with obstacles: P-PSO algorithm based multi-robot odor source search in ventilated indoor environment with obstacles. Acta Autom. Sin. 35, 1573–1579. doi: 10.3724/SP.J.1004.2009.01573

CrossRef Full Text | Google Scholar

Li, J.-G., Yang, J., Zhou, J.-Y., Liu, J., and Lu, G.-D. (2015). Mapping odour sources with a mobile robot in a time variant airflow environment. Austrian Contrib. Vet. Epidemiol. 8, 7. doi: 10.5281/zenodo.33825

CrossRef Full Text | Google Scholar

Li, W., Farrell, J., Pang, S., and Arrieta, R. (2006). Moth-inspired chemical plume tracing on an autonomous underwater vehicle. IEEE Trans. Robot. 22, 292–307. doi: 10.1109/TRO.2006.870627

CrossRef Full Text | Google Scholar

Lilienthal, A. J., Loutfi, A., and Duckett, T. (2006). Airborne chemical sensing with mobile robots. SENSORS 6, 1616–1678. doi: 10.3390/s6111616

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, Y., Zhao, X., Xu, J., Zhu, S., and Su, D. (2022). Rapid location technology of odor sources by multi-UAV. J. Field Robot. 39, 600–616. doi: 10.1002/rob.22066

CrossRef Full Text | Google Scholar

Lu, Q., and Han, Q.-L. (2010). “A distributed coordination control scheme for odor source localization,” in Proceedings of the IECON 2010 - 36th Annual Conference on IEEE Industrial Electronics Society (Glendale: IEEE), 1413–1418. doi: 10.1109/IECON.2010.5675475

CrossRef Full Text | Google Scholar

Lu, Q., Han, Q.-L., and Liu, S. (2014a). A finite-time particle swarm optimization algorithm for odor source localization. Inf. Sci. 277, 111–140. doi: 10.1016/j.ins.2014.02.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Lu, Q., Han, Q.-L., and Liu, S. (2016). A cooperative control framework for a collective decision on movement behaviors of particles. IEEE Trans. Evol. Comput. 20, 859–873. doi: 10.1109/TEVC.2016.2526656

CrossRef Full Text | Google Scholar

Lu, Q., Han, Q.-L., Xie, X., and Liu, S. (2014b). A finite-time motion control strategy for odor source localization. IEEE Trans. Ind. Electron. 61, 5419–5430. doi: 10.1109/TIE.2014.2301751

CrossRef Full Text | Google Scholar

Lu, Q., Liu, S., Xie, X., and Wang, J. (2013). Decision making and finite-time motion control for a group of robots. IEEE Trans. Cybern. 43, 738–750. doi: 10.1109/TSMCB.2012.2215318

PubMed Abstract | CrossRef Full Text | Google Scholar

Luo, B., Meng, Q.-H., Wang, J.-Y., and Zeng, M. (2018). A flying odor compass to autonomously locate the gas source. IEEE Trans. Instrum. Meas. 67, 137–149. doi: 10.1109/TIM.2017.2759378

CrossRef Full Text | Google Scholar

Luo, D., Zou, Y., and Zhuang, J. (2008). Multi-robot odor source localization strategy based on a modified ant colony algorithm. Robot 30, 536–541. Available online at: https://robot.sia.cn/EN/Y2008/V30/I6/536

Google Scholar

Mamduh, S. M., Kamarudin, K., Shakaff, A. Y. M., Zakaria, A., Visvanathan, R., Yeon, A. S. A., et al. (2018). Gas source localization using grey wolf optimizer. J. Telecommun. Electron. Comput. Eng. 10, 95–98. Available online at: https://jtec.utem.edu.my/jtec/article/view/4130/2956

Google Scholar

Marques, L., Nunes, U., and de Almeida, A. T. (2006). Particle swarm-based olfactory guided search. Auton. Robots 20, 277–287. doi: 10.1007/s10514-006-7567-0

CrossRef Full Text | Google Scholar

Meng, Q.-H., Li, J.-C., Li, F., and Zeng, M. (2006). “Mobile robots odor localization with an improved ant colony algorithm,” in Proceedings of the 2006 IEEE International Conference on Robotics and Biomimetics (Kunming: IEEE), 959–964. doi: 10.1109/ROBIO.2006.340358

CrossRef Full Text | Google Scholar

Meng, Q.-H., Yang, W.-X., Wang, Y., and Zeng, M. (2010). “Multi-robot odor-plume tracing in indoor natural airflow environments using an improved ACO algorithm,” in Proceedings of the 2010 IEEE International Conference on Robotics and Biomimetics (Tianjin: IEEE), 110–115. doi: 10.1109/ROBIO.2010.5723312

CrossRef Full Text | Google Scholar

Meng, Q.-H., Yang, W.-X., Wang, Y., and Zeng, M. (2011). Collective odor source estimation and search in time-variant airflow environments using mobile robots. Sensors 11, 10415–10443. doi: 10.3390/s111110415

PubMed Abstract | CrossRef Full Text | Google Scholar

Mirjalili, S., and Lewis, A. (2016). The whale optimization algorithm. Adv. Eng. Softw. 95, 51–67. doi: 10.1016/j.advengsoft.2016.01.008

CrossRef Full Text | Google Scholar

Mirjalili, S., Mirjalili, S. M., and Lewis, A. (2014). Grey wolf optimizer. Adv. Eng. Softw. 69, 46–61. doi: 10.1016/j.advengsoft.2013.12.007

CrossRef Full Text | Google Scholar

Murlis, J., Elkinton, J. S., and Cardé, R. T. (1992). Odor plumes and how insects use them. Annu. Rev. Entomol. 37, 505–532. doi: 10.1146/annurev.en.37.010192.002445

CrossRef Full Text | Google Scholar

Neumann, P. P., Bennetts, V. H., Lilienthal, A. J., Bartholmai, M., and Schiller, J. H. (2013). Gas source localization with a micro-drone using bio-inspired and particle filter-based algorithms. Adv. Robot. 27, 725–738. doi: 10.1080/01691864.2013.779052

CrossRef Full Text | Google Scholar

Pobkrut, T., Eamsa-ard, T., and Kerdcharoen, T. (2016). “Sensor drone for aerial odor mapping for agriculture and security services,” in Proceedings of the 2016 13th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON) (Chiang Mai: IEEE), 1–5. doi: 10.1109/ECTICon.2016.7561340

CrossRef Full Text | Google Scholar

Russell, R. A., Bab-Hadiashar, A., Shepherd, R. L., and Wallace, G. G. (2003). A comparison of reactive robot chemotaxis algorithms. Robot. Auton. Syst. 45, 83–97. doi: 10.1016/S0921-8890(03)00120-9

CrossRef Full Text | Google Scholar

Shen, X., Yuan, J., and Shan, Y. (2021). A novel plume tracking method in partial 3D diffusive environments using multi-sensor fusion. Expert Syst. Appl. 178, 114993. doi: 10.1016/j.eswa.2021.114993

CrossRef Full Text | Google Scholar

Sinha, A., Kumar, R., Kaur, R., and Mishra, R. K. (2020). Consensus-based odor source localization by multiagent systems under resource constraints. IEEE Trans. Cybern. 50, 3254–3263. doi: 10.1109/TCYB.2019.2924328

PubMed Abstract | CrossRef Full Text | Google Scholar

Smyth, W., and Moum, J. (2001). 3D turbulence. Encycl. Ocean Sci. Acad. Press 6, 2947–2955. doi: 10.1006/rwos.2001.0134

CrossRef Full Text | Google Scholar

Tang, J., Liu, G., and Pan, Q. (2021). A review on representative swarm intelligence algorithms for solving optimization problems: applications and trends. IEEECAA J. Autom. Sin. 8, 1627–1643. doi: 10.1109/JAS.2021.1004129

CrossRef Full Text | Google Scholar

Van den Bergh, F., and Engelbrecht, A. P. (2002). “A new locally convergent particle swarm optimiser,” in Proceedings of the IEEE International Conference on System Man and Cybernetics (Piscataway, NJ: IEEE), 6. doi: 10.1109/ICSMC.2002.1176018

CrossRef Full Text | Google Scholar

Villa, T. F., Salimi, F., Morton, K., Morawska, L., and Gonzalez, F. (2016). Development and validation of a UAV based system for air pollution measurements. Sensors 16, 2202. doi: 10.3390/s16122202

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, J., Zhang, R., Yan, Y., Dong, X., and Li, J. M. (2017). Locating hazardous gas leaks in the atmosphere via modified genetic, MCMC and particle swarm optimization algorithms. Atmos. Environ. 157, 27–37. doi: 10.1016/j.atmosenv.2017.03.009

CrossRef Full Text | Google Scholar

Wang, L., and Pang, S. (2021). Robotic odor source localization via adaptive bio-inspired navigation using fuzzy inference methods. Robot. Auton. Syst. 2021, 103914. doi: 10.1016/j.robot.2021.103914

CrossRef Full Text | Google Scholar

Wang, W., Cao, M., Ma, S., Ren, C., Zhu, X., and Lu, H. (2016). “Multi-robot odor source search based on Cuckoo search algorithm in ventilated indoor environment,” in Proceedings of the 2016 12th World Congress on Intelligent Control and Automation (WCICA) (Guilin: IEEE), 1496–1501. doi: 10.1109/WCICA.2016.7578817

CrossRef Full Text | Google Scholar

Wu, Y., and Wang, Z. (2021). “An improved Cuckoo search algorithm for multiple odor sources localization,” in Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Vol 2 (Setubal: Scitepress), 708–715. doi: 10.5220/0010231707080715

CrossRef Full Text | Google Scholar

Xie, X.-F., Zhang, W.-J., and Yang, Z.-L. (2002). “Dissipative particle swarm optimization,” in Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600) (Honolulu, HI: IEEE), 1456–1461.

Google Scholar

Yan, Y., Zhang, R., Wang, J., and Li, J. (2018). Modified PSO algorithms with “Request and Reset” for leak source localization using multiple robots. Neurocomputing 292, 82–90. doi: 10.1016/j.neucom.2018.02.078

CrossRef Full Text | Google Scholar

Yang, X., and Hossein Gandomi, A. (2012). Bat algorithm: a novel approach for global engineering optimization. Eng. Comput. 29, 464–483. doi: 10.1108/02644401211235834

CrossRef Full Text | Google Scholar

Yang, X.-S., and Deb, S. (2009). “Cuckoo search via lévy flights,” in Proceedings of the 2009 World Congress on Nature Biologically Inspired Computing (NaBIC) (Coimbatore: IEEE), 210–214. doi: 10.1109/NABIC.2009.5393690

CrossRef Full Text | Google Scholar

Yang, Y., Zhang, B., Feng, Q., Cai, H., Jiang, M., Zhou, K., et al. (2019). Towards locating time-varying indoor particle sources: development of two multi-robot olfaction methods based on whale optimization algorithm. Build. Environ. 166, 106413. doi: 10.1016/j.buildenv.2019.106413

CrossRef Full Text | Google Scholar

Yee, E., Chan, R., Kosteniuk, P. R., Chandler, G. M., Biltoft, C. A., and Bowers, J. F. (1994). Experimental measurements of concentration fluctuations and scales in a dispersing plume in the atmospheric surface layer obtained using a very fast response concentration detector. J. Appl. Meteorol. Climatol. 33, 996–1016. doi: 10.1175/1520-0450(1994)033<0996:EMOCFA>2.0.CO;2

CrossRef Full Text | Google Scholar

Zainal, N., Zain, A. M., Radzi, N. H. M., and Udin, A. (2013). Glowworm swarm optimization (GSO) algorithm for optimization problems: a state-of-the-art review. Appl. Mech. Mater. 421, 507–511. doi: 10.4028/www.scientific.net/AMM.421.507

CrossRef Full Text | Google Scholar

Zhang, J., Gong, D., and Zhang, Y. (2014). A niching PSO-based multi-robot cooperation method for localizing odor sources. Neurocomputing 123, 308–317. doi: 10.1016/j.neucom.2013.07.025

CrossRef Full Text | Google Scholar

Zhang, Y., Gong, D., Hu, Y., and Zhang, J. (2014). A PSO-based multi-robot search method for odor source in indoor environment with noise. Acta Electonica Sin. 42, 70. doi: 10.3969/j.issn.0372-2112.2014.01.011

CrossRef Full Text | Google Scholar

Zhang, Y., Ma, X., and Miao, Y. (2011). “Localization of multiple odor sources using modified glowworm swarm optimization with collective robots,” in Proceedings of the 30th Chinese Control Conference (Yantai: IEEE), 1899–1904. doi: 10.1109/CCDC.2011.5968545

CrossRef Full Text | Google Scholar

Zhang, Y., Ma, X., and Miao, Y. (2015a). Multiple chemical sources localization using virtual physics-based robots with release strategy. Math. Probl. Eng. 2015, 1–16. doi: 10.1155/2015/678451

CrossRef Full Text | Google Scholar

Zhang, Y., Zhang, J., Hao, G., and Zhang, W. (2015b). “Localizing odor source with multi-robot based on hybrid particle swarm optimization,” in Proceedings of the 2015 11th International Conference on Natural Computation (ICNC) (Zhangjiajie: IEEE), 902–906. doi: 10.1109/ICNC.2015.7378110

CrossRef Full Text | Google Scholar

Zhao, W., Wang, L., and Zhang, Z. (2020). Artificial ecosystem-based optimization: a novel nature-inspired meta-heuristic algorithm. Neural Comput. Appl. 32, 9383–9425. doi: 10.1007/s00521-019-04452-x

CrossRef Full Text | Google Scholar

Zhou, S., Zhang, C., Cai, H., Zhang, B., Feng, Q., Feng, L., et al. (2022). Locating a time-varying contaminant source in naturally ventilated indoor environments: an experimental study to find effective multi-robot olfaction methods. Build. Environ. 216, 108954. doi: 10.1016/j.buildenv.2022.108954

CrossRef Full Text | Google Scholar

Zou, Y., and Luo, D. (2008). “A modified ant colony algorithm used for multi-robot odor source localization,” in Proceedings of the Advanced Intelligent Computing Theories and Applications. With Aspects of Artificial Intelligence (Berlin, Heidelberg: Springer), 502–509. doi: 10.1007/978-3-540-85984-0_60

CrossRef Full Text | Google Scholar

Zou, Y., Luo, D., and Chen, W. (2009). “Swarm robotic odor source localization using ant colony algorithm,” in Proceedings of the 2009 IEEE International Conference on Control and Automation (Christchurch: IEEE), 792–796. doi: 10.1109/ICCA.2009.5410516

CrossRef Full Text | Google Scholar

Keywords: odor source localization, swarm intelligence algorithm, multi-robot system, particle swarm optimization, mobile robot, nature-inspired computation

Citation: Wang J, Lin Y, Liu R and Fu J (2022) Odor source localization of multi-robots with swarm intelligence algorithms: A review. Front. Neurorobot. 16:949888. doi: 10.3389/fnbot.2022.949888

Received: 21 May 2022; Accepted: 14 November 2022;
Published: 30 November 2022.

Edited by:

Georgios Ch. Sirakoulis, Democritus University of Thrace, Greece

Reviewed by:

Kai Huang, Sun Yat-sen University, China
Hongmiao Zhang, Soochow University, China

Copyright © 2022 Wang, Lin, Liu and Fu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Jun Fu, anVuZnUmI3gwMDA0MDt6amdzdS5lZHUuY24=

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.