- School of Civil Engineering, Central South University, Changsha, China
Effective hazard recognition and decision-making are crucial factors in ensuring workplace safety in the construction industry. Workers’ cognition closely relates to that hazard-handling behavior. Functional near-infrared spectroscopy (fNIRS) is a neurotechique tool that can evaluate the concentration vibration of oxygenated hemoglobin
1. Introduction
Dynamic-complex working environment makes the construction industry one of the most dangerous fields. According to the International Labor Organization (ILO), over 381,000 workers worldwide die from occupational injuries each year, with construction workers facing 3–4 times higher fatality rates, which escalate to 4–6 times in developing countries (1). According to the Ministry of Housing and Urban–Rural Development (MHURD), more than 794 Chinese construction workers lost their lives in construction accidents in 2022 (2). In the United States, occupations related to construction and extraction recorded 18.3% of all workplace fatalities in 2021, totaling 951 (3). Consequently, there is an urgent global mandate to enhance construction safety management to mitigate fatal accidents.
Construction projects, characterized by their inherent diversity and complexity, are breeding grounds for numerous workplace hazards such as machinery mishaps, falls, and fires (4). The failure to identify site hazards significantly contributes to unsafe behavior among construction workers, which is implicated in over 70% of construction site accidents (5). Furthermore, research indicates that up to 57% of job site hazards remain unrecognized, exacerbating the risk of accidents (6). Consequently, developing and implementing effective hazard recognition strategies emerge as a critical component of risk management and related safety research aimed at identifying and mitigating various site safety risks more proficiently. Moreover, considering that over 49% of workplace accidents are primarily attributed to the unsafe acts of construction workers (7), it underscores the imperative need to foster the research of safety about informed risk decision-making processes.
Hazard recognition and risk decision-making have garnered substantial attention in the academic sphere, catalyzing a shift toward more objective and scientifically rigorous research methodologies. Traditional research methodologies have relied heavily on surveys, encompassing questionnaires, interviews, and site surveys, to delve into the intrinsic mechanisms (8–10). However, these methods are hampered by subjective and memory biases, and the societal backdrop of safety research often discourages workers from disclosing unsafe behaviors during surveys, interrupting daily operations on sites. To circumvent these limitations, experimental methods have been adopted, where participants engage in risk identification or operational tasks within immersive virtual environments of workplaces, offering a more objective tool for evaluating construction workers’ risk identification and decision-making capabilities (11–16). Despite these advancements, the safety research on a comprehensive understanding of the cognitive mechanisms underlying hazard identification and decision-making among construction workers remains inadequate.
Addressing this gap, the emerging field of neuro-engineering management leverages advancements in sensor technologies to integrate neuroscience research methods into construction safety studies. This interdisciplinary approach facilitates the exploration of human cognition and behavior using advanced neuro-techniques such as electroencephalogram (EEG), functional near-infrared spectroscopy (fNIRS), and eye-tracker (17). EEG and eye-tracker could enhance the studies of brain activities and have been applied in research on hazard recognition and decision-making of construction workers systematically reviewed (18, 19). However, non-direct measurements of the eye tracker and low movement tolerance of EEG restrict the application in cognitive process mechanisms research. These limitations underscore the necessity for a more direct and adaptable tool that can seamlessly integrate into the dynamic environment of construction sites.
Here, fNIRS emerges as a pivotal tool, utilizing near-infrared light (~650–1,000 nm) to irradiate the human brain and collect scattered light through an optical detector (Figure 1), thereby directly detecting variations in oxygenated and deoxygenated hemoglobin concentrations in the cortex (20). These variations, supported by cerebral blood flow (CBF), indicate different brain activation states and are central to the cognitive processes involved in hazard recognition and decision-making. The modified Beer–Lambert law facilitates the statistical analysis of these concentration changes ( and ), offering an objective response to the associated CBF dynamics (21). The advent of miniaturized, wearable fNIRS devices has further propelled the field, enabling wireless cognition detection with high movement tolerance, thereby offering enhanced safety, convenience, and minimal disruption to daily work compared to traditional neuroscience methods (22). This development ensures the authenticity of the data collected and enhances the feasibility of implementing fNIRS technology on a larger scale in the construction industry.
Given these promising attributes, fNIRS has rapidly gained traction as a vital scientific tool in cognitive process research, presenting a promising avenue for unraveling the mechanisms of hazard recognition and decision-making in construction safety (23). Since its initial application in 2018, there has been a burgeoning interest in utilizing fNIRS for construction safety research, showcasing its potential as a burgeoning neuro-management technique in this domain (24). Its ability to provide direct, real-time insights into the cognitive processes underlying hazard recognition and decision-making by detecting hemoglobin concentration variation in the brain regions reflecting the cognition status with high movement tolerance and positions it as a revolutionary tool in advancing construction safety research.
However, the current landscape is marred by a lack of systematic reviews, limiting the full realization of fNIRS’s potential in construction safety research. There is an urgent need to scrutinize existing publications to furnish scholars venturing into fNIRS-based construction safety research with organized guidance on research topics, methodologies, and analysis of findings. This endeavor aims to foster collaborative knowledge sharing and research expansion, offering constructive recommendations for future scholarly explorations and management practices in construction safety through a comprehensive examination of pertinent studies in this arena.
2. Research methodology
This study proposes a rigorous three-step methodology to facilitate a comprehensive literature review (Figure 2). Initially, two preeminent academic databases are utilized to procure articles pertinent to this investigation. Subsequently, the identified academic findings undergo a meticulous two-stage screening process. During this phase, papers failing to satisfy the predetermined criteria are excluded from further consideration, thereby delineating the boundaries of this literature review. Finally, a thorough examination of the full texts of the selected articles is undertaken to ascertain the research objectives, experimental methodologies, and data analysis techniques employed.
The Web of Science and Scopus are two of the most reputable scientific databases, encompassing over 15,000 scientific journals globally. An exhaustive search is conducted within these databases, scrutinizing literature titles, abstracts, and keywords to identify relevant academic publications. The focal point of this literature review is the application of functional near-infrared spectroscopy (fNIRS) in enhancing safety within the construction sector, with a particular emphasis on utilizing NIRS to monitor the cognitive states or mental workload of construction workers, thereby fostering a safer work environment. The research scope is bifurcated into two primary dimensions: near-infrared spectroscopy and construction safety. Consequently, the search queries formulated for the databases above are as follows: for Web of Science, “TS = (construction safety) AND (TS = (near-infrared spectroscopy) OR TS = (NIRS)),” and for Scopus, “TITLE-ABS-KEY (construction AND safety) AND (TITLE-ABS-KEY (nirs) OR TITLE-ABS-KEY (near-infrared-spectroscopy)).” In these queries, the pivotal research terms are linked using the “AND” operator, while the critical term “near-infrared spectroscopy” is coupled with its acronym “NIRS” using the “OR” operator.
A further screening process is instituted to ascertain the relevance and alignment of the articles retrieved with the research objectives, guided by pre-established criteria. Firstly, the literature selection is confined to English language publications, given that most seminal works and high-quality information in this domain are predominantly published in English. Secondly, the articles must explicitly employ near-infrared spectroscopy to assess the cognitive dynamics of individuals engaged in construction-related tasks, thereby aligning with the dual focus on near-infrared spectroscopy and construction safety. Lastly, considering the developing integration of near-infrared spectroscopy in construction safety research, this study encompasses peer-reviewed articles, review papers, and conference proceedings to provide a holistic overview of the current research landscape.
Articles failing to meet the stipulated criteria are excluded from further analysis. Upon the completion of the database search, a three-tiered approach is adopted to refine the selection: (1) Preliminary screening through an analysis of titles, abstracts, and keywords to eliminate duplicates and irrelevant literature, adhering to the established screening guidelines. (2) Detailed full-text review to identify articles that fulfill the research criteria for in-depth analysis. (3) Implementation of a snowball search strategy to explore the citations of the articles shortlisted during the second stage, with the aim of incorporating additional literature that, although not identified in the initial database search, aligns with the study’s screening principles for a comprehensive analysis.
A systematic search was carried out using predetermined key terms on Web of Science and Scopus. This resulted in the retrieval of 21 articles from Web of Science and 16 from Scopus. Out of the 37 articles identified, 11 were found to be duplicates and were subsequently excluded. A further 18 articles were removed due to their lack of relevance to the research topic. A supplementary snowball search recommended the addition of three more publications. After the selection process, 11 articles were finalized for this review.
3. Experiment analysis
This section explores key considerations in applying functional Near-Infrared Spectroscopy (fNIRS) to construction safety research, encompassing detection area identification, equipment selection, foundational theory comprehension, task design, and participant selection. It delves into how fNIRS is employed to measure brain activity in different regions, with a focus on the prefrontal cortex involved in hazard recognition and decision-making in construction safety.
3.1. Detection area
Brain regions are associated with various specific functions, and fNIRS can be applied to confirm the brain active state of different regions by estimating data variables such as hemoglobin concentration (25). Therefore, identifying the brain regions for measurement is a crucial component of fNIRS-based studies. The human brain consists of four parts in the fNIRS-based construction safety research, such as: the frontal, parietal, temporal, and occipital lobes (Figure 3).
Within the frontal lobe, the blue area depicted in Figure 3 represents the prefrontal cortex (PFC), which is closely associated with functions such as thinking, planning, management, and motor execution (26). Previous studies focusing on the PFC have attempted to identify subjects’ emotional regulation and mental stress (27, 28). Since the PFC is involved in brain functions necessary for hazard recognition and decision-making by workers, existing fNIRS-based studies have predominantly chosen the PFC as the detection area to explore the cognitive mechanism of hazard recognition and decision-making in construction safety management (29, 30).
3.2. Apparatus
3.2.1. Equipment evolution
In fNIRS-based research, equipment selection is a critical factor that influences experimental operation, test cost, and measurement quality (Figure 4). Early functional near-infrared spectroscopy devices were bulky and primarily used for indoor experiments (31). However, the advent of wearable fNIRS devices has garnered increased attention from scholars, particularly those interested in applying the technique to construction safety management research (32).
To ensure sufficient fNIRS detection, researchers should consider their research objectives when determining the spatial resolution, sampling rate, and number of channels for choosing fNIRS devices. Although higher resolution devices offer more precise localization of brain activity, they tend to be more expensive and require more sophisticated analysis techniques. Similarly, while higher sampling rates provide more detailed temporal information, they may generate larger datasets and demand more processing power. Additionally, including more detection channels can lead to better coverage and localization, but may also increase the system’s cost and complexity. For example, to detect PFC and motor cortex of human brain, the selected fNIRS device-Oxymon (33) has 24 channels (34).
After considering the factors mentioned above, researchers should investigate whether the fNIRS device includes compatible data analysis software or if additional software is required to process and analyze the collected data. If the experiment involves combining fNIRS with other neuroimaging techniques (e.g., EEG, MRI), it is essential to ensure that the selected fNIRS device is compatible with the other equipment and allows for synchronized data collection. For instance, when integrating an eye-tracker, Liao et al. (29) choose NirSmart (35) with 20 channels.
3.2.2. Multimodal insights
Furthermore, with the development of neuroscience, multimodal study has been proposed as a new research agenda. To carry out joint research with different human cognition indicators associated, a multimodal monitoring method has been generated by integrating several neuro techniques, such as eye tracking, EEG, and fNIRS (36). In the fNIRS-based experiment research of construction safety, scholars typically choose eye tracking for multimodal monitoring (29). Besides, even carrying out experiments in simulated construction scenarios, the participant injuries cannot be avoided entirely. Thus, researchers tried to conduct the fNIRS-based study in a mix-reality environment with a virtual technique like VR, in which participants can explore the surrounding information or perform interactive actions realistically and safely (37). Furthermore, the model development of VR scenarios should achieve more realistic with various construction hazards, which would be a challenge for future fNIRS-based research.
3.3. Task design
The design of fNIRS-based experiments in construction safety typically focuses on hazard recognition and decision-making. Participants are tasked with identifying hazards or completing practical operational tasks in realistic environments that reflect the daily work of construction workers.
3.3.1. Hazard recognition
The hazard recognition process is a fundamental aspect of safety activity, which involves signal detection, comprehension, and projection (38). This process requires the involvement of cognitive resources and includes the tasks of detection, evaluation, and forecasting. The brain cognition principle indicates that the increase in cerebral activity leads to the regional blood flow variation for delivering glucose and oxygen for metabolic demands (23). This neural phenomenon is explicitly reflected as the value vibration of indicators: and (39). Typically, the representation of brain activities is considered to be the concentration changes of oxygenated hemoglobin (40–42). For instance, in transportation neuroscience research, it has been reported that measuring in the PFC effectively captures brain cortex activities, serving as a highly sensitive indicator of CBF (43). Through information synthesizing, the prefrontal cortex coordinates the act and thought based on internal goals via the nerve signal transmission within the brain system during hazard recognition (23, 44). In conclusion, by measuring the oxygenated hemoglobin of PCF, the neuroimaging technology fNIRS offers the methodology to quantitatively describe cognitive activities in the hazard recognition process (24).
In studies utilizing fNIRS for risk identification, some researchers focus on specific areas within a single category of risk, such as fatigue (45), risk attitude (46), and experience (47). Other studies have focused on replicating environments with potential hazards to investigate their effects, including settings that mimic workplaces (29), driving scenarios (48), and equipment usage (34). When it comes to construction safety, researchers place greater emphasis on adequately reflecting construction-related risks in their experiments, such as gravitational, electrical, mechanical, chemical, and individual factors.
Early fNIRS-based studies in construction safety primarily emphasized straightforward risk recognition tasks. Participants were presented with 24 images showcasing varied types and levels of risks (24). Throughout these experiments, scholars captured the participants’ BOLD data from the prefrontal cortex using fNIRS. However, the experimental design did not accurately represent the participants’ real-world work situations. Consequently, there were suggestions to deploy fNIRS measurements in more authentic contexts. For instance, controlled experiments were proposed to examine the impact of fatigue on risk identification, specifically within the driving domain (43) and neurorehabilitation (49). Nevertheless, in the realm of construction safety, workers are often extensively engaged in their routine tasks, leaving little to no opportunity for in situ fNIRS experimental manipulations (50).
In response to the constraints observed in earlier fNIRS research methodologies, there’s been a notable shift toward lab-simulated experiments. These experiments allow participants to recognize potential construction-related hazards under the monitoring of fNIRS. The setup often involves a predefined route within a lab-created simulation of a construction environment. Participants, wearing fNIRS devices, follow this route and use tools, such as laser pointers, to identify and report perceived risks. Sun and Liao (30) set a precedent in this direction, tailoring their simulated jobsite settings based on expert guidance. In their study, participants were tasked with recognizing hazards over a span of 25 min, from initial spotting to final decision-making. Essential data points like cognitive responses, identified hazards, and time taken were meticulously captured. This structured 25-min time frame was also incorporated by Zhou et al. (51). Their experimental design encompassed multiple phases: preparation, device calibration, task execution, and hazard verification. Deviating from this model, Qingwen Zhang et al. (52) conducted hazard-searching experiments without adhering to the 25-minute time constraint, but before initiating their core experiment, they evaluated participants on their familiarity with the site, understanding of safety protocols, and risk tolerance.
In essence, these fNIRS-simulated studies underscore the advantages of laboratory experiments, notably the ability to maintain controlled conditions while negating participants’ exposure to real-world hazards. However, a tangible disparity remains: the controlled simulations, no matter how intricate, still cannot fully emulate the complexities and nuances of actual construction worksites.
3.3.2. Decision-making
In the realm of fNIRS-based decision-making research, Wilde (53) introduced the risk homeostasis theory in psychology. This theory posits that workers are often inclined to compromise their fundamental interests, such as safety, in pursuit of potential profits amidst risks. Such a mindset might account for why construction site accidents are intrinsically linked to workers engaging in unsafe behaviors (7). Numerous variables come into play in workplace risk decision-making, encompassing factors like time pressure, cognitive demands, and risk attitude. A notable observation is that workers inclined toward unsafe actions tend to focus more on the enticing positive outcomes associated with these risky behaviors (54). Therefore, a comprehensive analysis of these influential variables is indispensable for effective construction safety management.
fNIRS, a non-invasive neuroscience technique, stands out for its wearability and tolerance to movement, making it apt for monitoring workers’ cognitive activities during decision-making processes in construction. This method evaluates changes in the cerebral cortex’s blood oxygen concentration, a direct indicator of brain activity. These changes can shed light on the effects of various influencing factors on cognition. As the intensity of cognitive tasks rises, there’s a commensurate increase in oxygen consumption by the brain’s neurons. This, in turn, leads to variations in the concentration of hemoglobin within the active neural regions, offering insights into cognitive processes (55).
Within the domain of cognitive studies centered on decision-making, control experiments play a pivotal role (56). However, when the focus shifts to decision-making in construction safety, the research dynamics change considerably. The inherently risky and unpredictable nature of construction environments necessitates a more tailored and rigorous experimental design. The aim is to accurately capture the nuanced cognitive processes influenced by factors such as time constraints. Recognizing this specificity, there has been a discernible trend toward adopting simulation experiments, particularly those leveraging the capabilities of fNIRS, in cognitive research related to construction safety. Illustratively, Pooladvand et al. (46) recommended a laboratory-based electrical construction work experiment with mixed reality environment using fNIRS. Within this framework, participants don VR and fNIRS devices to perform high-risk tasks, post-self-assessment, in two scenarios: standard and high-risk with potential rewards, with their behaviors and cognitive states being rigorously recorded. To ensure the simulation’s authenticity, researchers implemented a preliminary questionnaire, and, after a 30-min training, participants began tasks with the fNIRS system recording real-time cognitive data in an immersive environment (37).
3.4. Participants selection
The selection of participants can significantly impact the quality of an experiment. For instance, differences in memory performance among subjects can affect fNIRS measuring results (34). To address this issue, scholars recommend administering a brief questionnaire, such as the factor-referenced cognitive test, to ensure that abnormal mental conditions do not affect fNIRS measuring results (57). Additionally, having a sufficient sample size is essential in experimental design to reduce fNIRS measurement errors resulting from individual variations. In the reviewed studies on fNIRS applied in construction safety, the experiment participants range from 14 to 48, with a mean number of 40 and a median of 47. To enhance the reliability of results, researchers suggest having no fewer than 50 participants in psychological experiments, allowing for the simple comparison of two cognitive process indicators with 80% power (58). This assertion is based on the acceptable effect size of d = 0.4, with the sample size growing to 100 or more in the presence of within-group variable interactions. The existing sample sizes in studies are less than the ideal estimation, which may impact the reliability of experiment conclusions considering the complicated cognition status and related jumbled and violated measuring data in labor’s daily work.
In the reviewed papers that used experimental research methods with fNIRS, students in the field of civil engineering were selected as participants, with an average age of no less than 20 years (59, 60). High labor costs may be a reason for using students for experiments in some regions, such as the United States (46). Additionally, complex neuroscientific experiment tasks of fNIRS require participants to have a higher ability to learn and understand. However, construction workers are often perceived to lack higher education and to be older, which is contrary to the requirements of the fNIRS-based experiment. No studies have selected construction workers as subjects yet to generate convincing fNIRS experiment results. Moreover, there are fewer personal characteristic differences among students, which has the advantage of controlling irrelevant variables in fNIRS-based experiments (61). However, replacing construction workers with college students as fNIRS experiment participants has aroused suspicion for lacking sufficient working experience in construction. Furthermore, these fNIRS studies do not provide a reasonable explanation for why the findings of undergraduate participating experiments are equally applicable to construction workers, requiring further exploration.
4. Data analysis
4.1. Feature extraction
Hematoxylin plays an essential role in oxygen transport (62), particularly in industries like construction that involve significant physical work. The brain activity of construction workers leads to an increase in oxygen consumption, causing regional fluctuations in the concentration of oxyhemoglobin () and deoxyhemoglobin () (63). This forms the basis for fNIRS-based studies on construction safety, which enables the acquisition of and data (64). From this data, it is possible to generate the total hemoglobin concentration (, i.e., the sum of and ) and tissue oxygen saturation () (21). The result of and do not originate from direct fNIRS-based measurements but are calculated by processing the raw light intensity data based on the optical attenuation of the measured near-infrared spectroscopy light (65, 66). However, it is important to note that fNIRS measurements are susceptible to motion artifacts and physiological disturbances, especially when monitoring construction workers. Therefore, the successful extraction of essential features through the processing of raw functional near-infrared spectroscopy data becomes a critical factor in related neuroscience research (67).
In the fNIRS data analysis, the MBLL (Modified Beer–Lambert law) can be used to calculate the optical density variation for high dispersion media, which is the physics underlying the calculation of and (21). The MBLL is generally formulated as (68):
4.2. Signal preprocessing
The signal data collected in the reviewed fNIRS-based construction safety research are derived from three components, namely, (i) evoked neurovascular coupling from external stimuli or task design, (ii) spontaneous neurovascular coupling, and (iii) systemic physiological processes, including “physiological disturbances” or “systemic disturbances,” evoked by non-neurovascular coupling. Relying on the fNIRS signal, changes in blood oxygen concentration in the grey matter of the construction worker’s brain can be measured, which also reflects physiologically based systematic confounding in the superficial layers of the head (skin and frontal bone) (73). Recording a systematically confounded fNIRS signal can obscure participants’ brain activity and produce experimental error (74). To ensure effective and accurate statistical analysis of fNIRS-based construction safety research, it is necessary to preprocess signal data to exclude systematic confusion and remove unwanted signals (75).
The usual elements of signal processing and analysis of near-infrared spectroscopy include correction for motion artifacts, short-range correction, and physiological noise separation (66). In experimental studies applying fNIRS, low-pass filtering is one of the most commonly used signal processing methods to reduce experimental error by removing non-evoked signal content (76). As fNIRS-based construction safety research has evolved, data processing methods have been iteratively upgraded. Scholars raise a new approach for motion artifact removal by machine learning which shows a similar treatment effect between walking and stationary state in fNIRS measurement (77).
4.3. Analysis method
4.3.1. Statistical models
In the nascent stages of fNIRS-based construction safety research, the primary focus was on the rudimentary analysis of variations in hemoglobin oxygen content, which were then integrated with time series to formulate visualized results for analytical reference (24). However, as the field advanced, the complexity of experimental objectives and procedures increased, necessitating the integration of more sophisticated statistical approaches.
To address this growing complexity, researchers have expanded their analytical toolkit to include a diverse range of statistical models in fNIRS-based studies such as the two-sample t-test, paired t-test, one-way ANOVA, and multinomial ANOVA (20). Initially, simple t-tests were predominantly utilized to analyze mean value differences, offering a straightforward approach to data analysis (78). Subsequently, introducing more complex statistical models became imperative to cater to the evolving needs of fNIRS research. These later developments included the adoption of paired t-tests, which have proven instrumental in comparing activation levels under varying brain conditions (79), and the integration of ANOVA models, facilitating a nuanced analysis of data derived from fNIRS-based experiments (80).
Meanwhile, these statistical models reveal distinct advantages and disadvantages in fNIRS experiments. For instance, while t-tests are relatively simple to implement and adept at comparing means between two groups, researchers should consider whether the data in fNIRS-based study presuppose a normal distribution (47). Furthermore, the application of t-tests in multiple comparisons elevates the risk of type I error, potentially compromising the validity of the research findings for construction safety (81). Conversely, ANOVA models, though capable of handling multiple comparisons simultaneously in fNIRS experiments and offering a holistic view of the data, necessitating larger sample sizes in construction safety research can sometimes be a limiting factor (82). Moreover, interpreting results from multi-factorial ANOVA models can be complex, requiring a profound understanding of the statistical principles and proposing rational experimental designs that underpin these models in fNIRS-based safety research of construction workers (66).
Selecting an appropriate statistical model in the context of fNIRS-based construction safety research is multifaceted and influenced by numerous critical factors (83). These factors encompass specific research objectives, the nature of the collected data, and the intricacies inherent in the experimental design. For instance, in the pursuit of introducing a quantitative metric for assessing the hazard recognition capability of construction workers, researchers strategically opted for multivariate analysis of variance to compare diverse multimodal data, which included fNIRS measurements (30). This selection process demands a profound understanding of the underlying data distribution, considerations regarding sample size, and a meticulous evaluation of the potential consequences associated with both type I and type II errors in fNIRS experiments (84). Consequently, some research teams expanded the cohort of participants involved in fNIRS experiment and augmented the number of measurement channels for fNIRS to accumulate a more extensive dataset, thereby enhancing the robustness of their construction safety analysis (59). Furthermore, in selecting statistical models for the analysis of fNIRS data, it is crucial that these models not only facilitate the extraction of meaningful insights but also contribute to a deeper understanding of the intricate dynamics within the realm of construction safety. As an illustrative example, the adoption of a general linear model to investigate the relationship between individual risk attitudes and decision-making related to construction risk emerged as a rational and well-founded choice (46). Looking toward the future, as fNIRS experiments in construction safety evolve toward greater complexity and comprehensiveness, there is a burgeoning anticipation for the development of specialized statistical tools and software (85). These tools are poised to enable a more exhaustive and intricate analysis of fNIRS data, fostering a deeper and more nuanced understanding of the intricacies within the field of construction safety research.
4.3.2. Machine learning models
Increasing requirements of the fNIRS application in sectors such as healthcare are impeded by restricted monitoring regions (86). This has propelled the evolution of fNIRS devices, like the bundled optode approach, which could potentially augment the number of detection channels by thousands for experiments in construction safety research, thus introducing more complex statistical demands (87). Moreover, statistical analysis of a larger array of fNIRS data features elevates the volume and intricacy of data processing and comparison in construction safety research. These features include peak, mean, skewness, variance, slope, root mean square, and median (88). In response to this research trend, machine learning has been raised to achieve automatic feature extraction and classification tasks, like linear discriminant analysis (LDA), support vector machines (SVM), deep belief networks (DBN), and convolutional neural networks (CNN) (89, 90). Ho et al. (91) suggest a methodology using CNN and DBN achieving better classification accuracies of 84.26 ± 9.10% in comparison of [] and [] concentrations among two mental stages. In the mental load research by fNIRS, researchers compare the effect of a machine learning algorithm in data classification tasks, and it shows that DBN and CNN have higher accuracy than traditional methods like AdaBoost and SVM, one of the most popular models utilized widely for the cognition research of workers (92).
Integrating many algorithms, called ensemble learning, shows the potential for greater classification performance than applying a single traditional model in fNIRS-based research (93). This promising prospect has prompted scholars to consider the application of ensemble learning to fNIRS-based construction safety research, specifically in the cognitive exploration of construction workers. Two major categories of algorithms in ensemble learning contain bagging methods and boosting methods, such as XGBoost and Random Forest (RF). Linear support vector machine and linear discriminant analysis are integrated for classification work to improve the functional performance of fNIRS-based brain-computer interfaces (fNIRS-BCIs) (94). Li et al. (95) report that the ensemble learning of the 2-layer-GA-SVM model could enhance the average accuracy from 70.6 to 84.4% compared to the single GA-SVM model in fNIRS statistical analysis. Li et al. (96) also achieve an effective recognition rate of 94.4% (151/160) by fNIRS data using the gradient boosting tree (GBDT) and random forest (RF) models. These research cases in machine learning aiding data processing in the fNIRS-based study of construction safety are insufficient for further review analysis. Still, it provides guidance and insight for related research and deserves further observation in the future.
5. Discussion
5.1. Neurotechniques comparison
Functional neuroimaging technologies are pivotal tools in cognitive research, and within this realm, Functional Magnetic Resonance Imaging (fMRI), Electroencephalography (EEG), Electrocardiography (ECG), and Functional Near-Infrared Spectroscopy (fNIRS) are prominent methods (97–99). These technologies possess unique characteristics that make them suitable for cognitive research and application.
For example, fMRI is widely used to capture brain activity by monitoring changes in blood flow and oxygenation levels in specific brain regions (100). Its high spatial resolution allows for precise localization of brain activity, a valuable asset in cognitive research. However, fMRI has limitations, including the large, expensive equipment and the requirement for subjects to remain immobile within a narrow MRI machine, which can be restrictive in cognitive research related to construction worker safety (101).
On the other hand, EEG offers a different perspective on cognitive research (102). It reflects the macroscopic activity of the brain cortex and shares common attributes with fNIRS, such as wearability, wireless functionality, miniaturization, and lightweight design (103, 104). EEG records electrical activity on the scalp, providing insights into brain function in cognitive research. EEG devices are portable, lightweight, and relatively cost-effective compared to fMRI, making them well-suited for monitoring brain activity during various tasks, including cognitive assessments relevant to construction worker safety (105). However, EEG comes with certain limitations. For instance, in construction safety research, participants are required to apply a conductive paste to their scalp. This ensures a stable connection with the EEG electrodes, but it also adds to the overall cost of the experiments (106). Moreover, the nature of a construction worker’s job, which involves large-scale movements and vigorous physical activities, can introduce significant measurement noise into the EEG recordings. This not only impacts the detection precision but also increases the complexity of data processing and interpretation (18).
ECG, another technique in cognitive research, measures the electrical activity of the heart, offering insights into physiological responses during cognitive tasks of workers (107). ECG monitoring is relatively non-invasive, involving the placement of electrodes on the skin, and is well-suited for studying physiological responses in contexts related to construction worker safety. While ECG provides valuable data on cardiovascular responses, it is not a direct measure of brain activity like EEG or fNIRS in construction safety research.
In contrast, fNIRS emerges as a favorable option for investigating construction worker safety. fNIRS technology, due to its wearability, light weight, and tolerance for subject movement, proves ideal for assessing cognitive and physiological responses in dynamic work environments. Unlike EEG and ECG, fNIRS does not require conductive gel, thus eliminating discomfort and simplifying setup procedures (108). Moreover, fNIRS provides a more direct measure of localized changes in brain oxygenation, offering more profound insights into cognitive processes relevant to construction safety tasks. Furthermore, fNIRS exhibits a higher degree of movement tolerance, particularly in operational studies, as participants can wear the fNIRS equipment directly on their heads, providing more comfort compared to fMRI and EEG in construction safety research (109). This heightened tolerance reduces the likelihood of sweat-induced errors in device detection, minimizes exercise-related or physiological artifacts, and decreases the subsequent data processing workload, which is more common in EEG and ECG (18). Consequently, fNIRS demonstrates considerable potential for applications involving collecting long-time series data, specifically in the context of construction worker safety.
Given the dynamic, complex, and cognitively demanding nature of construction work, fNIRS emerges as the more suitable neuroscientific research tool for investigating construction safety. Its portability, comfort, and movement tolerance make it a practical choice for studying the cognitive and physiological responses of construction workers, ultimately contributing to the enhancement of safety measures and training protocols within the construction industry.
5.2. Implications
To achieve effective safety management in construction, it is essential to understand the cognitive processes of construction workers. As their work is performed in a complex and hazardous environment, it demands enormous cognitive effort. Therefore, accurate measurement and evaluation approaches are crucial for cognition research in construction safety. Traditional subjective questionnaire methodology is inadequate to capture the dynamic and complex nature of this research. The development of consumer-grade wearable fNIRS devices provides a more objective and accurate method to monitor brain activity in construction workers. In this review research, we have demonstrated the capability of fNIRS to measure cognitive processes and its future potential for multimodal studies. These findings suggest that fNIRS is a valuable tool for measuring the cognitive processes of construction workers on site, ultimately improving safety management in the industry.
Degrees of brain activity is closely related to the vibration of oxyhemoglobin concentration, which can intuitively reflect human cognitive and psychological status more intuitively and provide more accurate data to support experimental studies through fNIRS measurements (23). The success of fNIRS-based experiments requires a sufficient number of participants who receive appropriate pre-task guidance and are adequately representative of the target population. Meanwhile, the experiment design of construction safety research should thoroughly consider the authenticity of the operational environment and the possibility of influence on the measurement data, for which virtual reality has been applied in fNIRS-based studies (46). The fNIRS data can be evaluated to measure the correlation with mental representation, physiological indices, and external factors in workplaces (30). In cognition monitoring, fNIRS measurements produce fewer data noise and motion artifacts, resulting in less error in experimental results and higher data quality. After pre-processing (e.g., low-pass filtering), statistical analysis of fNIRS data can be calculated by the software, in which machine learning demonstrates higher computational power and accuracy in cognition status classification and computation.
According to previous research, fNIRS has demonstrated several advantages in the cognition research of construction workers compared to other measuring methods. Firstly, the portable and wearable nature of fNIRS devices allows for high motion tolerance and use in diverse research environments (104). Meanwhile, fNIRS also has good subject comfort. Secondly, fNIRS is a neuroscience technique that directly detects blood oxygen concentration variables in the cerebral cortex using near-infrared light, allowing for the most direct indication of cognitive activities through calculated [] and [] vibration values. This generated data enables thorough research into the phenomenon of brain blood flow to explore the mechanisms of related cognitive processes. Lastly, fNIRS measurement is time dynamic, recording the [] and [] changes owing to blood flow with the high temporal and spatial resolution, which is compatible with the rapid change and small-time scale of cognitive activity.
The use of fNIRS-based research in construction safety has filled a gap in the neuroscience field and provided a new technical tool for studying human cognitive conditions, which can improve our understanding of hazard recognition and decision-making processes (29). The fNIRS method facilitates an objective assessment of workers’ hazard recognition and decision-making abilities, which can help managers to improve safety training strategies and measure training effectiveness. With the aid of fNIRS-based measurement metrics, managers can provide individualized, customized training programs for construction workers, and future intelligent risk identification capability assessment training systems can be developed. Furthermore, a better understanding of decision-making mechanisms through fNIRS-based research provides an objective basis for improving management methods and identifying the key factors affecting management effectiveness.
5.3. Limitation
The fNIRS-based research in construction safety is still in its infancy, and the lack of sufficient study cases limits this present review. Although applying neuroscience techniques in the computation of the cognition process is an emerging research direction, the fNIRS-based study provides a broad view of construction workers’ neuroscience exploration. However, several limitations of fNIRS-based construction safety research expected to be addressed are discussed below:
1. Although researchers have tried to simulate the working environment of construction in a lab with appropriate space and set up risk points based on the actual situation (52), it is still challenging to fully represent the complex environment of actual construction sites (29). The dynamic changes of the construction workplace and the interferences between workers have not been discussed enough and are reflected in the existing research experiments. Moreover, the hazard search tasks designed for fNIRS-based research are of limited difficulty and may not be representative of actual construction workplaces. Furthermore, the sample subjects selected for simulation experiments are mainly young, college-educated males, which differ significantly from the educational profile of construction workers and may introduce bias into the fNIRS-based experiment results (110). Additionally, the ratio of female and older workers among construction workers is constantly vibrating, and these situations have not received sufficient attention in the existing fNIRS-based experimental designs (111). Furthermore, the fNIRS-based literature selected for this review suffers from a small sample size, which may limit the generalizability of the findings.
2. Scholars have focused on time and peak features of and concentration data to evaluate the impact of designed variables on hazard recognition and decision-making through the fNIRS-based experiment with construction workers (24). However, statistical analysis of more fNIRS data features has not been involved in exploring the cognitions status of construction workers, such as skewness, variance, slope, root means square, and median (88). Additionally, the analysis of designed impact variables to hazard recognition and decision-making only considers relevance in the fNIRS-based experiment, and further inquiry into the mechanisms of influence is needed.
3. Scholars have primarily focused on a limited number of indicators to evaluate the cognitive processes of construction workers in hazard recognition and decision-making. However, the cognitive process of construction workers is influenced by various internal and external factors, which are currently underrepresented in experimental analysis. For example, the hazard searching task in fNIRS-based experiments analyzing the implications of risk type on workers’ hazard recognition only considers four main risk events of workplaces, which differs significantly from the actual situation (59). While fNIRS-based experiments have been widely used in various industries to detect workers’ cognitive states, such as mental load, fatigue, and emotional state, the factors that affect workers’ cognition and may lead to unsafe behavior or ignorance of risk are complex (89, 112, 113). However, in the context of construction safety, the current application of this neuroscience technology has mainly focused on the importance of hazard identification and decision-making without exploring the potential impact of other cognitive factors on worker safety. In addition, the statistical analysis stage does not sufficiently consider the joint influence of multiple designed variables on the hazard recognition process for construction workers. Further experimental exploration is needed to investigate the mechanisms of interaction within the influencing factors, the synergistic impact mechanisms on hazard recognition, and the mechanisms of cognitive state formation under the influence in fNIRS-based research.
4. Researchers have primarily focused on exploring the role of different prefrontal cortex (PFC) areas in hazard identification and decision-making in fNIRS-based studies of construction workers (51). However, different brain regions typically work together to perform a specific recognition task, and it is, therefore, worth exploring whether other brain areas of construction workers are involved in the hazard recognition task, as well as their mechanism of action and degree of activation (114). Additionally, due to inadequate spatial resolution, fNIRS is insufficient for exploring cognitive functions in deep brain regions, and multimodal neuro-technique solutions are expected in the future. Furthermore, machine learning algorithms are well-suited for processing large amounts of data and have promising applications in the intelligent analysis of fNIRS data, particularly for feature learning and deep learning for classification. However, there is a lack of participation in machine learning methodology in fNIRS-based cognitive process computation of construction workers, and further research in this area is warranted.
5.4. Future direction
To demonstrate the potential of the fNIRS-based study in construction safety, the following recommendations for future research should be considered:
1. To demonstrate the potential of fNIRS-based studies in construction safety, it is recommended to improve the experimental design by simulating the working conditions of construction workers more comprehensively, including the full range of potential hazards. Researchers should select representative subjects with adequate sample sizes and properties compositions of gender and age that reflect the actual situation of construction workers in fNIRS-based cognitive experiments. Simplified experimental designs should be avoided, and tasks should correspond to the actual working conditions of construction workers, evaluating the influences of collaborative working among workers. In addition, incorporating immersive and realistic experimental environments through VR technology can enhance the fNIRS-based experiment design in the laboratory.
2. Scholars should consider incorporating additional data features into their statistical analysis. In addition to the time and peak features currently being used, other features such as skewness, variance, slope, root means square, and median should also be explored. This will allow for a more comprehensive understanding of the patterns and trends within the fNIRS data, which can provide valuable insights into the cognitive processes of construction workers. To support this effort, researchers should draw upon theoretical and experimental studies in neuroscience to identify relevant data features and develop appropriate statistical models.
3. In the domain of future fNIRS-based research aimed at enhancing the safety of construction workers, several crucial avenues for investigation emerge. Firstly, researchers should endeavor to expand the scope of influencing factors integrated into their fNIRS-based experiments. These factors should encompass a comprehensive array of variables in construction safety, including environmental conditions, psychological states, individual variances, and related elements. Incorporating these multifaceted variables will facilitate the acquisition of a more comprehensive understanding of the cognitive processes involved in recognizing hazards and decision-making among construction workers. Such a broader perspective will yield more precise insights conducive to enhancing safety management. Furthermore, it is essential to prioritize the examination of the mechanisms that underlie the interaction among these influencing factors. Understanding how internal and external elements synergistically affect cognitive processes will effectively bridge the knowledge gap about forming cognitive states in construction workers. This, in turn, will lead to a better understanding of construction workers’ cognitive processes within safety environments and support the development of more effective safety strategies. In addition, fNIRS-based research can investigate the cognitive foundations of hazard recognition and decision-making. This entails an exploration of cognitive variations across diverse work environments, analyzing workers’ physiological responses to hazard cues, and investigating the neural substrates of decision-making processes. These research endeavors will shed light on the cognitive challenges construction workers encounter in hazardous contexts, consequently informing the design of more effective safety training and management protocols. Ultimately, these research proposals have the potential to enhance the safety of construction workers significantly. Through rigorous cognitive investigations, we can attain a more profound comprehension of the pivotal factors influencing hazard recognition and decision-making, thereby enabling enhanced training and support, mitigating accident risks, and elevating overall safety standards at construction sites.
4. To improve the effectiveness of fNIRS-based research in construction safety, it is necessary to increase the number of brain regions explored in experiments. Researchers should consider the mechanisms by which different brain regions function in cognitive processes. To address this issue, fNIRS can be integrated with other neuroscience techniques, such as EEG, eye tracking, and fMRI, to conduct multimodal studies in construction safety. Multimodal research can compensate for the lack of spatial measurements in fNIRS devices and provide more comprehensive data to support cognitive studies of construction workers. Furthermore, the generated large amount of data from multimodal research can be analyzed and processed by artificial intelligent algorithms such as machine learning. Meanwhile, a suite of intelligent data analysis systems consisting of deep learning methods can be expected as a promising direction for future fNIRS-based research, such as: convolutional neural networks (CNN), recurrent neural networks (RNN) and graphical neural networks (GNN).
6. Conclusion
The fNIRS-based research provides a valuable methodology to enhance the understanding of the cognitive processes of workers in construction safety for both academics and managers. This review provided a systematic analysis of the fNIRS-based application in exploring construction workers’ cognitive process of hazard recognition and decision-making. Scholars have used fNIRS to study the influence of multiple variables on cognitive processes in hazard cognition and decision-making by computing concentration changes in [] and []. Moreover, the review outlined the basic theory and significant highlights and issues in fNIRS-based experimental design (detection area, participant selection, experimental device, and task design) and data analysis (data extraction, signal processing, computation method, and objective analysis).
This study identified gaps in the current fNIRS-based research and provided suggestions for future exploration. The design in the existing fNIRS-based experimental studies did not sufficiently simulate the realities of construction workers’ daily work, and researchers need to investigate the mechanisms of workers’ cognitive processes further. Multimodal approaches, such as integrating fNIRS with other neuroscience techniques, show promise for advancing the exploration of cognitive processes. Additionally, machine learning algorithms can be used to process and analyze large amounts of data generated by multimodal studies.
Therefore, future fNIRS-based exploration in construction safety should focus on theoretical development, experimental design, and algorithmic applications. This review provides guidance for new researchers in fNIRS-based safety research on the cognitive processes of construction workers, which would benefit construction management improvements.
Author contributions
YH: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Writing – original draft, Writing – review & editing. JH: Conceptualization, Formal analysis, Methodology, Project administration, Supervision, Validation, Writing – review & editing. YY: Data curation, Formal analysis, Investigation, Methodology, Writing – review & editing. HC: Conceptualization, Formal analysis, Project administration, Supervision, Validation, Writing – review & editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This work was supported by the National Natural Science Foundation of China (No. 72171237).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. International Labour Organization. (2015). Safety and health at the heart of the future of work. Available at: https://www.ilo.org/global/topics/safety-and-health-at-work/events-training/events-meetings/world-day-for-safety/WCMS_724000/lang--en/index.htm
2. MHURD. (2021). Office of the ministry of housing and urban-rural development's notification on the production safety accidents of housing and municipal engineering in 2020. Available at: https://www.mohurd.gov.cn/gongkai/zhengce/zhengcefilelib/202210/20221026_768565.html
3. U.S. Bureau of Labor Statistics. (2022). Census of Fatal Occupational Injuries Summary. Available at: https://www.bls.gov/news.release/cfoi.nr0.htm
4. Hinze, J, Pedersen, C, and Fredley, J. Identifying root causes of construction injuries. J Constructi Eng Manag ASCE. (1998) 124:67–71. doi: 10.1061/(asce)0733-9364(1998)124:1(67)
5. Jeelani, I, Albert, A, Han, K, and Azevedo, R. Are visual search patterns predictive of Hazard recognition performance? Empirical investigation using eye-tracking technology. J Constr Eng Manag. (2019) 145:1589. doi: 10.1061/(asce)co.1943-7862.0001589
6. Albert, A, Hallowell, MR, Kleiner, B, Chen, A, and Golparvar-Fard, M. Enhancing construction Hazard recognition with high-Fidelity augmented Virtuality. J Constr Eng Manag. (2014) 140:04014024. doi: 10.1061/(asce)co.1943-7862.0000860
7. Haslam, RA, Hide, SA, Gibb, AG, Gyi, DE, Pavitt, T, Atkinson, S, et al. Contributing factors in construction accidents. Appl Ergon. (2005) 36:401–15. doi: 10.1016/j.apergo.2004.12.002
8. Ma, H, Wu, ZG, and Chang, P. Social impacts on hazard perception of construction workers: a system dynamics model analysis. Saf Sci. (2021) 138:105240. doi: 10.1016/j.ssci.2021.105240
9. Namian, M., Zuluaga, C. M., and Albert, A. (2016) Critical factors that impact construction Workers' Hazard recognition performance. Construction Research Congress 2016: Old and New Construction Technologies Converge in Historic San Juan. University of Puerto Rico at Mayaguez, San Juan.
10. Wang, NN. Multi-criteria decision-making model for whole life costing design. Struct Infrastruct Eng. (2011) 7:441–52. doi: 10.1080/15732470802670875
11. Albert, A, Pandit, B, and Patil, Y. Focus on the fatal-four: implications for construction hazard recognition. Saf Sci. (2020) 128:104774. doi: 10.1016/j.ssci.2020.104774
12. Bhandari, S., Hallowell, M. R., Van Boven, L., Gruber, J., and Welker, K. M. Emotional states and their impact on hazard identification skills. Construction Research Congress (2016) 28:31–40. doi: 10.1061/9780784479827.282
13. Jern, A, Lucas, CG, and Kemp, C. People learn other people’s preferences through inverse decision-making. Cognition. (2017) 168:46–64. doi: 10.1016/j.cognition.2017.06.017
14. Lu, J, Xie, X, and Xu, J. Desirability or feasibility: self–other decision-making differences. Personal Soc Psychol Bull. (2013) 39:144–55. doi: 10.1177/0146167212470146
15. Stone, ER, and Allgaier, L. A social values analysis of self–other differences in decision making involving risk. Basic Appl Soc Psychol. (2008) 30:114–29. doi: 10.1080/01973530802208832
16. Wolf, M, Teizer, J, Wolf, B, Bükrü, S, and Solberg, A. Investigating hazard recognition in augmented virtuality for personalized feedback in construction safety education and training. Adv Eng Inform. (2022) 51:101469. doi: 10.1016/j.aei.2021.101469
17. Peng, Y, Xu, Q, Lin, SX, Wang, XH, Xiang, GL, Huang, SF, et al. The application of electroencephalogram in driving safety: current status and future prospects. Front Psychol. (2022) 13:919695. doi: 10.3389/fpsyg.2022.919695
18. Cheng, B, Fan, C, Fu, H, Huang, J, Chen, H, and Luo, X. Measuring and computing cognitive statuses of construction workers based on electroencephalogram: a critical review. IEEE Trans Comput Soc Syst. (2022) 9:1644–59. doi: 10.1109/TCSS.2022.3158585
19. Cheng, B, Luo, X, Mei, X, Chen, H, and Huang, J. A systematic review of eye-tracking studies of construction safety. Front Neurosci. (2022) 16:891725. doi: 10.3389/fnins.2022.891725
20. Scholkmann, F, Kleiser, S, Metz, AJ, Zimmermann, R, Pavia, JM, Wolf, U, et al. A review on continuous wave functional near-infrared spectroscopy and imaging instrumentation and methodology. Neuroimage. (2014) 85:6–27. doi: 10.1016/j.neuroimage.2013.05.004
21. Delpy, DT, Cope, M, van der Zee, P, Arridge, S, Wray, S, and Wyatt, J. Estimation of optical pathlength through tissue from direct time of flight measurement. Phys Med Biol. (1988) 33:1433–42. doi: 10.1088/0031-9155/33/12/008
22. Pinti, P, Merla, A, Aichelburg, C, Lind, F, Power, S, Swingler, E, et al. A novel GLM-based method for the automatic identification of functional events (AIDE) in fNIRS data recorded in naturalistic environments. Neuroimage. (2017) 155:291–304. doi: 10.1016/j.neuroimage.2017.05.001
23. Bonetti, LV, Hassan, SA, Lau, ST, Melo, LT, Tanaka, T, Patterson, KK, et al. Oxyhemoglobin changes in the prefrontal cortex in response to cognitive tasks: a systematic review. Int J Neurosci. (2019) 129:195–203. doi: 10.1080/00207454.2018.1518906
24. Hu, M., Shealy, T., Hallowell, M., and Hardison, D. (2018) Advancing construction Hazard recognition through neuroscience: measuring cognitive response to hazards using functional near infrared spectroscopy Construction Research Congress 2018: Safety and Disaster management, Louisiana State University, Bert S Turner Department of Construct Management, New Orleans, LA
25. Herff, C, Heger, D, Fortmann, O, Hennrich, J, Putze, F, and Schultz, T. Mental workload during n-back task—quantified in the prefrontal cortex using fNIRS. Front Hum Neurosci. (2014) 7:935. doi: 10.3389/fnhum.2013.00935
26. Peng, K, Steele, SC, Becerra, L, and Borsook, D. Brodmann area 10: collating, integrating and high level processing of nociception and pain. Prog Neurobiol. (2018) 161:1–22. doi: 10.1016/j.pneurobio.2017.11.004
27. Al-Shargie, F., Tang, T. B., and Kiguchi, M. Mental stress grading based on fNIRS signals. In: 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE (2016) 51:40–43. doi: 10.1109/EMBC.2016.7591884
28. Yeung, MCK, Lee, TL, and Chan, AGS. Negative mood is associated with decreased prefrontal cortex functioning during working memory in young adults. Psychophysiology. (2021) 58:e13802. doi: 10.1111/psyp.13802
29. Liao, P-C, Sun, X, and Zhang, D. A multimodal study to measure the cognitive demands of hazard recognition in construction workplaces. Saf Sci. (2021) 133:105010. doi: 10.1016/j.ssci.2020.105010
30. Sun, X, and Liao, PC. Re-assessing hazard recognition ability in occupational environment with microvascular function in the brain. Saf Sci. (2019) 120:67–78. doi: 10.1016/j.ssci.2019.06.040
31. Holtzer, R, Mahoney, JR, Izzetoglu, M, Izzetoglu, K, Onaral, B, and Verghese, J. fNIRS study of walking and walking while talking in young and old individuals. J Gerontol A Biol Sci Med Sci. (2011) 66:879–87. doi: 10.1093/gerona/glr068
32. Wang, M, Liu, X, Lai, Y, Cao, W, Wu, Z, and Guo, X. Application of neuroscience tools in building construction – an interdisciplinary analysis. Front Neurosci. (2022) 16:895666. doi: 10.3389/fnins.2022.895666
33. Artinis-Medical. (2022). Oxymon. Available at: https://www.artinis.com/oxymon
34. Zhu, Q, Du, J, Shi, YM, and Wei, P. Neurobehavioral assessment of force feedback simulation in industrial robotic teleoperation. Autom Constr. (2021) 126:103674. doi: 10.1016/j.autcon.2021.103674
35. Huichuang Co. (2022). NirSmart. Available at: http://www.hcmedx.cn/ProductDetail/4483814.html
36. Giannakos, MN, Sharma, K, Pappas, IO, Kostakos, V, and Velloso, E. Multimodal data as a means to understand the learning experience. Int J Inf Manag. (2019) 48:108–19. doi: 10.1016/j.ijinfomgt.2019.02.003
37. Pooladvand, S, and Hasanzadeh, S. Neurophysiological evaluation of workers' decision dynamics under time pressure and increased mental demand. Autom Constr. (2022) 141:104437. doi: 10.1016/j.autcon.2022.104437
38. Endsley, MR. Measurement of situation awareness in dynamic-systems. Hum Factors. (1995) 37:65–84. doi: 10.1518/001872095779049499
39. Hoshi, Y. Functional near-infrared optical imaging: utility and limitations in human brain mapping. Psychophysiology. (2003) 40:511–20. doi: 10.1111/1469-8986.00053
40. Hoshi, Y, Kobayashi, N, and Tamura, M. Interpretation of near-infrared spectroscopy signals: a study with a newly developed perfused rat brain model. J Appl Physiol. (2001) 90:1657–62. doi: 10.1152/jappl.2001.90.5.1657
41. Leff, DR, Orihuela-Espina, F, Elwell, CE, Athanasiou, T, Delpy, DT, Darzi, AW, et al. Assessment of the cerebral cortex during motor task behaviours in adults: a systematic review of functional near infrared spectroscopy (fNIRS) studies. Neuroimage. (2011) 54:2922–36. doi: 10.1016/j.neuroimage.2010.10.058
42. Quaresima, V, Ferrari, M, Torricelli, A, Spinelli, L, Pifferi, A, and Cubeddu, R. Bilateral prefrontal cortex oxygenation responses to a verbal fluency task: a multichannel time-resolved near-infrared topography study. J Biomed Opt. (2005) 10:011012. doi: 10.1117/1.1851512
43. Ahn, S, Nguyen, T, Jang, H, Kim, JG, and Jun, SC. Exploring neuro-physiological correlates of Drivers' mental fatigue caused by sleep deprivation using simultaneous EEG, ECG, and fNIRS data. Front Hum Neurosci. (2016) 10:219. doi: 10.3389/fnhum.2016.00219
44. Yoshino, K, Oka, N, Yamamoto, K, Takahashi, H, and Kato, T. Functional brain imaging using near-infrared spectroscopy during actual driving on an expressway. Front Hum Neurosci. (2013) 7:882. doi: 10.3389/fnhum.2013.00882
45. Li, LP, Liu, ZG, Zhu, HY, Zhu, L, and Huang, YC. Functional near-infrared spectroscopy in the evaluation of urban rail transit drivers’ mental workload under simulated driving conditions. Ergonomics. (2019) 62:406–19. doi: 10.1080/00140139.2018.1535093
46. Pooladvand, S., Ay, D., and Hasanzadeh, S. The neural basis of risk attitude in decision-making under risk: FNIRS investigation of the simulated electrical construction task. In: 39th International Symposium on Automation and Robotics in Construction, ISARC (2022) 26:1–7.
47. Tian, F, Li, H, Tian, S, Tian, C, and Shao, J. Is there a difference in brain functional connectivity between Chinese coal mine workers who have engaged in unsafe behavior and those who have not? Int J Environ Res Public Health. (2022) 19:509. doi: 10.3390/ijerph19010509
48. Perello-March, J, Burns, CG, Woodman, R, Birrell, S, and Elliott, MT. How do drivers perceive risks during automated driving scenarios? An fNIRS neuroimaging study. Hum Factors. (2023). doi: 10.1177/00187208231185705 [Epub ahead of print].
49. Skau, S, Bunketorp-Käll, L, Kuhn, HG, and Johansson, B. Mental fatigue and functional near-infrared spectroscopy (fNIRS)–based assessment of cognitive performance after mild traumatic brain injury. Front Hum Neurosci. (2019) 13:145. doi: 10.3389/fnhum.2019.00145
50. Chen, JY, Song, XY, and Lin, ZH. Revealing the "invisible Gorilla" in construction: estimating construction safety through mental workload assessment. Autom Constr. (2016) 63:173–83. doi: 10.1016/j.autcon.2015.12.018
51. Zhou, X, Hu, Y, Liao, P-C, and Zhang, D. Hazard differentiation embedded in the brain: a near-infrared spectroscopy-based study. Autom Constr. (2021) 122:103473. doi: 10.1016/j.autcon.2020.103473
52. Zhang, Q, Zhang, D, and Liao, P-C. Leading indicators of mental representation in construction hazard recognition. Int J Occup Saf Ergon. (2021) 28:2066–79. doi: 10.1080/10803548.2021.1952005
53. Wilde, GJ. The theory of risk homeostasis: implications for safety and health. Risk Anal. (1982) 2:209–25. doi: 10.1111/j.1539-6924.1982.tb01384.x
54. Low, BKL, Man, SS, Chan, AHS, and Alabdulkarim, S. Construction worker risk-taking behavior model with individual and organizational factors. Int J Environ Res Public Health. (2019) 16, 16:1335. doi: 10.3390/ijerph16081335
55. Buxton, RB, Wong, EC, and Frank, LR. Dynamics of blood flow and oxygenation changes during brain activation: the balloon model. Magn Reson Med. (1998) 39:855–64. doi: 10.1002/mrm.1910390602
56. Kopton, IM, and Kenning, P. Near-infrared spectroscopy (NIRS) as a new tool for neuroeconomic research. Front Hum Neurosci. (2014) 8:549. doi: 10.3389/fnhum.2014.00549
57. Ekstrome, R, French, J, Harman, H, and Dermen, D. Manual for kit of factor referenced cognitive tests. Princeton, NJ: Educational Testing Service (1976).
58. Brysbaert, M. How many participants do we have to include in properly powered experiments? A tutorial of power analysis with reference tables. J Cogn. (2019) 2:16. doi: 10.5334/joc.72
59. Zhang, Q.-W., and Liao, P.-C. (2020) Influence of critical variables on prefrontal cortex activity in Hazard search. Construction Research Congress 2020: Safety, Workforce, and Education]. Construction research congress (CRC) on Construction Research and Innovation to Transform Society, Arizona State University, Tempe, AZ.
60. Zhu, Y, Sun, F, Li, C, Huang, J, Hu, M, Wang, K, et al. Acute effects of mindfulness-based intervention on athlete cognitive function: an fNIRS investigation. J Exerc Sci Fit. (2022) 20:90–9. doi: 10.1016/j.jesf.2022.01.003
61. Han, Y, Yin, Z, Zhang, J, Jin, R, and Yang, T. Eye-tracking experimental study investigating the influence factors of construction safety hazard recognition. J Constr Eng Manag. (2020) 146:4020091. doi: 10.1061/(ASCE)CO.1943-7862.0001884
62. Perutz, M. Hoppe-Seyler, stokes and haemoglobin. Biol Chem Hoppe Seyler. (1995) 376:449–50. doi: 10.1515/bchm3.1995.376.8.449
63. Wolf, M, Wolf, U, Toronov, V, Michalos, A, Paunescu, LA, Choi, JH, et al. Different time evolution of oxyhemoglobin and deoxyhemoglobin concentration changes in the visual and motor cortices during functional stimulation: a near-infrared spectroscopy study. Neuroimage. (2002) 16:704–12. doi: 10.1006/nimg.2002.1128
64. Durantin, G, Gagnon, JF, Tremblay, S, and Dehais, F. Using near infrared spectroscopy and heart rate variability to detect mental overload. Behav Brain Res. (2014) 259:16–23. doi: 10.1016/j.bbr.2013.10.042
65. Huppert, TJ, Diamond, SG, Franceschini, MA, and Boas, DA. HomER: a review of time-series analysis methods for near-infrared spectroscopy of the brain. Appl Opt. (2009) 48:D280–98. doi: 10.1364/AO.48.00D280
66. Tak, S, and Ye, JC. Statistical analysis of fNIRS data: a comprehensive review. Neuroimage. (2014) 85:72–91. doi: 10.1016/j.neuroimage.2013.06.016
67. Heiskala, J, Arridge, SR, Kolehmainen, VP, Tarvainen, T, and Kaipio, JP. Approximation error method can reduce artifacts due to scalp blood flow in optical brain activation imaging. J Biomed Opt. (2012) 17:096012. doi: 10.1117/1.JBO.17.9.096012
68. Cope, M, and Delpy, DT. System for long-term measurement of cerebral blood and tissue oxygenation on newborn infants by near infra-red transillumination. Med Biol Eng Comput. (1988) 26:289–94. doi: 10.1007/BF02447083
69. Asgher, U, Ahmad, R, Naseer, N, Ayaz, Y, Khan, MJ, and Amjad, MK. Assessment and classification of mental workload in the prefrontal cortex (PFC) using fixed-value modified beer-lambert law. Ieee Access. (2019) 7:143250–62. doi: 10.1109/ACCESS.2019.2944965
70. Kocsis, L, Herman, P, and Eke, A. The modified beer–Lambert law revisited. Phys Med Biol. (2006) 51:N91–8. doi: 10.1088/0031-9155/51/5/N02
71. Strangman, G, Franceschini, MA, and Boas, DA. Factors affecting the accuracy of near-infrared spectroscopy concentration calculations for focal changes in oxygenation parameters. Neuroimage. (2003) 18:865–79. doi: 10.1016/S1053-8119(03)00021-1
72. Hiraoka, M, Firbank, M, Essenpreis, M, Cope, M, Arridge, S, Van Der Zee, P, et al. A Monte Carlo investigation of optical pathlength in inhomogeneous tissue and its application to near-infrared spectroscopy. Phys Med Biol. (1993) 38:1859–76. doi: 10.1088/0031-9155/38/12/011
73. Gagnon, L, Cooper, RJ, Yücel, MA, Perdue, KL, Greve, DN, and Boas, DA. Short separation channel location impacts the performance of short channel regression in NIRS. Neuroimage. (2012) 59:2518–28. doi: 10.1016/j.neuroimage.2011.08.095
74. Cooper, RJ, Selb, J, Gagnon, L, Phillip, D, Schytz, HW, Iversen, HK, et al. A systematic comparison of motion artifact correction techniques for functional near-infrared spectroscopy. Front Neurosci. (2012) 6:147. doi: 10.3389/fnins.2012.00147
75. Noori, FM, Naseer, N, Qureshi, NK, Nazeer, H, and Khan, RA. Optimal feature selection from fNIRS signals using genetic algorithms for BCI. Neurosci Lett. (2017) 647:61–6. doi: 10.1016/j.neulet.2017.03.013
76. Brigadoi, S, Ceccherini, L, Cutini, S, Scarpa, F, Scatturin, P, Selb, J, et al. Motion artifacts in functional near-infrared spectroscopy: a comparison of motion correction techniques applied to real cognitive data. Neuroimage. (2014) 85:181–91. doi: 10.1016/j.neuroimage.2013.04.082
77. Siddiquee, MR, Hasan, SMS, Marquez, JS, Ramon, RN, and Bai, O. Accurate vigilance detection during gait by using movement artifact removal. Ieee Access. (2020) 8:51179–88. doi: 10.1109/access.2020.2980546
78. Schroeter, ML, Zysset, S, Kupka, T, Kruggel, F, and von Cramon, DY. Near-infrared spectroscopy can detect brain activity during a color-word matching Stroop task in an event-related design. Hum Brain Mapp. (2002) 17:61–71. doi: 10.1002/hbm.10052
79. Fishburn, FA, Norr, ME, Medvedev, AV, and Vaidya, CJ. Sensitivity of fNIRS to cognitive state and load. Front Hum Neurosci. (2014) 8:76. doi: 10.3389/fnhum.2014.00076
80. Chu, H, Cao, Y, Jiang, J, Yang, J, Huang, M, Li, Q, et al. Optimized electroencephalogram and functional near-infrared spectroscopy-based mental workload detection method for practical applications. Biomed Eng Online. (2022) 21:9. doi: 10.1186/s12938-022-00980-1
81. Singh, AK, Clowney, L, Okamoto, M, Cole, JB, and Dan, I. Scope of resampling-based tests in fNIRS neuroimaging data analysis. Stat Sin. (2008) 18:1519–34.
82. Juliana, N, Abu, IF, Mohamad, MHN, Fazel, MF, Rani, NA, Zafreen, NZF, et al. Simple coordination and cognitive stimulation activities for cognitive function assessments using functional near-infrared spectroscopy. Sains Malaysiana. (2022) 51:823–34. doi: 10.17576/jsm-2022-5103-16
83. Kamran, MA, and Hong, K-S. Linear parameter-varying model and adaptive filtering technique for detecting neuronal activities: an fNIRS study. J Neural Eng. (2013) 10:056002. doi: 10.1088/1741-2560/10/5/056002
84. Uga, M, Dan, I, Dan, H, Kyutoku, Y, Taguchi, Y, and Watanabe, E. Exploring effective multiplicity in multichannel functional near-infrared spectroscopy using eigenvalues of correlation matrices. Neurophotonics. (2015) 2:015002–2. doi: 10.1117/1.NPh.2.1.015002
85. Xu, J, Liu, X, Zhang, J, Li, Z, Wang, X, Fang, F, et al. FC-NIRS: a functional connectivity analysis tool for near-infrared spectroscopy data. Biomed Res Int. (2015) 2015:248724. doi: 10.1155/2015/248724
86. Hong, KS, and Yaqub, MA. Application of functional near-infrared spectroscopy in the healthcare industry: a review. J Innov Opt Health Sci. (2019) 12:1930012:91. doi: 10.1142/s179354581930012x
87. Nguyen, HD, and Hong, KS. Bundled-optode implementation for 3D imaging in functional near-infrared spectroscopy. Biomed Opt Express. (2016) 7:3491–507. doi: 10.1364/boe.7.003491
88. Hong, K-S, Khan, MJ, and Hong, MJ. Feature extraction and classification methods for hybrid fNIRS-EEG brain-computer interfaces. Front Hum Neurosci. (2018) 12:246. doi: 10.3389/fnhum.2018.00246
89. Aghajani, H, Garbey, M, and Omurtag, A. Measuring mental workload with EEG+fNIRS. Front Hum Neurosci. (2017) 11:359. doi: 10.3389/fnhum.2017.00359
90. Tanveer, MA, Khan, MJ, Qureshi, MJ, Naseer, N, and Hong, KS. Enhanced drowsiness detection using deep learning: an fNIRS study. Ieee Access. (2019) 7:137920–9. doi: 10.1109/access.2019.2942838
91. Ho, TKK, Gwak, J, Park, CM, and Song, JI. Discrimination of mental workload levels from multi-channel fNIRS using deep leaning-based approaches. IEEE Access. (2019) 7:24392–403. doi: 10.1109/access.2019.2900127
92. Ho, TKK, Gwak, J, Park, CM, Khare, A, and Song, JI. Deep leaning-based approach for mental workload discrimination from multi-channel fNIRS. Int Conf Emerg Trends Commun Comput Electr. (2019) 524:431–40. doi: 10.1007/978-981-13-2685-1_41
93. Guan, D, Yuan, W, Lee, Y-K, Najeebullah, K, and Rasel, MK. A review of ensemble learning based feature selection. IETE Tech Rev. (2014) 31:190–8. doi: 10.1080/02564602.2014.906859
94. Shin, J. Random subspace ensemble learning for functional near-infrared spectroscopy brain-computer interfaces. Front Hum Neurosci. (2020) 14:236. doi: 10.3389/fnhum.2020.00236
95. Li, C, Su, M, Xu, J, Jin, H, and Sun, L. A between-subject fNIRS-BCI study on detecting self-regulated intention during walking. IEEE Trans Neural Syst Rehabil Eng. (2020) 28:531–40. doi: 10.1109/TNSRE.2020.2965628
96. Li, C, Xu, Y, He, L, Zhu, Y, Kuang, S, and Sun, L. Research on fNIRS recognition method of upper limb movement intention. Electronics. (2021) 10:1239. doi: 10.3390/electronics10111239
97. Bennett, CM, and Miller, MB. fMRI reliability: influences of task and experimental design. Cogn Affect Behav Neurosci. (2013) 13:690–702. doi: 10.3758/s13415-013-0195-1
98. Hwang, S, Seo, J, Jebelli, H, and Lee, S. Feasibility analysis of heart rate monitoring of construction workers using a photoplethysmography (PPG) sensor embedded in a wristband-type activity tracker. Autom Constr. (2016) 71:372–81. doi: 10.1016/j.autcon.2016.08.029
99. Wang, Y, Huang, Y, Gu, B, Cao, S, and Fang, D. Identifying mental fatigue of construction workers using EEG and deep learning. Autom Constr. (2023) 151:104887. doi: 10.1016/j.autcon.2023.104887
100. Bigler, ED. Magnetic resonance imaging in the evaluation of cognitive function. Pediatr Blood Cancer. (2014) 61:1724–8. doi: 10.1002/pbc.25110
101. Korivand, S, Jalili, N, and Gong, J. Experiment protocols for brain-body imaging of locomotion: a systematic review. Front Neurosci. (2023) 17:1051500. doi: 10.3389/fnins.2023.1051500
103. Carrino, F., Dumoulin, J., Mugellini, E., Abou Khaled, O., and Ingold, R. A self-paced BCI system to control an electric wheelchair: evaluation of a commercial, low-cost EEG device. In: 2012 ISSNIP biosignals and biorobotics conference: biosignals and robotics for better and safer living (BRC). IEEE (2012):1–6.
104. Uchitel, J, Vidal-Rosas, EE, Cooper, RJ, and Zhao, H. Wearable, integrated EEG-fNIRS technologies: a review. Sensors. (2021) 21:6106. doi: 10.3390/s21186106
105. Michel, CM, and Murray, MM. Towards the utilization of EEG as a brain imaging tool. Neuroimage. (2012) 61:371–85. doi: 10.1016/j.neuroimage.2011.12.039
106. Ranky, G., and Adamovich, S. Analysis of a commercial EEG device for the control of a robot arm. In: The 2010 IEEE 36th Annual Northeast Bioengineering Conference (NEBEC). IEEE (2010):1–2.
107. Yu, J, Liu, GY, Wen, WH, and Chen, CW. Evaluating cognitive task result through heart rate pattern analysis. Healthc Technol Lett. (2020) 7:41–4. doi: 10.1049/htl.2018.5068
108. Hopko, SK, Khurana, R, Mehta, RK, and Pagilla, PR. Effect of cognitive fatigue, operator sex, and robot assistance on task performance metrics, workload, and situation awareness in human-robot collaboration. Ieee Robot Autom Lett. (2021) 6:3049–56. doi: 10.1109/LRA.2021.3062787
109. Karthikeyan, P, Moradi, S, Ferdinando, H, Zhao, Z, and Myllylä, T. Optics based label-free techniques and applications in brain monitoring. Appl Sci. (2020) 10:2196. doi: 10.3390/app10062196
110. Wang, XL, Wang, XC, and Huang, Y. Chinese construction worker reluctance toward vocational skill training. J Eng Design Technol. (2019) 17:155–71. doi: 10.1108/jedt-06-2018-0100
111. Peng, L, and Chan, AHS. Adjusting work conditions to meet the declined health and functional capacity of older construction workers in Hong Kong. Saf Sci. (2020) 127:104711. doi: 10.1016/j.ssci.2020.104711
112. Curtin, A, Tong, SB, Sun, JF, Wang, JJ, Onaral, B, and Ayaz, H. A systematic review of integrated functional near-infrared spectroscopy (fNIRS) and transcranial magnetic stimulation (TMS) studies. Front Neurosci. (2019) 13:Article 84. doi: 10.3389/fnins.2019.00084
113. Fakhrhosseini, M, Jeon, M, and Bose, R. Estimation of drivers' emotional states based on neuroergonmic equipment: an exploratory study using fNIRS. In: 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (2015):38–43.
Keywords: functional near-infrared spectroscopy, construction safety, construction workers, cognition process, Hazard recognition, decision-making, literature review
Citation: Han Y, Huang J, Yin Y and Chen H (2023) From brain to worksite: the role of fNIRS in cognitive studies and worker safety. Front. Public Health. 11:1256895. doi: 10.3389/fpubh.2023.1256895
Edited by:
Yibin Ao, Chengdu University of Technology, ChinaReviewed by:
Yanyu Wang, Louisiana State University, United StatesQi Liang, Southwest Petroleum University, China
Copyright © 2023 Han, Huang, Yin and Chen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Huihua Chen, chh@csu.edu.cn