- 1Assistance Systems and Medical Device Technology, Department for Health Services Research, Carl von Ossietzky University, Oldenburg, Germany
- 2Geriatric Medicine, Department for Health Services Research, Carl von Ossietzky University, Oldenburg, Germany
Introduction: Falls are one of the most common causes of emergency hospital visits in older people. Early recognition of an increased fall risk, which can be indicated by the occurrence of near-falls, is important to initiate interventions.
Methods: In a study with 87 subjects we simulated near-fall events on a perturbation treadmill and recorded them with inertial measurement units (IMU) at seven different positions. We investigated different machine learning models for the near-fall detection including support vector machines, AdaBoost, convolutional neural networks, and bidirectional long short-term memory networks. Additionally, we analyzed the influence of the sensor position on the classification results.
Results: The best results showed a DeepConvLSTM with an F1 score of 0.954 (precision 0.969, recall 0.942) at the sensor position “left wrist.”
Discussion: Since these results were obtained in the laboratory, the next step is to evaluate the suitability of the classifiers in the field.
1. Introduction
Falls are a major cause of emergency department visits in older adults (1). Approximately 33% of community-dwelling older adults fall at least once a year, with many becoming repeated fallers (2, 3). Falls reduce quality of life and increase mortality and morbidity (4). About 14% of falls result in fractures and about 10% of falls result in traumatic head injury (5, 6). Near-falls, which describe gait disturbances such as stumbling or slipping without actually falling, are frequent in everyday life and may precede actual falls. Therefore, it is important to identify near-falls, as these may present one of the earliest signs of an increased fall risk (7) providing the opportunity to establish treatment approaches as early as possible.
There is already plenty of work in the literature on fall detection. Most of the work focuses on the detection of falls and activities of daily living. According to a systematic literature review (8), wearable devices, depth-imaging cameras and radar-based systems are mainly used for fall detection. Wearable devices include smartphones with built-in accelerometers and gyroscopes. The authors describe that each of these methods has advantages and disadvantages in terms of effectiveness, data collection, security and privacy. In particular, camera-based solutions are rarely used due to privacy concerns. The first promising methods for fall detection were the threshold-based methods (9). However, it is difficult to determine the appropriate threshold without triggering false alarms: More complex movements with high outliers in the sensor signals, such as climbing stairs, are difficult to distinguish from falls or near-falls. Especially, the detection of near-fall events (stumbling) is difficult with this method, as no clear thresholds can be set that would not also be reached during normal walking.
Besides the threshold-based methods, another major area of research is fall detection using machine learning (ML) methods. Wang et al. (8) distinguished between methods based on feature engineering and neural networks. Feature engineering is used to compute selected time and frequency domain features from raw sensor data. However, according to Wang et al. (8), this approach requires expert knowledge to ultimately decide which features are most appropriate for the data and classification methods. The computed features can then be used as input to classifiers such as Support Vector Machines (SVM) or Decision Trees. Neural networks have the major advantage over conventional methods that they can learn to extract the features relevant for classification from the raw data. In the literature, convolutional neural networks (CNNs) and variants of recurrent neural networks (RNNs) are mainly used for fall detection (10, 11). Many studies use and train more complex neural networks to achieve multi-class classifications to distinguish between different activities of daily living and fall types. Also a deep convolutional and LSTM recurrent neural network (DeepConvLSTM) was used, which combines the advantages of CNNs for feature extraction and LSTM neurons for pattern recognition from the temporal sequence of the data (12). Near-falls (such as tripping) are characterized by the fact that they are intercepted by one’s own physical reaction and thus do not result in a fall. The early detection of an increased occurrence of near-falls can help to identify groups that are at risk of falls. However, the detection of near-falls has been studied by only a few research groups (13, 14), mainly due to the lack of appropriate data sets. Therefore, we provoked near-falls in older people on a perturbation treadmill in a study and measured their reaction during near-falls with inertial measurement units. Our goal was to develop a near-fall detection algorithm for early detection of increased fall risk in the future. Our research questions are:
• Which machine learning methods are suitable for near-fall detection?
• How does sensor position influence detection accuracy?
• Is a single sensor sufficient for near-fall detection?
2. Materials and methods
2.1. Study design and applied sensor systems
To answer the research questions, we examined the motion sensor data from the SeFallED and the CareFall study recorded in the gait laboratory of the geriatric department of the Carl von Ossietzky University Oldenburg. The SeFallED study aims to identify long-term trajectories of older adults, presenting to the emergency department without hospital admission after a sentinel fall. For the purpose of this study, data from baseline tests were used. A full list of inclusion and exclusion criteria has been published elsewhere (15). The CareFall study investigates cardiorespiratory fitness as a potential determinant of increased fall risk and reduced gait safety in older adults. Both studies use the perturbation treadmill to induce near-falls. The experimental setup, sensors, sensor positions and orientations, and the perturbation protocols are identical. Therefore, the data of these studies are comparable and the main difference is the medical objective of the studies
The perturbation treadmill (Motek Medical B.V., Amsterdam, the Netherlands) induces a total of nine different disturbances in addition to the normal gait mode (see Figure 1). The perturbations include anterior–posterior, medio-lateral and pitch perturbations. The integrated split-belt of the treadmill with separate force plates (sampling rate: 300 Hz) allows to perturb either both legs or just one leg during walking. The perturbations were designed to simulate typical fall situations and to measure the subjects’ reactions. During the gait recordings, the subjects were secured with a harness to prevent them from falling to the ground. Motion sensor data was collected in both studies by six wirelessly synchronized inertial measurement units (IMU) (Opal V1, Mobility Lab™, APDM, Inc., Portland, OR, USA) and one activPAL sensor (activPAL©, PAL Technologies Ltd, Glasgow UK). The APDM Opal sensors record at a sampling rate of 128 Hz and contain an accelerometer and a gyroscope. The activPAL sensor has an accelerometer that samples at 40 Hz. Figure 1 shows the positioning of the sensors during the measurements. The sensor placements were selected based on commonly used positions in the literature (8). The sensors are always attached at the same position with the same orientation. The activPAL sensor has a long battery life is additionally worn in everyday life for a week after the laboratory visit. In the future, we also want to detect near-falls and thus an increased risk of falling with this sensor in everyday life. In addition to the IMUs, the subjects were also recorded by depth cameras (Azure Kinect DK, Microsoft, Redmond, WA, USA) during the measurements. Once the sensors were in place, first the individual preferred overground and treadmill gait speed were determined. All participants then completed a perturbation protocol with a duration of about 4 min and 30 s. The perturbation protocol starts with 30 s of the preferred treadmill walking speed, followed by 9 perturbations randomly presented to the participants. Time between perturbations will vary between 20–30 s. Additional functional assessments such as the short physical performance battery (SPPB), Short Falls Efficacy Scale International (Short-FES-I), and maximal grip strength of the dominant hand were performed. The test procedures were approved by the local ethics committee (ethical vote: Carl von Ossietzky University Oldenburg No. 2021-120 and 2021-026) and conducted in accordance with the Declaration of Helsinki. In total the data of 87 participants (44 male, 43 female) were included in this work. All participants provided written informed consent to participate in the study. Table 1 shows the characteristics of the study population. Of the 87 subjects, eleven reported the use walking aids in their daily lives and 42 reported no treadmill-experiences at all.
Figure 1. Perturbation treadmill (left) and IMU sensors and their position (right). The positions of the APDM sensors (green circle) are foot (left/right), wrist(left/right), sternum, and lumbar. The position of the activPAL sensor (blue box) is the right upper thigh.
Table 1. Characteristics of the entire study population with mean, median, standard deviation (SD), minimum (min), maximum (max), 25th percentile (Q1) and 75th percentile (Q3) values.
After data acquisition, the sensor data were processed as shown in Figure 2. The processing includes preprocessing steps, training, and classification, which were described in the following section. We focused on acceleration data only for all analyses.
2.2. Data preprocessing
The treadmill and the IMU-computers, both APDM and activPAL, are synchronized using Network Time Protocol. The treadmill and APDM are also synchronized by an external trigger so that these measurements start at the same time. In addition to NTP, we use event identification to synchronize the activPAL sensor (change between static and dynamic activity, response to disturbance). For synchronization, the data from both IMU-sensors (activPAL and APDM) was adjusted to the sampling rate of the treadmill. Subsequently, the data was labeled automatically, distinguishing between walking and perturbations. The classification was based on the treadmill data, which included timestamp and duration of the perturbations. All gait recordings without perturbations are directly classified into 2 s windows using the sliding window method. The duration of the perturbation does not necessarily represent the response to the perturbation, as individual response times must be considered. Thus, the perturbation windows are determined using the following methodology. Based on the time window of the perturbation, the method of Liu et al. (16) is used to calculate the maximum value of the norm from the three axes of the sensors using the formula (1).
The maximum is assumed to be the center of the perturbation response. Then a 2 s window is cut around the maximum. Figure 3 shows such an impact window. In the area between the two green lines, the treadmill has triggered a perturbation. The found maximum of the norm (negative peak) is marked with the blue line. The cut window is the area between the two red lines. This procedure must be repeated for each sensor position since the position of the respective maximum and thus the reaction time of the extremities can be different. The windows created and assigned to the two classes are then randomly divided into training, validation, and test data sets. The training data set receives 60%, the validation data set 20% and the test data set the remaining 20% of the windows. To ensure a comparable evaluation of all methods used, the division into the three data sets remains identical for all machine learning approaches.
Figure 3. Creating a perturbation window around the maximum of the norm, which represents the maximum reaction to a perturbation. Green: Treadmill perturbation, blue: Maximum, red: Selected 2s perturbation window.
2.3. Training
We used different machine learning algorithms to identify the best method for our application. The selection of the algorithms was based on the present literature in the field of fall detection (8). The classification algorithms include support vector machines (SVM) (17), AdaBoost (18), one- and two-dimensional convolutional neural networks (1D- and 2D-CNN) (19), and bidirectional long short-term memory (LSTM) networks (20). The improvement in bidirectional LSTM is that the current output is not only related to previous information but also to subsequent information and therefore captures a longer temporal relationships to enhance the recognition rate (21). For the SVM and AdaBoost classification, we selected features according to Liu et al. (22) and calculated them for each time window. For each axis of the accelerometer data as well as Norm , Norm , Norm following features are calculated:
• mean, median, standard deviation
• interquartile range, variance, minimum, maximum
• max-min (range), kurtosis, skew, energy
• Pearson correlation coefficient of the axes
All neural networks were created using tensorflow and keras modules. The optimization of the hyperparameters was done with hyperband for the neural networks and GridSearchCV for SVM and AdaBoost. Table 2 shows the search parameters for GridSearchCV and Hyperband. To compensate for the imbalance of classes (6238 gait windows and 1107 perturbation windows), we used weighted classes (23) as well as data augmentation (24).
3. Results
To answer our research question “Which machine learning methods are suitable for near-fall detection?,” we divided our results into classical ML approaches (SVM and AdaBoost) and neural networks. The results are also sorted by sensor position to answer the question “How does sensor position affect detection accuracy? Finally, we investigate the question” Is a single sensor sufficient for near-fall detection? To do this, we examine whether the combination of all six APDM sensors provides better results than a single sensor.
3.1. SVM and AdaBoost
For each sensor and sensor position, the GridSearch procedure was used to find the best classifier with the optimal hyperparameters in each case. For AdaBoost, GridSearch showed for example that DecisionTrees with max_depth=8 and min_samples_leaf=10 should be used as weak learners. It also showed that a total of 250 weak learners should be used. Table 3 shows the GridSearch results for SVM for each sensor position. The results of the different sensor positions of the SVMs and the AdaBoost classifier are presented in Table 4.
Table 4. Classification results of the different sensor positions with the SVM classifier and AdaBoost.
Data augmentation did not lead to any significant improvement in results and is therefore not listed here. The results show that we achieved similar results for SVM and AdaBoost for the activPAL sensor on the “upper thigh.” Adaboost achieved a precision of 0.952 and SVM a recall of 0.790 and an F1-Score of 0.862. For the APDM sensor the sensor position “wrist right” achieved the best results for SVM and AdaBoost with a precision of 0.707 (AdaBoost), a recall of 0.860 (SVM), and an F1-Score of 0.722 (AdaBoost).
3.2. Neural network
For each sensor and sensor position, the optimized hyperparameters for each evaluated network architecture was determined. Table 5 lists the results for the hyperparameters.
For the following analyses, we calculated the test results as the mean of 10 test runs and the standard deviation for each metric. Table 6 shows the results for each network architecture and sensor position. All data sets were tested with and without data augmentation (DA). The best result is listed. While the bidirectional Long Short-Term Memory (Bi-LSTM) networks produced weaker results for the precision and correspondingly also for the F1-Score, good results were obtained for each of the other architectures. For the activPAL sensor with the position upper thigh the 1D-CNN with DA achieved the best results with a precision of 0.838, a recall of 0.867 and an F1-Score of 0.851. For the APDM sensor, the left wrist shows the best precision of 0.969 with DeepConvLSTM DA. The best recall of 0.974 was achieved with the CNN and the left foot as sensor position. The best F1-Score was 0.954 with DeepConvLSTM DA on the left wrist.
3.3. Single sensor vs. multi-sensor system
We also examined whether the combination of all six APDM sensors provides better results than a single sensor. Therefore, we realized two approaches. Firstly, we trained the models on all APDM acceleration data, and therefore the combination of all sensor positions. Secondly, we used the best classifier for each sensor position (Table 6) and developed a majority vote classification algorithm. So the class with the majority of the six single votes is selected. The confusion matrices are presented in Figure 4.
Figure 4. Confusion matrix of DeepConv2DLSTM model and optimal hyperparameters based on data of a multi-sensor system (left) and confusion matrix of the majority vote classification of a multi-sensor system (right).
For the first approach, the combination of all sensor positions, best results are obtained with the DeepConv2DLSTM model and optimized hyperparameters. The F1-Score was of 0.932, precision 0.956, and recall 0.909. The majority vote classification approach resulted in an F1-Score of 0.995, precision of 0.994 and a recall of 0.996. There was no significant difference in classification time between these approaches when using pre-processed data.
4. Discussion
4.1. Influence of machine learning method
In this work, machine learning methods were used to classify near-fall events in motion sensor data. For this purpose, the suitability of different machine learning methods was evaluated. We included feature-based ML classifiers like SVM and AdaBoost as well as neural networks like 1D- and 2D-CNN, and LSTM networks. For the feature-based classifiers, we obtained good results for the activPAL sensor on the right upper thigh (Table 4). Here, the SVM classifier achieves an F1 score of 0.862 and the Adaboost classifier achieves an F1 score of 0.860. The precision and recall values of both classifiers are also close to each other. For both classifiers, the achieved precision is relatively high (>0.9), while the recall is significantly lower (<0.8). The low recall shows that a higher number of perturbations are falsely classified as gait data (false positives). To improve the results in the future, we may test more features in combination with the features already used. These could be, for example, features from the frequency domain, which are also widely used in the literature (25, 26).
The classification of the data was also investigated using neural networks (Table 6). While the bidirectional Long Short-Term Memory networks produced weak results for the precision, better results were obtained for each of the other architectures. The best architecture for the activPAL is the 1D-CNN+DA with an F1 score of 0.851. Another important point to compare is the training and testing time. To compare the resources required, it is assumed that the data are already prepared for the respective classifier. Training and testing the SVM classifier takes less than 2 s. Training with the 1D-CNN requires a graphics card. This training takes an average of 13.9 s without data augmentation and 25.1 s with data augmentation. After the model is trained once, it can be loaded for further classifications of test data without a new training. Loading the saved model and testing it with new data then takes about 3 s. For comparison of the evaluated methods it is also important to consider how they can be implemented for the actual use for the early detection of fall risk in private homes. Depending on the available hardware the size of the neural networks may be a factor in deciding which method should be used. From the comparison of the tested methods, it can be seen that the DeepConvLSTM model achieves the best result when the focus is on the correct classification of perturbations with few false positives (high precision). The DeepConvLSTM model however requires the most hardware resources of all evaluated methods. When less hardware resources are available, the SVM classifier can also give good results. When using the SVM classifier, it must then be weighed how to handle the higher number of false positives.
4.2. Influence of sensor position
We also investigated the influence of the sensor position on the classification results. Especially, we wanted to examine whether an alternative sensor position is better for classification compared to the positioning on the thigh, which is used in our studies for the activPAL sensors to detect near-falls in everyday life. Compared to the results with the activPAL sensor data, the classifications with the APDM sensors and the SVM and Adaboost classifiers achieve worse F1-Scores (Table 4). The APDM sensors on the right wrist achieves the best F1-Score among the APDM sensors with 0.722. But, it is noticeable that the precision is significantly smaller for all classifiers with the APDM data than in the experiments with the activPAL data. The classifiers that only achieve a small precision value can therefore not distinguish well between gait data without perturbations and those with perturbations and would thus trigger many false alarms. The best results for the neural networks (Table 6) were obtained with a DeepConvLSTM model on the left wrist with an F1-Score of 0.954 as well as a CNN on the data of the left foot with an F1-Score of 0.949. This work shows that the sensor position influences the classification. We achieved the best results with the sensor position “left wrist.” But F1-Scores above 0.85 could also be obtained with all other positions and they are therefore also suitable. Our dataset was created under laboratory conditions. Disturbances were provoked externally by the treadmill, but the subjects still knew they were going to stumble at some point and were therefore able to prepare for it. Thus, the best sensor position in real life may differ from laboratory conditions.
4.3. Influence of sensor number
We also investigated if a multi-sensor system achieved better results than a single sensor and analyzed two approaches: training on a combined data-set of all six APDM sensors and a majority vote classification based on the best classifier for each APDM sensor. As already discussed, satisfactory results could be reached by using only the accelerometer data of one sensor. For the trained classifier with data from all APDM sensors, we found that the best model was the DeepConvLSTM with an F1-Score of 0.932. For the majority vote classification, the F1-Score is 0.995. Thus, the multi-sensor system with majority vote performs slightly better than a single sensor (F1-Score 0.954). However, it is also important to note that a near-fall detection system for older adults that requires wearing six sensors is not suitable for everyday use.
4.4. Potential for fall prevention
As the data were recorded under laboratory conditions with participants being equipped with a total of 7 sensors, transfer of the results into everyday life is limited. Nevertheless, the results are promising that sensor-based near fall detection may be possible in the future warranting further research to design translational methods. In the next step, we will analyze the activPAL data recorded over one week in the participants’ everyday life. Here we will work with a hierarchical classifier to first identify the gait phases and then use the algorithm presented in this article to search for near-falls in these gait phases. The participants kept a near-fall/fall log. This allows us to evaluate our results. In this context, the similarity between real and treadmill induced near-falls should be investigated.
However, if it was possible to validly identify individuals at a high risk for falls by them wearing a sensor on their thigh, it would provide the opportunity to refine preventive treatment approaches by identifying individuals at risk as early as possible. Early identification is crucial to establish effective falls prevention (27) and, thus, avoid a fall-and all the associated negative outcomes-itself. The potential of e-health, technology and sensor-based data in falls prevention has been acknowledged in the world guidelines for falls prevention published in 2022 (28). However, the guidelines further support the notion that more research is needed to fully unlock the potential of such technology-based approaches.
5. Conclusion
Early detection of a fall risk is important in order to initiate interventions. We developed an algorithm to detect near-falls and investigated the suitability of different machine learning methods. We obtained the best results with a DeepConvLSTM based on data of a single sensor on the left wrist. However, promising results were also reached at other sensor positions. A multi-sensor system with majority vote performs slightly better than a single sensor. Since these results were obtained in the laboratory, the next step is to evaluate the suitability of the classifiers and sensor position in the field.
6. Outlook
As an outlook, our system can also be adapted to a fall detection system with an alarm function. Therefore, the dataset and the machine learning algorithms need to be extended in an appropriate way. Transfer learning could be a relevant approach for this adaptation (29, 30). Another important use case for transfer learning could be the individualization of the machine learning model for people with specific movement patterns (due to certain diseases or disabilities) to reduce the rate of false positive alarms. More advanced machine learning methods, such as graph neural networks (31) and evolutionary analysis (32), should also be considered for future work, since they could improve the performance of the (near-)fall detection systems. Another commonly used technique in modern machine learning research is the attention mechanism. Li et al. (33) implemented an improved attention mechanism together with a CNN-BiLSTM network to further identify important regions in the data. An implementation of this method in combination with the already used DeepConvLSTM network could be an improvement to our current approach. A fall detection system also requires the implementation of a continuous recording and analysis of the motion data. This could enable the proposed system to react to falls in real time and raise an alarm for potential emergencies. Many systems already have a long battery life of for example one week, but even recharging once a week can be a challenge for this group of older people at high risk of falling. For continuous measurement systems, a self-powered sensor could therefore be an interesting development to reduce data loss due to battery life (34). Developments regarding multi-sensor systems are also interesting to record and link for example vital parameters such as breathing patterns in addition to activity data to identify emergency situations (35, 36).
Data availability statement
The datasets presented in this article are not readily available because the raw data of the studies contain sensitive health data and cannot be made available due to data protection regulations. Requests to access the datasets should be directed to sandra.hellmers@uol.de.
Ethics statement
The studies involving human participants were reviewed and approved by Medical Ethics Committee of the Carl von Ossietzky University Oldenburg. The patients/participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.
Author contributions
The authors had the following contributions: Conceptualization, TZ and AH; methodology, EK and SH; software, EK; validation, EK and SH; formal analysis, EK, SH, JK and TS; data curation, AG, LS, JK and TS; writing, original draft preparation, SH, EK, JK, TS; writing, review and editing, AG, TZ and AH; visualization, SH and EK; supervision, TZ and AH. All authors contributed to the article and approved the submitted version.
Funding
The project has been funded by the Federal Ministry of Education and Research (BMBF, grant number: 01GY2021). The BMBF did not contribute to the study design or in writing the manuscript nor will it be involved in data collection, analysis and interpretation.
Acknowledgments
We want to thank all doctors and nurses involved, particularly our study nurses Imke de Jonge, Sabine Ehlers, Mehtap Ince, Ute von Varel and Ann-Kathrin Wolter for their help in informing the subjects about the study and collecting the data. Furthermore, we would like to express our gratitude to all research assistants involved in the data collection.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. Shankar KN, Liu SW, Ganz DA. Trends, characteristics of emergency department visits for fall-related injuries in older adults, 2003–2010. West J Emerg Med. (2017) 18:785. doi: 10.5811/westjem.2017.5.33615
2. Moreland J, Richardson J, Chan DH, O’Neill J, Bellissimo A, Grum RM, et al. Evidence-based guidelines for the secondary prevention of falls in older adults. Gerontology. (2003) 49:93–116. doi: 10.1159/000067948
3. Rubenstein LZ. Falls in older people: epidemiology, risk factors, strategies for prevention. Age Ageing. (2006) 35:ii37–ii41. doi: 10.1093/ageing/afl084
4. Ambrose AF, Paul G, Hausdorff JM. Risk factors for falls among older adults: a review of the literature. Maturitas. (2013) 75:51–61. doi: 10.1016/j.maturitas.2013.02.009
5. Rupp M, Walter N, Pfeifer C, Lang S, Kerschbaum M, Krutsch W, et al. The incidence of fractures among the adult population of germany: an analysis from 2009 through 2019. Dtsch Arztebl Int. (2021) 118:665. doi: 10.3238/arztebl.m2021.0238
6. Thompson HJ, McCormick WC, Kagan SH. Traumatic brain injury in older adults: epidemiology, outcomes, and future implications. J Am Geriatr Soc. (2006) 54:1590–5. doi: 10.1111/j.1532-5415.2006.00894.x
7. Maidan I, Freedman T, Tzemah R, Giladi N, Mirelman A, Hausdorff J. Introducing a new definition of a near fall: intra-rater, inter-rater reliability. Gait Posture. (2014) 39:645–7. doi: 10.1016/j.gaitpost.2013.07.123
8. Wang X, Ellul J, Azzopardi G. Elderly fall detection systems: a literature survey. Front Robot AI. (2020) 7:71. doi: 10.3389/frobt.2020.00071
9. Bourke AK, O’Brien JV, Lyons GM. Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm. Gait Posture. (2007) 26(2):194–9. doi: 10.1016/j.gaitpost.2006.09.012
10. Nakandala S, Jankowska MM, Tuz-Zahra F, Bellettiere J, Carlson JA, LaCroix AZ, et al. Application of convolutional neural network algorithms for advancing sedentary and activity bout classification. J Meas Phys Behav. (2021) 4:102–10. doi: 10.1123/jmpb.2020-0016
11. Wisesa IWW, Mahardika G. Fall detection algorithm based on accelerometer and gyroscope sensor data using recurrent neural networks. IOP Conf Ser: Earth Environ Sci. (2019) 258:012035. doi: 10.1088/1755-1315/258/1/012035
12. Ordóñez FJ, Roggen D. Deep convolutional and LSTM recurrent neural networks for multimodal wearable activity recognition. Sensors. (2016) 16(1):115. doi: 10.3390/s16010115
13. Wang S, Miranda F, Wang Y, Rasheed R, Bhatt T. Near-fall detection in unexpected slips during over-ground locomotion with body-worn sensors among older adults. Sensors. (2022) 22:3334. doi: 10.3390/s22093334
14. Choi A, Kim TH, Yuhai O, Jeong S, Kim K, Kim H, et al. Deep learning-based near-fall detection algorithm for fall risk monitoring system using a single inertial measurement unit. IEEE Trans Neural Syst Rehabil Eng. (2022) 30:2385–94. doi: 10.1109/TNSRE.2022.3199068
15. Stuckenschneider T, Koschate J, Dunker E, Reeck N, Hackbarth M, Hellmers S, et al. Sentinel fall presenting to the emergency department (sefalled) -protocol of a complex study including long-term observation of functional trajectories after a fall, exploration of specific fall risk factors, and patients’ views on falls prevention. BMC Geriatr. (2022) 22(1):594. doi: 10.1186/s12877-022-03261-7
16. Liu K-C, Hsieh C-Y, Huang H-Y, Hsu SJ-P, Chan C-T. An analysis of segmentation approaches and window sizes in wearable-based critical fall detection systems with machine learning models. IEEE Sens J. (2020) 20:3303–13. doi: 10.1109/JSEN.2019.2955141
17. Awad M, Khanna R. Efficient learning machines: theories, concepts, and applications for engineers and system designers. Berkeley, CA: Apress (2015).
18. Zhang B, Machine learning, visual perception. Berlin, Boston: De Gruyter (2020). doi: 10.1515/9783110595567
19. Silva IN, Spatti DH, Flauzino RA, Liboni LHB, Alves SR. Artificial neural networks: a practical course. Cham: Springer (2017).
20. Mekruksavanich S, Jitpattanakul A. Lstm networks using smartphone data for sensor-based human activity recognition in smart homes. Sensors. (2021) 21:1636. doi: 10.3390/s21051636
21. Zhao Y, Yang R, Chevalier G, Xu X, Zhang Z. Deep residual bidir-LSTM for human activity recognition using wearable sensors. Math Probl Eng. (2018) 2018:1–13. doi: 10.1155/2018/7316954
22. Liu K-C, Hsieh C-Y, Hsu SJ-P, Chan C-T. Impact of sampling rate on wearable-based fall detection systems based on machine learning models. IEEE Sens J. (2018) 18:9882–90. doi: 10.1109/JSEN.2018.2872835
23. Fernando KRM, Tsokos CP. Dynamically weighted balanced loss: class imbalanced learning and confidence calibration of deep neural networks. IEEE Trans Neural Networ Learn Syst. (2022) 33:2940–51. doi: 10.1109/TNNLS.2020.3047335
24. Um TT, Pfister FMJ, Pichler D, Endo S, Lang M, Hirche S, et al. Data augmentation of wearable sensor data for parkinson’s disease monitoring using convolutional neural networks. In: Proceedings of the 19th ACM International Conference on Multimodal Interaction, ICMI ’17. New York, NY, USA: Association for Computing Machinery (2017). p. 216–20. Available from: https://doi.org/10.1145/3136755.3136817.
25. Jalal A, Quaid MAK, Tahir SBUD, Kim K. A study of accelerometer and gyroscope measurements in physical life-log activities detection systems. Sensors. (2020) 20(22):6670. doi: 10.3390/s20226670
26. Tian C, Xu Z, Wang L, Liu Y. Arc fault detection using artificial intelligence: challenges and benefits. Math Biosci Eng. (2023) 20:12404–32. doi: 10.3934/mbe.2023552
27. Lusardi MM, Fritz S, Middleton A, Allison L, Wingood M, Phillips E, et al. Determining risk of falls in community dwelling older adults: a systematic review and meta-analysis using posttest probability. J Geriatr Phys Ther. (2017) 40:1. doi: 10.1519/JPT.0000000000000099
28. Montero-Odasso M, van der Velde N, Martin FC, Petrovic M, Tan MP, Ryg J, et al. World guidelines for falls prevention and management for older adults: a global initiative. Age Ageing. (2022) 51:afac205. doi: 10.1093/ageing/afac205
29. Hernandez N, Lundström J, Favela J, McChesney I, Arnrich B. Literature review on transfer learning for human activity recognition using mobile and wearable devices with environmental technology. SN Comput Sci. (2020) 1:1–16. doi: 10.1007/s42979-020-0070-4
30. Shi Y, Li L, Yang J, Wang Y, Hao S. Center-based transfer feature learning with classifier adaptation for surface defect recognition. Mech Syst Signal Process. (2023) 188:110001. doi: 10.1016/j.ymssp.2022.110001
31. Yang P, Yang C, Lanfranchi V, Ciravegna F. Activity graph based convolutional neural network for human activity recognition using acceleration and gyroscope data. IEEE Trans Ind Inform. (2022) 18:6619–30. doi: 10.1109/TII.2022.3142315
32. Liu Z, Yang D, Wang Y, Lu M, Li R. EGNN: graph structure learning based on evolutionary computation helps more in graph neural networks. Appl Soft Comput. (2023):110040. doi: 10.1016/j.asoc.2023.110040
33. Li C, Liu M, Yan X, Teng G. Research on CNN-BiLSTM fall detection algorithm based on improved attention mechanism. Appl Sci. (2022) 12(19):9671. doi: 10.3390/app12199671
34. Shi Y, Li H, Fu X, Luan R, Wang Y, Wang N, et al. Self-powered difunctional sensors based on sliding contact-electrification and tribovoltaic effects for pneumatic monitoring and controlling. Nano Energy. (2023) 110:108339. doi: 10.1016/j.nanoen.2023.108339
35. Qi W, Aliverti A. A multimodal wearable system for continuous and real-time breathing pattern monitoring during daily activity. IEEE J Biomed Health Inform. (2019) 24:2199–207. doi: 10.1109/JBHI.2019.2963048
Keywords: near-fall, perturbation, CNN, machine learning, IMU, fall risk, mobile health
Citation: Hellmers S, Krey E, Gashi A, Koschate J, Schmidt L, Stuckenschneider T, Hein A and Zieschang T (2023) Comparison of machine learning approaches for near-fall-detection with motion sensors. Front. Digit. Health 5:1223845. doi: 10.3389/fdgth.2023.1223845
Received: 16 May 2023; Accepted: 6 July 2023;
Published: 26 July 2023.
Edited by:
Alessandro Blasimme, ETH Zürich, SwitzerlandReviewed by:
Hang Su, Fondazione Politecnico di Milano, ItalyAlpha Agape Gopalai, Monash University Malaysia, Malaysia
© 2023 Hellmers, Krey, Gashi, Koschate, Schmidt, Stuckenschneider, Hein and Zieschang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Sandra Hellmers sandra.hellmers@uni-oldenburg.de