Skip to main content

ORIGINAL RESEARCH article

Front. Bioeng. Biotechnol., 12 March 2024
Sec. Biomechanics

Comparison of kinematics and joint moments calculations for lower limbs during gait using markerless and marker-based motion capture

  • 1Sports Biomechanics Laboratory, College of Physical Education and Health, Wenzhou University, Wenzhou, China
  • 2Laboratory of Biomechanics and Rehabilitation Engineering, School of Medicine, Tongji University, Shanghai, China
  • 3TsingVA (Beijing) Technology Co., Ltd., Beijing, China
  • 4Key Laboratory of Exercise and Health Sciences, Ministry of Education, Shanghai University of Sport, Shanghai, China

Objective: This study aimed at quantifying the difference in kinematic and joint moments calculation for lower limbs during gait utilizing a markerless motion system (TsingVA Technology, Beijing, China) in comparison to values estimated using a marker-based motion capture system (Nokov Motion Capture System, Beijing, China).

Methods: Sixteen healthy participants were recruited for the study. The kinematic data of the lower limb during walking were acquired simultaneously based on the markerless motion capture system (120 Hz) and the marker-based motion capture system (120 Hz). The ground reaction force was recorded synchronously using a force platform (1,200 Hz). The kinematic and force data were input into Visual3D for inverse dynamics calculations.

Results: The difference in the lower limb joint center position between the two systems was the least at the ankle joint in the posterior/anterior direction, with the mean absolute deviation (MAD) of 0.74 cm. The least difference in measuring lower limb angles between the two systems was found in flexion/extension movement, and the greatest difference was found in internal/external rotation movement. The coefficient of multiple correlations (CMC) of the lower limb three joint moments for both systems exceeded or equaled 0.75, except for the ad/abduction of the knee and ankle. All the Root Mean Squared Deviation (RMSD) of the lower limb joint moment are below 18 N·m.

Conclusion: The markerless motion capture system and marker-based motion capture system showed a high similarity in kinematics and inverse dynamic calculation for lower limbs during gait in the sagittal plane. However, it should be noted that there is a notable deviation in ad/abduction moments at the knee and ankle.

1 Introduction

In the field of biomechanical research, the motion capture system plays a crucial role in the quantitative analysis of movement. It has been extensively used in sports injury analysis, sports performance improvement, and gait analysis (Quesada et al., 1996; Stone et al., 2013; Fuchs et al., 2019). However, marker-based (MB) systems come with inherent challenges that are hard to circumvent. These include the high cost of cameras, stringent requirements for the experimental environment, and errors in the estimation of joint center positions caused by incorrect placement of reflective markers by operators (Della Croce et al., 1999; Stagni et al., 2000; Mündermann et al., 2006). Additionally, skin movement can introduce noise interference, further complicating the data capture process (Sati et al., 1996; Holden et al., 1997; Fiorentino et al., 2017).

The advancement of artificial intelligence (AI) technology has significantly improved markerless motion capture systems (MMC) (Belić et al., 2019; Lam et al., 2023). MMC have outperformed MB systems in several aspects (e.g., automated capturing, simple operation, and suitability for capturing realistic motion scenarios) (Knippenberg et al., 2017). The Microsoft Kinect, exemplifying monocular MMC, employs RGB and depth images for the acquisition of human movements. Primarily designed for gaming applications, its capability to accurately delineate the subtleties of human motion within a three-dimensional context exhibits significant limitations. Multi-camera MMC may potentially compensate for the deficiencies of monocular cameras in capturing human motion.

Some previous studies have been conducted on the concurrent comparison of kinematic measurements obtained from MMC systems. For instance, Nakano et al. (Nakano et al., 2020) quantified the differences in lower limb joint center positions during walking, jumping, and throwing movements between MB and MMC systems. As indicated by their results, an OpenPose-based multi-camera MMC system could measure the movements of humans with a Mean Absolute Error (MAE) of less than 30 mm for 80% of the joint center positions. Kanko et al. (Kanko et al., 2021a; Kanko et al., 2021b) showed that the MMC system exhibited high accuracy in measuring gait speed, stride length, and stride width with a Root Mean Squared Deviation (RMSD) of less than 25 mm for all joint centers except for the hip joint center, where the RMSD exceeded 30 mm.

Besides kinematic analysis, inverse dynamics analysis serves as a fundamental method for investigating the movement. Inverse dynamics calculation uses kinematic and external force data and human model parameters to determine internal joint forces and moments that are not directly measurable during human movement (Winter, 2009). These parameters provided a quantitative basis for evaluating mechanical loads on the human body during motion (Holder et al., 2020). It is imperative to provide accurate and reliable inverse dynamic parameters to facilitate the widespread use of MMC systems in clinical and research applications. Given the significant role of kinetics data in biomechanical analysis, some researchers have conducted studies on the accuracy of measuring kinetics using MMC systems (Tang et al., 2022; Kanko et al., 2023; Song et al., 2023). For example, Tang et al. (Tang et al., 2022) compared lower extremity joint moments in the sagittal plane during running estimated by MB and MMC systems. As far as we know, however, the differences between these two methods have not been evaluated for lower extremity joint moments in three planes during gait.

This study aimed to compare the difference between the MMC and MB systems for calculating lower limb joint center positions, joint angles, and joint moments during gait.

2 Methods

2.1 Markerless motion capture system

Pixmotion (TsingVA Technology, Beijing, China) is a deep learning-based MMC system that captures human motion images and performs 3D human pose estimation (Cao et al., 2017). A deep convolution neural network (Sun et al., 2019) was trained on over 120,000 images of humans in the wild, with 25 human joints manually labeled for each instance. Pix-Motion estimates 25 skeleton joints on 2D images (Cao et al., 2017). The human 3D skeleton is calculated by combining multi-view 2D pose information from 8 cameras, using Direct Linear Transformation (DLT) for camera calibration to map 3D spatial coordinates to 2D image plane coordinates, thus enabling 3D scene reconstruction from 2D images. A Skinned Multi-Person Linear (SMPL) model was fitted, and the human mesh was recovered. Next, a neural blend shapes method (Li et al., 2021) was used to output more than 6,000 vertices on the skin. Finally, 39 human mesh vertices were manually extracted, corresponding to the positions of reflective markers used in the MB system (Figure 1).

FIGURE 1
www.frontiersin.org

FIGURE 1. The technology of the MMC system.

2.2 Participants

This study was conducted at Peak Sport Science Laboratory in Xiamen, China, with 16 healthy participants (Table 1). The participants provided written informed consent before the commencement of the study, and the institutional ethics committee approved the experimental procedure used in this study. Participants were not engaged in intense exercise within 24 h before the experiment, and no participants had a history of lower limb injury.

TABLE 1
www.frontiersin.org

TABLE 1. Characteristics of participants (x¯ ±SD).

2.3 Experimental setup and procedure

An MB motion capture system (thirteen Mars 4H (Nokov Motion Capture System, Beijing, China), 4.1-megapixel resolution cameras) and an MMC system (eight Z-CAM-E2 (Intetech, Beijing, China), 120HZ, 8-megapixel resolution) were used to capture the movement synchronously.

Both systems were positioned around the runway. The MB cameras were affixed at an elevation of approximately 3 m from the ground, whereas the MMC cameras were placed on tripods at an approximate height of 1.5 m from the ground. The force platform (1200Hz, 9287CA, Kistler Instruments, Winterthur, Switzerland) was placed underground in the middle of the runway (Figure 2). The data collection from both systems and the force platform was synchronized in one click through a self-developed program. A common global coordinate system was built for both systems through the calibration procedure. A static calibration trial for both systems was collected, with the participants standing in the middle of the runway. A total of thirty-nine retroreflective markers were placed as follows: on both the left and right anterior superior iliac spines, iliac crests, greater trochanters of the femur, knee joints, and ankle joints. On each foot, four markers were affixed at the lateral malleolus of the first and fifth metatarsophalangeal joints, the toe, and the heel. In addition, on the lateral sides of both thighs and shanks, four clusters were affixed, with each cluster comprising four markers. Besides, a marker was affixed to the sacrum.

FIGURE 2
www.frontiersin.org

FIGURE 2. Overhead view experimental setup and markers’ locations on the body.

The participants performed three walking trials with at least six steps at a self-selected speed. Participants placed their 4th step on the force platform with the right foot. Retests were required if not done successfully. The initial contact toe-off events were determined using vertical ground reaction force thresholds (>10N for initial contact and <10N for toe-off), while the second contact was determined through kinematic data.

2.4 Data analysis

C3D files generated by MB and MMC systems are input in Visual3D (C-Motion, United States) for inverse dynamics calculations. The lower body kinematic chain in the skeletal model was constrained to have six degrees of freedom (DOF). Figure 3 illustrates the processing workflow following data collection. The raw 3D coordinate data were filtered with a fourth-order Butterworth low-pass filter at 6 Hz, and force data were filtered at 100 Hz. Force-based gait events were used to obtain time-normalized gait cycles. The duration of each stride cycle was scaled to 101 data points.

FIGURE 3
www.frontiersin.org

FIGURE 3. Summary of the workflow.

Joint center positions, joint angles, and joint moments of the lower limb were calculated using the Visual3D models. The right ankle centers were determined by the proximal end of the right shank, the right knee centers by the distal end of the right thigh, and the right hip centers by the proximal end of the right thigh. Joint angles were determined using a Cardan sequence (Grood and Suntay, 1983). The joint moments for both systems were estimated using the inverse dynamics approach (Winter, 2009).

The similarity between the measurement of the two systems was increased with the decrease of the value of RMSD and MAD. The measurement difference of the MMC system was examined using the Coefficient of Multiple Correlation (CMC) (Kadaba et al., 1989) (Eq. 1), MAD, and RMSD (Shcherbakov et al., 2013). The difference of joint moment peak time between MMC and MB was done by performing two-tailed paired t-tests, p-value 0.05 was assumed to be significant.

CMC=1s=1Sj=1Jt=1TXsjtXt¯2/TSJ1S=1Sj=1Jt=1TXsjtX¯2/JT1(1)

S represents the number of motion capture systems (MB and MMC systems); J represents the number of tests; T is the number of time points; Xsjt represents the t time point of the j test of the s system; Xt represents the average of all the curves at time t; X is the average of all the curves in the gait. In general, the CMC is classified into four levels:0.75–1 indicates high similarity, 0.5–0.74 indicates moderate similarity, 0.25–0.49 indicates low similarity, and below 0.25 indicates very low similarity (Ferrari et al., 2010).

3 Results

3.1 Joint center position

As shown in Figure 4, the difference in joint centers was the greatest in the superior/inferior direction, 3.21 cm, and the least difference was found at the ankle joint center in the posterior/anterior direction, with MAD of 0.74 cm.

FIGURE 4
www.frontiersin.org

FIGURE 4. Mean ± SD of differences (MMC–MB) in hip, knee, and ankle joint center positions in the anteroposterior, mediolateral, and internal/external directions during the gait cycle in 16 subjects. MAD is presented in the respective panel.

3.2 Joint angle

As shown in Figure 5, the least difference in measuring lower limb angles between the two systems was found in flexion/extension movement, 5.3°, 6.8°, and 6.5°. The greatest difference was found in int/external rotation movement, 8.5°, 9.5°, and 11.1°.

FIGURE 5
www.frontiersin.org

FIGURE 5. Mean ± SD of differences (MMC–MB) in hip, knee, and ankle joint angles in the Flexion/Extension, Ab/adduction, and Int/Ext Rotation movement during the gait cycle in 16 subjects. RMSD is presented in the respective panel.

3.3 Joint moment

Figure 6 shows the mean and variance of three-dimensional joint moments for the lower limb in the two systems. The RMSD between the systems was below 18 N m, with the smallest observed at the ankle joint at 4 N m and the largest at the hip joint at 17.1 N m. The similarity of the curves between both systems was above 0.75, except for the abduction/adduction moments at the knee and ankle joints, where the CMCs were 0.58 and 0.45, respectively. As shown in Table 2, paired t-tests revealed significant differences in the relative timing to peak moments between the MB and MMC systems, specifically for the first and second peak hip moments (HP1, HP2) and the first peak knee moment (KP1). The MMC system reached the peak of HP1 (MB: 5.45 ± 3.76, MMC: 1.35 ± 0.57) more rapidly but demonstrated slower timings for HP2 (MB: 48.5 ± 9.48, MMC: 54.9 ± 6.04) and KP1 (MB: 14.05 ± 1.47, MMC: 15.55 ± 1.88). However, the absolute mean differences observed between the systems for HP1, HP2, and KP1 represented only 4.1%, 6.4%, and 1.5% in the gait cycle. No significant differences were found between the systems when measuring the second peak knee moment (KP2) and the first peak ankle moment (AP1), with the mean difference for AP1 being only 0.2. Refer to Table 2 for more details.

FIGURE 6
www.frontiersin.org

FIGURE 6. Mean ± SD of MB (blue) and MMC system (red) in hip, knee, and ankle joint moment in Flexion/Extension, Ab/adduction, and Int/Ext Rotation movement during the gait cycle in 16 subjects. RMSD and CMC are presented in the respective panel. HP1 represents the hip’s first peak, HP2 represents the hip’s second peak, KP1 represents the knee’s first peak, KP2 represents the knee’s second peak, and AP1 represents the ankle’s first peak. For the gait phase, 0%–60% is the stance phase, and 60%–100% is the swing phase for the right foot.

TABLE 2
www.frontiersin.org

TABLE 2. Joint moments peak time as a percentage of gait cycle (mean, SD) for MB and MMC systems in sagittal plane.

4 Discussion

This study explored the differences in measuring lower limb joint centers, angles, and moments during gait between MMC and MB systems. It provided a comparative analysis of three-dimensional kinematic and kinetic data derived from both systems.

Compared with the MB system, the MMC system demonstrated a deviation of 0.74 cm in estimating the position of the ankle joint center in the anterior-posterior direction and a 3.21 cm discrepancy in the position of the hip joint center in the vertical direction. The angle differences of the hip, knee, and ankle joints in the sagittal plane were less than 7°. These findings are similar to the differences reported by Nakano et al. (Nakano et al., 2020) and Kanko et al. (Kanko et al., 2021a). Compared to MB systems, the difference in kinematic measurement accuracy of this MMC system is comparable to other MMC systems.

The similarity of waveforms between the joint moment measurements of the two systems was evaluated using CMC, a coefficient that quantifies the simultaneous effects of correlation, gain, and offset. The two systems were highly similar (CMC ≥ 0.75) in calculating lower limb joint moments in the horizontal and sagittal planes. The RMSD < 18 N m was close to the magnitude of difference in lower limb joint moments during weightlifting between both systems (Mehrizi et al., 2017). However, it was much smaller compared to the difference in lower limb joint moments during running between both systems (Tang et al., 2022). Given that we observed CMC greater than 0.8 in the curves within the sagittal plane, further examination of the difference in the relative timing to peak moments can enhance our understanding of the MMC system’s accuracy in gait detection. Regarding the relative timing to peak joint moment, our study found that the two systems showed a high similarity for the knee and ankle joint in the sagittal plane. The greater difference in joint moments and the relative timing to peak moment between the two systems found in a previous study may be due to greater soft tissue artifacts during running (Tang et al., 2022). The difference in joint moments primarily arose from differences in identifying the joint center position because we used the same force data to calculate the joint moment in both systems, and the moments were calculated using the Visual3D software. Important metrics for gait analysis include the relative timing to peak moments and the pattern of the moment curve. Identifying abnormalities in the metrics mentioned above can help trainers and doctors diagnose abnormal gait and perform interventions (e.g., designing targeted training programs and adding customized orthopedic equipment) (Milner, 2009; Harvi et al., 2016). The above-described parameters exhibit little difference in both systems. Although the difference of the MMC system on the abduction and adduction moments needs to be improved, the result on the flexion and extension moments suggests that the MMC system can identify and diagnose abnormal gait on the flexion and extension moments. A considerable number of abnormal gait patterns were reported in flexion-extension moments (Devita et al., 1998; Osada et al., 2021; Stief et al., 2021). For instance, Neckel et al. (Neckel et al., 2008) suggested that gait differences between stroke patients and the healthy population are reported mainly in the support phase, with stroke patients having greater hip extension and knee flexion moments than the healthy population. Consequently, the precise recording of the moment and the timing of moment peaks in the sagittal plane can significantly contribute to the utility of the MMC system in gait analysis applications. Considering the substantial variation in the curves on the frontal plane, we refrained from conducting an analysis of peak moments in that plane. Moreover, while the measurements of rotational moments exhibited commendable CMC values, the loss of information during feature recognition for these moments poses a challenge. Despite our efforts to compensate for this loss by imposing additional constraints in the calculation process, the discrepancies in angles for the rotational moments were still the most pronounced compared to the sagittal and coronal planes, leading to our decision to exclude their computation from the current analysis.

The differences produced by the MMC motion capture system were affected by several factors. Firstly, annotation bias in the training dataset of the MMC system would propagate to the point identification process, increasing the probability of large errors (Martinez et al., 2017). Given that the MMC system employs the SMPL algorithm, the shape parameters necessitate being acquired via image-based methods. However, the current system did not incorporate such data input and thus, relied on the standard body model provided by SMPL. Consequently, the unique body characteristics of the participants were not considered, potentially introducing a certain degree of bias to the generated model of 39 points. Nonetheless, as there were not particularly obese or underweight individuals among the participants, the error is relatively minor. Additionally, due to the utilization of different calibration rods for spatial calibration in the two systems, although manual alignment of the original coordinates was performed, the use of disparate calibration systems still induces a certain degree of error.

The measurement accuracy of the MMC system can be improved in several manners. Firstly, our training dataset was generated through manual annotation, where the margin of error is contingent upon the annotator’s expertise. To enhance the accuracy of the dataset in the later stages, especially for points with larger recognition errors, we plan to provide more specialized training for the standard annotators and employ a multi-person cross-validation annotation approach. Secondly, our current 2D pose tracking system relies on frame-by-frame detection, lacking temporal context between frames. To address this, we plan to develop a neural network that takes video clips as input, aiming to improve joint localization by leveraging temporal correlations. Thirdly, since an SMPL algorithm is employed in this study’s MMC motion capture system, individual differences between different participants may reduce the accuracy of recognition. In subsequent development, personalized data (e.g., the height and size of the subject) should be input into the system by inputting the image information, aiming to increase the SMPL fitting accuracy.

Despite the current limitations of the MMC motion capture system, as AI has been leaping forward, the measurement accuracy of the MMC motion capture system will be further improved, and the application prospects will be significantly expanded. This study indicates the potential for MMC motion capture systems to supplement or replace MB systems, facilitating the extension of human movement data collection from laboratory settings to real-world scenarios, which could significantly impact sports training and sports science research.

5 Conclusion

The MMC and MB systems showed a high similarity in kinematics and inverse dynamic calculation for lower limbs during gait in the sagittal plane. However, it should be noted that there is a notable deviation in ad/abduction moments at the knee and ankle.

Scope statement

This study aimed to provide a reference standard for the application of markerless systems by comparing the difference of marker-based and markerless motion capture systems in calculating the position of lower limb joint centers, joint angles, and joint moments.

Data availability statement

The raw data supporting the conclusion of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by the Shanghai University of Sport Research Ethics Committee. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any identifiable images or data included in this article.

Author contributions

TH: Data curation, Software, Writing–original draft. MR: Conceptualization, Funding acquisition, Supervision, Writing–review and editing. SH: Methodology, Software, Validation, Writing–review and editing. LF: Methodology, Software, Writing–review and editing. XW: Software, Supervision, Writing–review and editing.

Funding

The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. Grant: the National Natural Science Foundation of China number: 31871204.

Acknowledgments

We are grateful for the comments on the manuscript by Daisuke TAKESHITA at the University of Tokyo, the technical support from Xiongxiong Dong, an engineer at TsingVA (Beijing) Technology Co., Ltd., and the data processing assisted by Xiangming Li.

Conflict of interest

Author LF is employed by TsingVA (Beijing) Technology Co., Ltd.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Belić, M., Bobić, V., Badža, M., Šolaja, N., Đurić-Jovičić, M., and Kostić, V. S. J. C. N. (2019). Artificial intelligence for assisting diagnostics and assessment of Parkinson’s disease—a review. Clin. Neurol. Neurosurg. 184, 105442. doi:10.1016/j.clineuro.2019.105442

PubMed Abstract | CrossRef Full Text | Google Scholar

Cao, Z., Simon, T., Wei, S.-E., and Sheikh, Y. (2017). “Realtime multi-person 2d pose estimation using part affinity fields,” in Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA, July 21 2017 to July 26 2017, 7291–7299.

CrossRef Full Text | Google Scholar

Della Croce, U., Cappozzo, A., and Kerrigan, D. C. J. M. (1999). Pelvis and lower limb anatomical landmark calibration precision and its propagation to bone geometry and joint angles. Med. Biol. Eng. Comput. 37, 155–161. doi:10.1007/bf02513282

PubMed Abstract | CrossRef Full Text | Google Scholar

Devita, P., Hortobagyi, T., Barrier, J. J. M., and Sports, S. I. (1998). Gait biomechanics are not normal after anterior cruciate ligament reconstruction and accelerated rehabilitation. Med. Sci. Sports Exerc. 30, 1481–1488. doi:10.1097/00005768-199810000-00003

PubMed Abstract | CrossRef Full Text | Google Scholar

Ferrari, A., Cutti, A. G., and Cappello, A. J. G. (2010). A new formulation of the coefficient of multiple correlation to assess the similarity of waveforms measured synchronously by different motion analysis protocols. Gait Posture. 31, 540–542. doi:10.1016/j.gaitpost.2010.02.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Fiorentino, N. M., Atkins, P. R., Kutschke, M. J., Goebel, J. M., Foreman, K. B., and Anderson, A. E. (2017). Soft tissue artifact causes significant errors in the calculation of joint angles and range of motion at the hip. Gait Posture 55, 184–190. doi:10.1016/j.gaitpost.2017.03.033

PubMed Abstract | CrossRef Full Text | Google Scholar

Fuchs, P. X., Fusco, A., Bell, J. W., Von Duvillard, S. P., Cortis, C., Wagner, H. J. J. O. S., et al. (2019). Movement characteristics of volleyball spike jump performance in females. J. Sci. Med. Sport 22, 833–837. doi:10.1016/j.jsams.2019.01.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Grood, E. S., and Suntay, W. J. (1983). A joint coordinate system for the clinical description of three-dimensional motions: application to the knee. J. Biomech. Eng. 105 (2), 136–144. doi:10.1115/1.3138397

PubMed Abstract | CrossRef Full Text | Google Scholar

Harvi, F. H., Adam, G. C., Natalie, J. C., David, C. A., Sallie, M. C., Zuzana, M., et al. (2016). Knee kinematics and joint moments during gait following anterior cruciate ligament reconstruction: a systematic review and meta-analysis. Br. J. Sports Med. 50, 597–612. doi:10.1136/bjsports-2015-094797

PubMed Abstract | CrossRef Full Text | Google Scholar

Holden, J. P., Orsini, J. A., Siegel, K. L., Kepple, T. M., Gerber, L. H., and Stanhope, S. J. J. G. 1997. Surface movement errors in shank kinematics and knee kinetics during gait. Gait Posture 5, 217–227. doi:10.1016/s0966-6362(96)01088-0

CrossRef Full Text | Google Scholar

Holder, J., Trinler, U., Meurer, A., and Stief, F. J. F. I. B. (2020). A systematic review of the associations between inverse dynamics and musculoskeletal modeling to investigate joint loading in a clinical environment. Front. Bioeng. Biotechnol. 8, 603907. doi:10.3389/fbioe.2020.603907

PubMed Abstract | CrossRef Full Text | Google Scholar

Kadaba, M. P., Ramakrishnan, H., Wootten, M., Gainey, J., Gorton, G., and Cochran, G. J. J. O. O. R. (1989). Repeatability of kinematic, kinetic, and electromyographic data in normal adult gait. J. Orthop. Res. 7, 849–860. doi:10.1002/jor.1100070611

PubMed Abstract | CrossRef Full Text | Google Scholar

Kanko, R. M., Laende, E. K., Davis, E. M., Selbie, W. S., and Deluzio, K. J. J. J. O. B. (2021a). Concurrent assessment of gait kinematics using marker-based and markerless motion capture. J. Biomech. 127, 110665. doi:10.1016/j.jbiomech.2021.110665

PubMed Abstract | CrossRef Full Text | Google Scholar

Kanko, R. M., Laende, E. K., Strutzenberger, G., Brown, M., Selbie, W. S., Depaul, V., et al. (2021b). Assessment of spatiotemporal gait parameters using a deep learning algorithm-based markerless motion capture system. J. Biomech. 122, 110414. doi:10.1016/j.jbiomech.2021.110414

PubMed Abstract | CrossRef Full Text | Google Scholar

Kanko, R. M., Outerleys, J. B., Laende, E. K., Scott Selbie, W., and Deluzio, K. J. J. B. (2023). Comparison of concurrent and asynchronous running kinematics and kinetics from marker-based motion capture and markerless motion capture under two clothing conditions. J. Appl. Biomech. 22, 529537. doi:10.1101/2023.02.22.529537

CrossRef Full Text | Google Scholar

Knippenberg, E., Verbrugghe, J., Lamers, I., Palmaers, S., Timmermans, A., and Spooren, A. J. J. O. N., (2017). Markerless motion capture systems as training device in neurological rehabilitation: a systematic review of their use, application, target population and efficacy. J. Neuroeng. Rehabil. 14, 61–11. doi:10.1186/s12984-017-0270-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Lam, W. W., Tang, Y. M., and Fong, K. N. J. J. O. N., (2023). A systematic review of the applications of markerless motion capture (MMC) technology for clinical measurement in rehabilitation. J. Neuroeng. Rehabil. 20, 57–26. doi:10.1186/s12984-023-01186-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, P., Aberman, K., Hanocka, R., Liu, L., Sorkine-Hornung, O., and Chen, B. J. A. T. O. G. (2021). Learning skeletal articulations with neural blend shapes. ACM Trans. Graph. 40, 1–15. doi:10.1145/3450626.3459852

CrossRef Full Text | Google Scholar

Martinez, J., Hossain, R., Romero, J., and Little, J. J. (2017). “A simple yet effective baseline for 3d human pose estimation,” in Proceedings of the IEEE international conference on computer vision, Venice, Italy, 22-29 October 2017, 2640–2649.

CrossRef Full Text | Google Scholar

Mehrizi, R., Xu, X., Zhang, S., Pavlovic, V., Metaxas, D., and Li, K. J. A. E. (2017). Using a marker-less method for estimating L5/S1 moments during symmetrical lifting. Appl. Ergon. 65, 541–550. doi:10.1016/j.apergo.2017.01.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Milner, C. E. J. J. O. O. S. (2009). Is gait normal after total knee arthroplasty? Syst. Rev. literature 14, 114–120. doi:10.1007/s00776-008-1285-8

PubMed Abstract | CrossRef Full Text | Google Scholar

MüNDERMANN, L., Corazza, S., and Andriacchi, T. P. J. J. O. N. (2006). The evolution of methods for the capture of human movement leading to markerless motion capture for biomechanical applications. J. Neuroeng. Rehabil. 3, 6–11. doi:10.1186/1743-0003-3-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Nakano, N., Sakura, T., Ueda, K., Omura, L., Kimura, A., Iino, Y., et al. (2020). Evaluation of 3D markerless motion capture accuracy using OpenPose with multiple video cameras. Front. Sports Act. Living 2, 50. doi:10.3389/fspor.2020.00050

PubMed Abstract | CrossRef Full Text | Google Scholar

Neckel, N. D., Blonien, N., Nichols, D., and Hidler, J. J. J. O. N. (2008). Abnormal joint torque patterns exhibited by chronic stroke subjects while walking with a prescribed physiological gait pattern. J. Neuroeng. Rehabil. 5, 19–13. doi:10.1186/1743-0003-5-19

PubMed Abstract | CrossRef Full Text | Google Scholar

Osada, Y., Motojima, N., Kobayashi, Y., Yamamoto, S. J. A. O. R. R., and Translation, C. (2021). Abnormal gait movements prior to a near fall in individuals after stroke. Arch. Rehabil. Res. Clin. Transl. 3, 100156. doi:10.1016/j.arrct.2021.100156

PubMed Abstract | CrossRef Full Text | Google Scholar

Quesada, P., Mengelkoch, L., Hale, R., and Denniston, N. J. G. (1996). Kinetic assessment of marching while wearing military style backpacks. J. Ergonomics Soc. Korea 2, 201–202. doi:10.1016/0966-6362(96)80646-1

CrossRef Full Text | Google Scholar

Sati, M., De Guise, J. A., Larouche, S., and Drouin, G. J. T. K. (1996). Quantitative assessment of skin-bone movement at the knee. Knee 3, 121–138. doi:10.1016/0968-0160(96)00210-4

CrossRef Full Text | Google Scholar

Shcherbakov, M. V., Brebels, A., Shcherbakova, N. L., Tyukov, A. P., Janovsky, T. A., and Kamaev, V. A. E. J. W. A. S. J. (2013). A survey of forecast error measures. World Appl. Sci. J. 24, 171–176. doi:10.5829/idosi.wasj.2013.24.itmies.80032

CrossRef Full Text | Google Scholar

Song, K., Hullfish, T. J., Silva, R. S., Silbernagel, K. G., and Baxter, J. R. J. J. O. B. (2023). Markerless motion capture estimates of lower extremity kinematics and kinetics are comparable to marker-based across 8 movements. J. Biomech. 157, 111751. doi:10.1016/j.jbiomech.2023.111751

PubMed Abstract | CrossRef Full Text | Google Scholar

Stagni, R., Leardini, A., Cappozzo, A., Benedetti, M. G., and Cappello, A. J. J. O. B. (2000). Effects of hip joint centre mislocation on gait analysis results. J. Biomech. 33, 1479–1487. doi:10.1016/s0021-9290(00)00093-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Stief, F., Holder, J., Feja, Z., Lotfolahpour, A., Meurer, A., and Wilke, J. J. G. (2021). Impact of subject-specific step width modification on the knee and hip adduction moments during gait. Gait Posture 89, 161–168. doi:10.1016/j.gaitpost.2021.07.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Stone, E. E., Butler, M., Mcruer, A., Gray, A., Marks, J., and Skubic, M. (2013). “Evaluation of the microsoft Kinect for screening ACL injury,” in 2013 35th annual international conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan, 3-7 July 2013 (IEEE), 4152–4155.

PubMed Abstract | CrossRef Full Text | Google Scholar

Sun, K., Xiao, B., Liu, D., and Wang, J. (2019). “Deep high-resolution representation learning for human pose estimation,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Long Beach, CA, USA, June 15 2019 to June 20 2019, 5693–5703.

CrossRef Full Text | Google Scholar

Tang, H., Pan, J., Munkasy, B., Duffy, K., and Li, L. (2022). Comparison of lower extremity joint moment and power estimated by markerless and marker-based systems during treadmill running. Bioeng. (Basel) 9, 574. doi:10.3390/bioengineering9100574

CrossRef Full Text | Google Scholar

Winter, D. A. (2009). Biomechanics and motor control of human movement. New Jersey, United States: John Wiley & Sons.

Google Scholar

Keywords: 3D motion analysis, deep learning, artificail intelligence, joint moment, markerless motion capture

Citation: Huang T, Ruan M, Huang S, Fan L and Wu X (2024) Comparison of kinematics and joint moments calculations for lower limbs during gait using markerless and marker-based motion capture. Front. Bioeng. Biotechnol. 12:1280363. doi: 10.3389/fbioe.2024.1280363

Received: 20 August 2023; Accepted: 26 February 2024;
Published: 12 March 2024.

Edited by:

Scott Selbie, Theia Markerless Inc., Canada

Reviewed by:

Nobuyasu Nakano, National Institute of Advanced Industrial Science and Technology (AIST), Japan
Yunqi Tang, Shaanxi University of Science and Technology, China
Ye Ma, Ningbo University, China
Kuan Wang, Tongji University, China

Copyright © 2024 Huang, Ruan, Huang, Fan and Wu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Mianfang Ruan, cnVhbm1mQHlhaG9vLmNvbQ==

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.