Hybrid Graph-Recurrent Architectures for Spatio-Temporal Motion Analysis and Fall Forecasting

Main Article Content

Asyafa Ditra Al Hauna
Masanori Fukui

Abstract

Falls constitute a predominant etiology of injury across demographic spectra and represent a significant contributor to morbidity, mortality, and escalating healthcare expenditures in Australia. Mitigating such incidents necessitates integrating intelligent surveillance systems capable of preemptive detection and rapid intervention. To support these goals, our study advances a deep learning model designed to anticipate and classify fall-related human motion by modeling the intricate spatiotemporal interdependencies inherent in bodily dynamics. The proposed approach is developed and evaluated exclusively using the TelUP dataset. Among our exploration on graph-recurrent models, GCN-GRU operationalizes a synergistic representation of spatial posture and temporal progression to forecast imminent falls with heightened precision. Empirical validation reveals a marked performance improvement over extant baselines, attaining an accuracy of 97.40%, an F1-score of 96.89%, a mean per-joint position error (MPJPE) of 113.4 pixels, and a mean per-joint velocity error (MPJVE) of 64.66 pixels. Supplementary analyses concerning computational complexity and comparative visual evaluation corroborate the model’s superior efficacy relative to prevailing architectures, notably outperforming the LSTM benchmark. Future work will evaluate the proposed approach across additional public datasets and real-world deployment settings to assess robustness while accounting for inference-intervention latency under variations in physical environments.


Manuscript received: 01 Feb 2026 | Revised: 27 Mac 2026 |  Accepted: 29 Apr 2026 | Published: 31 Jul 2026

Article Details

How to Cite
Al Hauna, A. D., & Fukui, M. (2026). Hybrid Graph-Recurrent Architectures for Spatio-Temporal Motion Analysis and Fall Forecasting. International Journal on Robotics, Automation and Sciences, 8(2), 62–73. https://doi.org/10.33093/ijoras.2026.8.2.8
Section
4th International Article Writing Competition 2026

References

D. Basak, A.A. Anthony, N. Banerjee, S. Rath, S. Chatterjee, K.D. Soni, N. Sharma, T. Ogawa, G. O'Reilly, J. Attergrim, M.G. Warnberg and N. Roy, "Mortality from fall: A descriptive analysis of a multicenter Indian trauma registry," Injury, vol. 53, no. 12, pp. 3956-3961, 2022.

DOI: https://doi.org/10.1016/j.injury.2022.09.048

P.H. Pelicioni, L.L. Chan, S. Shi, K. Wong, L. Kark, Y. Okubo and M.A. Brodie, "Impact of mobile phone use on accidental falls risk in young adult pedestrians," Heliyon, vol. 9, no. 8, pp. e18366, 2023.

DOI: https://doi.org/10.1016/j.heliyon.2023.e18366

G.S. Kim, M.K. Park, J.J. Lee, L. Kim, J.Y. Lee and N. Kim, "Situational and environmental risk factors associated with home falls among community-dwelling older adults: Visualization of disparities between actual and perceived risks," Geriatric Nursing, vol. 62, pp. 221-228, 2025.

DOI: https://doi.org/10.1016/j.gerinurse.2025.02.006

K.J. Burdick, A.P. Coulter and M. Tirabassi, "Prehospital Transport Time and Outcomes for Pediatric Trauma: A National Study," Journal of Surgical Research, vol. 292, pp. 144-149, 2023.

DOI: https://doi.org/10.1016/j.jss.2023.07.041.

Australian Institute of Health and Welfare, “Falls.” Accessed: Jan. 28, 2026. [Online]. Available: https://www.aihw.gov.au/reports/injury/falls

T.E. Lockhart, R. Soangra, H. Yoon, T. Wu, C.W. Frames, R. Weaver and K.A. Roberto, "Prediction of fall risk among community-dwelling older adults using a wearable system," Scientific Reports, vol. 11, no. 1, 2021.

DOI: https://doi.org/10.1038/s41598-021-00458-5

S. Subramaniam, A.I. Faisal and M.J. Deen, "Wearable Sensor Systems for Fall Risk Assessment: A Review," Frontiers in Digital Health, vol. 4, 2022.

DOI: https://doi.org/10.3389/fdgth.2022.921506

A. Latif, H.F.A. Janabi, M. Joshi, G. Fusari, L. Shepherd, A. Darzi and D.R. Leff, "Use of commercially available wearable devices for physical rehabilitation in healthcare: a systematic review," BMJ Open, vol. 14, no. 11, pp. e084086, 2024.

DOI: https://doi.org/10.1136/bmjopen-2024-084086

J. Hu, S. Wang, Y. Shen and X. Miao, "A Wearable System for Knee Osteoarthritis: Based on Multimodal Physiological Signal Assessment and Intelligent Rehabilitation," Sensors, vol. 25, no. 23, pp. 7334, 2025.

DOI: https://doi.org/10.3390/s25237334

S. Saurav, R. Saini and S. Singh, "A dual-stream fused neural network for fall detection in multi-camera and 360 videos," Neural Computing and Applications, vol. 34, no. 2, pp. 1455-1482, 2022.

DOI: https://doi.org/10.1007/s00521-021-06495-5

A.P. Yunus, N.C. Shirai, K. Morita and T. Wakabayashi, "Comparison of RNN-LSTM and Kalman Filter Based Time Series Human Motion Prediction," Journal of Physics: Conference Series, vol. 2319, no. 1, pp. 012034, 2022.

DOI: https://doi.org/10.1088/1742-6596/2319/1/012034

A. Widiyanto, R.G. Candraningtyas, A.H.H. F.F, M. Prameswari, H. Bashiran, G.N. Surahmat, B.A. Rahmah, A.A.I.C.M. Dewi and A.P. Yunus, "TelUP Human Fall Dataset: A Motion Forecasting Study of Human Falls," JURNAL INFOTEL, vol. 17, no. 3, pp. 456-471, 2025.

DOI: https://doi.org/10.20895/infotel.v17i3.1420

B. Huang and X. Li, "GGTr: An Innovative Framework for Accurate and Realistic Human Motion Prediction," Electronics, vol. 12, no. 15, pp. 3305, 2023.

DOI: https://doi.org/10.3390/electronics12153305

A. Bharathi, R. Sanku, M. Sridevi, S. Manusubramanian and S.K. Chandar, "Real-time human action prediction using pose estimation with attention-based LSTM network," Signal, Image and Video Processing, vol. 18, no. 4, pp. 3255-3264, 2024.

DOI: https://doi.org/10.1007/s11760-023-02987-0

M. Lovanshi, V. Tiwari and S. Jain, "3D Skeleton-Based Human Motion Prediction Using Dynamic Multi-Scale Spatiotemporal Graph Recurrent Neural Networks," IEEE Transactions on Emerging Topics in Computational Intelligence, vol. 8, no. 1, pp. 164-174, 2024.

DOI: https://doi.org/10.1109/TETCI.2023.3318985

L. Chen, R. Liu, X. Yang, D. Zhou, Q. Zhang and X. Wei, "STTG-net: a Spatio-temporal network for human motion prediction based on transformer and graph convolution network," Visual Computing for Industry, Biomedicine, and Art, vol. 5, no. 1, 2022.

DOI: https://doi.org/10.1186/s42492-022-00112-5

A.P. Yunus, K. Morita, N.C. Shirai and T. Wakabayashi, "Temporal-Spatial Time Series Self-Attention 2D & 3D Human Motion Forecasting," 2023 IEEE International Conference on Industry 4.0, Artificial Intelligence, and Communications Technology (IAICT), pp. 66-72, 2023.

DOI: https://doi.org/10.1109/IAICT59002.2023.10205596

H. Choi, G. Moon and K.M. Lee, "Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Pose," Lecture Notes in Computer Science, pp. 769-787, 2020.

DOI: https://doi.org/10.1007/978-3-030-58571-6_45

T. N. Kipf and M. Welling, “Semi-Supervised Classification with Graph Convolutional Networks,” Proceedings of the 5th International Conference on Learning Representations (ICLR 2017), 2017.

DOI: https://doi.org/10.48550/arXiv.1609.02907

P. Velickovic, G. Cucurull, A. Casanova, A. Romero, P. Lio, and Y. Bengio, “Graph Attention Networks”, International Conference on Learning Representations, 2018.

DOI: https://doi.org/10.48550/arXiv.1710.10903

A. Hikmah, S. Adi and M. Sulistiyono, "The Best Parameter Tuning on RNN Layers for Indonesian Text Classification," 2020 3rd International Seminar on Research of Information Technology and Intelligent Systems (ISRITI), pp. 94-99, 2020.

DOI: https://doi.org/10.1109/ISRITI51436.2020.9315425

S. Hochreiter and J. Schmidhuber, "Long Short-Term Memory," Neural Computation, vol. 9, no. 8, pp. 1735-1780, 1997.

DOI: https://doi.org/10.1162/neco.1997.9.8.1735

A. Shukurlu, “Improving Deep Knowledge Tracing via Gated Architectures and Adaptive Optimization,” arXiv preprint arXiv:2504.20070, 2025.

DOI: https://doi.org/10.48550/arXiv.2504.20070

J. Chung, C. Gulcehre, K. Cho, and Y. Bengio, “Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling,” arXiv preprint arXiv:1412.3555, 2014.

DOI: https://doi.org/10.48550/arXiv.1412.3555

A. Bouazizi, A. Holzbock, U. Kressel, K. Dietmayer and V. Belagiannis, "MotionMixer: MLP-based 3D Human Body Pose Forecasting," Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, pp. 791-798, 2022.

DOI: https://doi.org/10.24963/ijcai.2022/111

D. M. W. Powers, “Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation”, arXiv:2010.16061, 2020.

DOI: https://doi.org/10.48550/arXiv.2010.16061

T. Fawcett, "An introduction to ROC analysis," Pattern Recognition Letters, vol. 27, no. 8, pp. 861-874, 2006.

DOI: https://doi.org/10.1016/j.patrec.2005.10.010

N.J.D. NAGELKERKE, "A note on a general definition of the coefficient of determination," Biometrika, vol. 78, no. 3, pp. 691-692, 1991.

DOI: https://doi.org/10.1093/biomet/78.3.691

Y. Ji, "calflops: A FLOPs and Params calculate tool for neural networks in PyTorch framework," 2023. [Online]. Available: https://github.com/MrYxJ/calculate-flops.pytorch