Intelligent Telemedicine Systems for Contactless Heart Rate Estimation using Deep Learning-based rPPG
Article Sidebar
Main Article Content
Abstract
Over the last ten years, telemedicine has undergone significant developments, from simple communication-based healthcare to smart and data-driven solutions. The solutions are now powered by Artificial Intelligence (AI), Machine Learning (ML), and Internet of Medical Things (IoMT) technologies. Physiological monitoring is traditionally done with contact-based sensors. The sensors include Electrocardiogram (ECG) and pulse oximeters. The sensors have various disadvantages, including hardware costs, difficulty in continuous usage, and discomfort for patients. Photoplethysmography (rPPG), a remote method of physiological monitoring, is a breakthrough technology. The method is used to estimate physiological signals, including Heart Rate (HR), from video streams captured by standard RGB cameras. The paper aims to explore spatial-temporal deep learning frameworks for remote rPPG as part of a standard five-layer telemedicine architecture. We explain a general ML pipeline, along with the benefits of decomposing the spatial and temporal features of images and motion to improve signal extraction against environmental noise. Besides, the paper presents some of the deployment issues, which include motion effects, lighting, as well as bias in the algorithms, specifically with respect to melanin absorption in human skin. The research also presents some of the avenues of future research, specifically with respect to model compression, which will help move from a cloud to an edge device, thus helping to improve the privacy of users.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
All articles published in JIWE are licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) License. Readers are allowed to
- Share — copy and redistribute the material in any medium or format under the following conditions:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use;
- NonCommercial — You may not use the material for commercial purposes;
- NoDerivatives — If you remix, transform, or build upon the material, you may not distribute the modified material.
References
P. C. Ahanotu, D. A. Adedigba, R. Hasan, and S. Palaniappan, “Deep learning-based automatic detection and diagnosis of tuberculosis from chest X-ray images: A comprehensive analysis,” Journal of Informatics and Web Engineering, vol. 5, no. 1, pp. 69–85, Feb. 2026, doi: 10.33093/jiwe.2026.5.1.5.
S. Palaniappan, R. Logeswaran, K. Subaramaniam, O. Baker, and B. N. Dung, “Training the brain: A machine learning approach to predicting wellbeing through intentional thought pattern modification,” Journal of Informatics and Web Engineering, vol. 4, no. 3, pp. 64–89, Oct. 2025, doi: 10.33093/jiwe.2025.4.3.4.
M. Rossi, and S. Rehman, “Integrating artificial intelligence into telemedicine: Evidence, challenges, and future directions,” Cureus, vol. 17, no. 8, 2025, doi: 10.7759/cureus.90829.
U. Chaturvedi, S. B. Chauhan, and I. Singh, “The impact of artificial intelligence on remote healthcare: Enhancing patient engagement connectivity and overcoming challenges,” Intelligent Pharmacy, 2025, doi: 10.1016/j.ipha.2024.12.003.
W. Wang, A. C. den Brinker, S. Stuijk, and G. de Haan, “Algorithmic principles of remote PPG,” in IEEE Transactions on Biomedical Engineering, vol. 64, no. 7, pp. 1479-1491, July 2017, doi: 10.1109/TBME.2016.2609282.
J. Allen, “Photoplethysmography and its application in clinical physiological measurement,” Physiological Measurement, vol. 28, no. 3, pp. R1–R39, 2007, doi: 10.1088/0967-3334/28/3/r01.
W. Verkruysse, L. O. Svaasand, and J. S. Nelson, “Remote plethysmographic imaging using ambient light,” Optics Express, vol. 16, no. 26, pp. 21434, 2008, doi: 10.1364/oe.16.021434.
M. Poh, D. McDuff, and R. W. Picard, “Non-contact, automated cardiac pulse measurements using video imaging and blind source separation,” Optics Express, vol. 18, no. 10, pp. 10762, 2010, doi: 10.1364/oe.18.010762.
G. de Haan, and V. Jeanne, “Robust pulse rate from chrominance-based rPPG,” in IEEE Transactions on Biomedical Engineering, vol. 60, no. 10, pp. 2878-2886, Oct. 2013, doi: 10.1109/TBME.2013.2266196.
Z. Yu, W. Peng, X. Li, X. Hong, and G. Zhao, “Remote Heart Rate Measurement From Highly Compressed Facial Videos: An end-to-end deep learning solution with video enhancement,” 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 151–160, 2019, doi: 10.1109/iccv.2019.00024.
Z. Yu et al., “PhysFormer++: Facial video-based physiological measurement with slowfast temporal difference transformer,” International Journal of Computer Vision, vol. 131, no. 6, pp. 1307–1330, 2023, doi: 10.1007/s11263-023-01758-1.
W. Chen and D. McDuff, “DeepPhys: Video-based physiological measurement using convolutional attention networks,” Lecture Notes in Computer Science, pp. 356–373, 2018, doi: 10.1007/978-3-030-01216-8_22.
W. -N. Lie, D. Q. Le, P. -H. Huang, G. -H. Fu, A. Nguyen Thi Quynh, and Q. Nguyen Quang Nhu, “A two-stream deep-learning network for heart rate estimation from facial image sequence,” in IEEE Sensors Journal, vol. 24, no. 24, pp. 42343-42351, Dec.15, 2024, doi: 10.1109/JSEN.2024.3483629.
V. K. Damera, R. Cheripelli, N. Putta, G. Sirisha, and D. Kalavala, “Enhancing remote patient monitoring with AI driven IoMT and cloud computing technologies,” Scientific Reports, vol. 15, no. 1, p. 24088, 2025, doi: 10.1038/s41598-025-09727-z.
S. Bobbia, R. Macwan, Y. Benezeth, A. Mansouri, and J. Dubois, “Unsupervised skin tissue segmentation for remote photoplethysmography,” Pattern Recognition Letters, vol. 124, pp. 82–90, 2019, doi: 10.1016/j.patrec.2017.10.017.
R. Stricker, S. Muller, and H. -M Gross, “Non-contact video-based pulse rate measurement on a mobile service robot,” The 23rd IEEE International Symposium on Robot and Human Interactive Communication, pp. 1056–1062, 2014, doi: 10.1109/roman.2014.6926392.
Z. Yu, X. Li, and G. Zhao, "Remote photoplethysmograph signal measurement from facial videos using spatio-temporal networks," in Proceedings of the British Machine Vision Conference (BMVC), 2019.
R. Song, H. Chen, J. Cheng, C. Li, Y. Liu, and X. Chen, “PulseGAN: Learning to generate realistic pulse waveforms in remote photoplethysmography,” in IEEE Journal of Biomedical and Health Informatics, vol. 25, no. 5, pp. 1373-1384, May 2021, doi: 10.1109/JBHI.2021.3051176.
S. Majumder, T. Mondal, and M. J. Deen, “Wearable Sensors for Remote Health Monitoring,” Sensors, vol. 17, no. 1, pp. 130, 2017, doi: 10.3390/s17010130.
E. M. Nowara et al., “Towards a deeper understanding of skin tone and motion in remote photoplethysmography,” CVPR Workshops, 2021.
E. Lee, E. Chen, and C.-Y. Lee, “Meta-rPPG: Remote heart rate estimation using a transductive meta-learner,” in Proceedings of the European Conference on Computer Vision (ECCV), 2020.
J. Gideon, and S. Stent, “The way to my heart is through contrastive learning: Remote Photoplethysmography from unlabelled video,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021.
H. Yu, H. Lee, and K. Sohn, “Multi-scale spatio-temporal feature learning for remote photoplethysmography,” in Proceedings of the Asian Conference on Computer Vision (ACCV), 2022.
Z. Chen, W. Wang, and A. C. Bovik, “AND-rPPG: Adaptive Noise Decoupling for Robust Remote Photoplethysmography,” in Proceedings of the IEEE International Conference on Image Processing (ICIP), 2022.
Y. Niu, H. Luo, and W. Wang, “STI: Spatio-temporal interaction network for remote photoplethysmography estimation,” IEEE Transactions on Instrumentation and Measurement, 2022.
J. Cheng, H. Chen, and X. Chen, “rPPG-FuseNet: Remote photoplethysmography estimation via multi-feature fusion network,” IEEE Access, 2022.
C. Zhao, M. Zhou, W. Han, and Y. Feng, “Anti-motion remote measurement of heart rate based on region proposal generation and multi-scale ROI fusion,” in IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1-13, Art no. 5012413, 2022, doi: 10.1109/TIM.2022.3169567.
Z. Zhang, H. Wang, and L. Yin, “CPulse: Camera-based pulse estimation via deep learning,” in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023.
H. Li, X. Chen, and Y. Wang, “REA: Robust efficient attention network for remote photoplethysmography,” Biomedical Signal Processing and Control, 2023.
X. Liu, H. Wang, and Z. Yu, “STSC + MHFF: Spatio-temporal signal compensation with multi-head feature fusion for rPPG estimation,” in Proceedings of the IEEE International Conference on Multimedia and Expo (ICME), 2023.
X. Ma, Z. Wang, X. Liu, and H. Kuang, “CMRPPGFormer: 3-D Spatio-temporal convolutional modulation transformer network for remote heart rate estimation,” in IEEE Sensors Journal, vol. 24, no. 19, pp. 30275-30286, Oct.1, 2024, doi: 10.1109/JSEN.2024.3407816.
S. -Q. Liu, and P. C. Yuen, “Robust remote photoplethysmography estimation with environmental noise disentanglement,” in IEEE Transactions on Image Processing, vol. 33, pp. 27-41, 2024, doi: 10.1109/TIP.2023.3330108.
M. Amin et al., “LGI-rPPG-Net: A Lightweight encoder–decoder network for remote photoplethysmography estimation,” Biomedical Signal Processing and Control, 2024.