Development of Augmented Reality Based Applications for Brain Memory Training

Main Article Content

Zheng You Lim
Toa Chean Khim
Rao Edwin
Sim Kok Swee

Abstract

This paper presents the development of augmented reality (AR) based brain memory training to improve the memorizing capability of the student. The AR visual memory training application is built on top of the mobile phone by utilizing the Unity and Vuforia platform. The developed visual memory test is a flipping card test that can measure a person’s memory capability to retain visual images and spatial perception in the mind. In this study, it is aimed to prove that AR technology is suitable to be employed in the education field. The results are justified based on the visual memory test score and the engaging level of the user computed from the electroencephalogram (EEG) signal. The results are assessed by comparing with the physical mode and computer-based mode. As result, it is shown that the student performed better in the AR-based visual memory test compared to physical and computer-based modes. Besides, the EEG signals also show that students are more engaged and attentive while using AR technology. Thus, this research proves that AR technology implemented in the education field is able to uplift the learning experience and performance of the students. This research might contribute to the first step in revolutionize the traditional learning method in Malaysia education system.


 


(Manuscript received: 17 November 2021 | Accepted: 24 April 2022 | Published: 30 April 2023)

Article Details

How to Cite
Lim, Z. Y., Toa, C. K., Rao, E. ., & Sim, K. S. (2023). Development of Augmented Reality Based Applications for Brain Memory Training . International Journal on Robotics, Automation and Sciences, 5(1), 13–20. https://doi.org/10.33093/ijoras.2023.5.1.3
Section
Articles

References

Z. Y. Lim, K. S. Sim, and S. C. Tan, “An Evaluation of Left and Right Brain Dominance using Electroencephalogram Signal”, Engineering Letters, vol. 28, no. 4, pp. 1358-1367, 2020.

N. F. Saidin, N. D. A.Halim, and N. Yahaya, “A review of research on augmented reality in education: Advantages and applications”, International education studies, vol. 8, no.13, pp. 1-8, 2015

C. K. Toa, K. S. Sim and S. C. Tan, "Electroencephalogram-Based Attention Level Classification Using Convolution Attention Memory Neural Network," in IEEE Access, vol. 9, pp. 58870-58881, 2021.

M. Sirakaya and D. A. Sirakaya, “Trends in educational AR studies: a systematic review,” Malaysian Online Journal of Educational Technology, vol.6, no. 2, pp. 60–74, 2018.

J. Martín-Gutiérrez, P. Fabiani, W. Benesova, M. D. Meneses, and C. E. Mora, “AR to promote collaborative and autonomous learning in higher education,” Computers in Human Behavior, vol. 51, pp. 752–761, 2015.

H. Wu, S. W. Lee, H. Chang, and J. Liang, “Current status, opportunities and challenges of AR in education,” Computers and Education, vol. 62, pp. 41–49, 2013.

K. Cheng and C. Tsai, “Affordances of AR in science learning: suggestions for future research,” Journal of Science Education and Technology, vol. 22, no. 4, pp. 449–462, 2013.

C.K. Toa, K.S. Sim, and S.C. Tan, “Emotiv Insight with Convolutional Neural Network: Visual Attention Test Classification”, Advances in Computational Collective Intelligence, vol. 1463, pp 348-357, 2021.

Y. Kuang and X. Bai, "The Feasibility Study of Augmented Reality Technology in Early Childhood Education," 2019 14th International Conference on Computer Science & Education (ICCSE), 2019, pp. 172-175.

V. Chrisna, Leonardo and T. G. Satria, “Kotak Edu: An Educational Augmented Reality Game for Early Childhood”, Journal of Physics: Conference Series, vol.1844, 2020.

J. Bacca, S. Baldiris, R. Fabregat et al., “AR trends in education: a systematic review of research and applications,” Journal of Educational Technology and Society, vol. 17, no. 4, pp. 133–149, 2014.

X. Wei, D. Weng, Y. Liu, and Y. Wang, “Teaching based on AR for a technical creative design course,” Computers and Education, vol. 81, pp. 221–234, 2015.

V. Gopalan, A. N. Zulkifli, and J. A. A. Abubakar, “A study of students’ motivation using the AR science textbook,” AIP Conference Proceedings, vol. 1761, no. 1, pp. 27–35, 2016

S. Jacob, M. Warde and P. Dumane, "Impact of Augmented Reality as an ICT tool to Deliver Engineering Education Content," 2020 International Conference on Convergence to Digital World - Quo Vadis (ICCDW), pp. 1-5, 2020.

A. Álvarez-Marín, J. Á. Velázquez-Iturbide and M. Castillo-Vergara, "Intention to use an interactive AR app for engineering education," 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), pp. 70-73, 2020.

Neil Charness, Walter R. Boot, “Technology, Gaming, and Social Networking”, Handbook of the Psychology of Aging (Eighth Edition), pp. 389-407, 2016.

K. L Lew, K.S Sim, S.C Tan, S. A. Fazly, “Virtual reality post stroke upper limb assessment using Unreal Engine 4”, Engineering Letters, vol. 29, no. 4, pp. 1511-1523, 2021.

C.C Lim, K.S Sim, C. K Toa, “Development of Visual-based Rehabilitation Using Sensors for Stroke Patient”, International Journal On Robotics, Automation And Sciences, vol.2, no.1, pp.25-30, 2020.

EMOTIV, “Insight Brainwear® 5 Channel Wireless EEG Headset | EMOTIV,” EMOTIV Inc., 2013. https://www.emotiv.com/insight/ (accessed Oct. 18, 2021).

K.S Sim, Z.Y Lim, T.K. Kho, “EEG Controlled Wheelchair”, MATEC Web of Conferences, vol. 51, pp 18-25, 2016.

P. A. Abhang, B. W. Gawali, and S. C. Mehrotra, “Chapter 3 - Technical Aspects of Brain Rhythms and Speech Parameters,” in Introduction to EEG- and Speech-Based Emotion Recognition, P. A. Abhang, B. W. Gawali, and S. C. Mehrotra, Eds. Academic Press, 2016, pp. 51–79.