SABAS: A Smartphone-Aided Training Simulator based on Virtual and Augmented Reality for Brain Anatomy Assessment

Authors

  • Emre Dandıl Department of Computer Engineering, Faculty of Engineering, Bilecik Seyh Edebali University, Bilecik ,Turkey
  • Zafer Serin Department of Computer Engineering, Institute of Science, Bilecik Seyh Edebali University, Bilecik ,Turkey
  • Yeşim Şenol Department of Medical Education, School of Medicine, Akdeniz University, Turkey

DOI:

https://doi.org/10.18662/brain/13.3/366

Keywords:

Brain anatomy, anatomy education, training simulator, virtual reality, augmented reality, mobile application

Abstract

Many application areas for augmented reality (AR) and virtual reality (VR) emerged with the technological advances. These technologies, which initially appeared in sectors such as entertainment and games, are now widely used in the field of health care. In this study, a traditional simulator named SABAS is designed with its all components to be used in the training of brain anatomy. The designed simulator is equipped with AR and VR supported innovative e-learning technologies in order to examine and learn the structure of the human brain, whose anatomical structure and functioning is complex, using 3D models in anatomy education. This smartphone-aided application is achieved a high level of success in examination of brain anatomy with the additional features such as interface design and application usability. After the cornerstones of this designed prototype application are presented, the required suggestions are obtained from experts and healthcare professionals and it is observed that the application worked with maximum efficiency. In the study, the effectiveness of the VR and AR aided SABAS mobile application simulator, developed to teach the anatomical structure of the brain, is evaluated based on the experiences of 30 participants who wanted to voluntarily participate in the study.

References

Aziz, M. A., Mckenzie, J. C., Wilson, J. S., Cowie, R. J., Ayeni, S. A., & Dunn, B. K. (2002). The human cadaver in the age of biomedical informatics. The Anatomical Record: An Official Publication of the American Association of Anatomists, 269(1), 20-32. https://doi.org/10.1002/ar.10046

Blum, T., Kleeberger, V., Bichlmeier, C., & Navab, N. (2012). Mirracle: An augmented reality magic mirror system for anatomy education. In Proceedings of the 2012 IEEE Virtual Reality Workshops (VRW) (pp. 115-116). http://dx.doi.org/10.1109/VR.2012.6180909

Boas, Y. (2013). Overview of virtual reality technologies. In Proceedings of the Interactive Multimedia Conference. https://www.coursehero.com/file/47603440/Overview-of-VR-techpdf/

Boruff, J. T., & Storie, D. (2014). Mobile devices in medicine: a survey of how medical students, residents, and faculty use smartphones and other mobile devices to find information. Journal of the Medical Library Association: JMLA, 102(1), 22-30. https://doi.org/10.3163%2F1536-5050.102.1.006

Bourquain, H., Schenk, A., Link, F., Preim, B., Prause, G., & Peitgen, H. O. (2002). HepaVision2 - A software assistant for preoperative planning in living-related liver transplantation and oncologic liver surgery. In CARS 2002 Computer Assisted Radiology and Surgery (pp. 341-346). Berlin: Springer.

Chase, T. J., Julius, A., Chandan, J. S., Powell, E., Hall, C. S., Phillips, B. L., Burnett, R., Gill, D., & Fernando, B. (2018). Mobile learning in medicine: an evaluation of attitudes and behaviours of medical students. BMC Medical Education, 18(1), 1-8. https://doi.org/10.1186/s12909-018-1264-5

Coles, T. R., Meglan, D., & John, N. W. (2010). The role of haptics in medical training simulators: A survey of the state of the art. In IEEE Transactions on haptics, 4(1), 51-66. https://doi.org/10.1109/toh.2010.19

Gannis, C. (2017). The Augmented selfie. In Proceedings of the Electronic Visualisation and the Arts (EVA 2017). (pp. 319-326). http://dx.doi.org/10.14236/ewic/EVA2017.66

Goswami, P., Schlegel, P., Solenthaler, B., & Pajarola, R. (2010). Interactive SPH simulation and rendering on the GPU. In Proceedings of the Proceedings of the 2010 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (pp. 55-64). http://dx.doi.org/10.2312/SCA/SCA10/055-064

Huang, Y. M., & Chiu, P. S. (2015). The effectiveness of a meaningful learning‐based evaluation model for context‐aware mobile learning. British Journal of Educational Technology, 46(2), 437-447. https://doi.org/10.1111/bjet.12147

Isdale, J. (1998). What is virtual reality. http://isdale.com/jerry/VR/WhatIsVR/noframes/WhatIsVR4.1.html

Jamali, S. S., Shiratuddin, M. F., Wong, K. W., & Oskam, C. L. (2015). Utilising mobile-augmented reality for learning human anatomy. Procedia-Social and Behavioral Sciences, 197, 659-668. https://doi.org/10.1016/j.sbspro.2015.07.054

Jones, N., Blackey, H., Fitzgibbon, K., & Chew, E. (2010). Get out of MySpace! Computers & Education, 54(3), 776-782. http://dx.doi.org/10.1016/j.compedu.2009.07.008

Khachan, A. M., & Özmen, A. (2019). IMSSAP: After‐school interactive mobile learning student support application. Computer Applications in Engineering Education, 27(3), 543-552. https://doi.org/10.1002/cae.22096

Küçük, S., Kapakin, S., & Göktaş, Y. (2016). Learning anatomy via mobile augmented reality: Effects on achievement and cognitive load. Anatomical Sciences Education, 9(5), 411-421. https://doi.org/10.1002/ase.1603

Kurniawan, M. H., & Witjaksono, G. (2018). Human anatomy learning systems using augmented reality on mobile application. Procedia Computer Science, 135, 80-88. https://doi.org/10.1016/j.procs.2018.08.152

Lemole Jr, G. M., Banerjee, P. P., Luciano, C., Neckrysh, S., & Charbel, F. T. (2007). Virtual reality in neurosurgical education: Part-task ventriculostomy simulation with dynamic visual and haptic feedback. Neurosurgery, 61(1), 142-149. https://doi.org/10.1227/01.neu.0000279734.22931.21

Mekni, M., & Lemieux, A. (2014). Augmented reality: Applications, challenges and future trends. Applied Computational Science, 205-214. http://www.cs.ucf.edu/courses/cap6121/spr2020/readings/Mekni2014.pdf

Parkes, R., Forrest, N., & Baillie, S. (2009). A mixed reality simulator for feline abdominal palpation training in veterinary medicine. In Proceedings of the MMVR (pp. 244-246). https://pubmed.ncbi.nlm.nih.gov/19377159/

Popović, O., Marković, D. S., & Popović, R. (2016). mTester - Mobile learning system. Computer Applications in Engineering Education, 24(3), 412-420. https://doi.org/10.1002/cae.21719

Reitinger, B., Bornik, A., Beichel, R., & Schmalstieg, D. (2006). Liver surgery planning using virtual reality. In IEEE Computer Graphics and Applications, 26(6), 36-47. https://doi.org/10.1109/mcg.2006.131

Rhienmora, P., Gajananan, K., Haddawy, P., Suebnukarn, S., Dailey, M. N., Supataratarn, E., & Shrestha, P. (2010). Haptic augmented reality dental trainer with automatic performance assessment. In Proceedings of the Proceedings of the 15th international Conference on Intelligent User Interfaces (pp. 425-426). http://dx.doi.org/10.1145/1719970.1720054

Rose, F. D., Brooks, B. M., & Rizzo, A. A. (2005). Virtual reality in brain damage rehabilitation. Cyber Psychology & Behavior, 8(3), 241-262. https://doi.org/10.1089/cpb.2005.8.241

Ruthenbeck, G. S., & Reynolds, K. J. (2015). Virtual reality for medical training: the state-of-the-art. Journal of Simulation, 9(1), 16-26. https://doi.org/10.1057/jos.2014.14

Safi, A., Castaneda, V., Lasser, T., & Navab, N. (2010). Skin lesions classification with optical spectroscopy. In H. Liao, P. J. Edwards, X. Pan, Y. Fan & G. Z. Yang (Eds.), Proceedings of the International Workshop on Medical Imaging and Virtual Reality (pp. 411-418). https://doi.org/10.1007/978-3-642-15699-1_43

Sketchfab. (2019). Home page. https://sketchfab.com/

Tatar, I., Huri, E., Selcuk, I., Moon, Y. L., Paoluzzi, A., & Skolarikos, A. (2019). Review of the effect of 3D medical printing and virtual reality on urology training with MedTRain3DModsim'Erasmus + European Union Project. Turkish Journal of Medical Sciences, 49(5), 1257-1270. https://doi.org/10.3906/sag-1905-73

Unity3D. (2019). Home page. https://unity.com/

Vuforia. (2019). Home page. https://developer.vuforia.com/

Walsh, K. (2015). Mobile learning in medical education. Ethiopian Journal of Health Sciences, 25(4), 363-366. https://doi.org/10.4314/ejhs.v25i4.10

Wang, F. H. (2017). An exploration of online behaviour engagement and achievement in flipped classroom supported by learning management system. Computers & Education, 114, 79-91. https://doi.org/10.1016/j.compedu.2017.06.012

Wexelblat, A. (2014). Virtual reality: Applications and explorations. Cambridge: Academic Press.

Downloads

Published

2022-09-30

How to Cite

Dandıl, E., Serin, Z., & Şenol, Y. (2022). SABAS: A Smartphone-Aided Training Simulator based on Virtual and Augmented Reality for Brain Anatomy Assessment. BRAIN. Broad Research in Artificial Intelligence and Neuroscience, 13(3), 252-276. https://doi.org/10.18662/brain/13.3/366

Publish your work at the Scientific Publishing House LUMEN

It easy with us: publish now your work, novel, research, proceeding at Lumen Scientific Publishing House

Send your manuscript right now