SABAS: A Smartphone-Aided Training Simulator based on Virtual and Augmented Reality for Brain Anatomy Assessment
Keywords:Brain anatomy, anatomy education, training simulator, virtual reality, augmented reality, mobile application
Many application areas for augmented reality (AR) and virtual reality (VR) emerged with the technological advances. These technologies, which initially appeared in sectors such as entertainment and games, are now widely used in the field of health care. In this study, a traditional simulator named SABAS is designed with its all components to be used in the training of brain anatomy. The designed simulator is equipped with AR and VR supported innovative e-learning technologies in order to examine and learn the structure of the human brain, whose anatomical structure and functioning is complex, using 3D models in anatomy education. This smartphone-aided application is achieved a high level of success in examination of brain anatomy with the additional features such as interface design and application usability. After the cornerstones of this designed prototype application are presented, the required suggestions are obtained from experts and healthcare professionals and it is observed that the application worked with maximum efficiency. In the study, the effectiveness of the VR and AR aided SABAS mobile application simulator, developed to teach the anatomical structure of the brain, is evaluated based on the experiences of 30 participants who wanted to voluntarily participate in the study.
Aziz, M. A., Mckenzie, J. C., Wilson, J. S., Cowie, R. J., Ayeni, S. A., & Dunn, B. K. (2002). The human cadaver in the age of biomedical informatics. The Anatomical Record: An Official Publication of the American Association of Anatomists, 269(1), 20-32. https://doi.org/10.1002/ar.10046
Blum, T., Kleeberger, V., Bichlmeier, C., & Navab, N. (2012). Mirracle: An augmented reality magic mirror system for anatomy education. In Proceedings of the 2012 IEEE Virtual Reality Workshops (VRW) (pp. 115-116). http://dx.doi.org/10.1109/VR.2012.6180909
Boas, Y. (2013). Overview of virtual reality technologies. In Proceedings of the Interactive Multimedia Conference. https://www.coursehero.com/file/47603440/Overview-of-VR-techpdf/
Boruff, J. T., & Storie, D. (2014). Mobile devices in medicine: a survey of how medical students, residents, and faculty use smartphones and other mobile devices to find information. Journal of the Medical Library Association: JMLA, 102(1), 22-30. https://doi.org/10.3163%2F1536-5050.102.1.006
Bourquain, H., Schenk, A., Link, F., Preim, B., Prause, G., & Peitgen, H. O. (2002). HepaVision2 - A software assistant for preoperative planning in living-related liver transplantation and oncologic liver surgery. In CARS 2002 Computer Assisted Radiology and Surgery (pp. 341-346). Berlin: Springer.
Chase, T. J., Julius, A., Chandan, J. S., Powell, E., Hall, C. S., Phillips, B. L., Burnett, R., Gill, D., & Fernando, B. (2018). Mobile learning in medicine: an evaluation of attitudes and behaviours of medical students. BMC Medical Education, 18(1), 1-8. https://doi.org/10.1186/s12909-018-1264-5
Coles, T. R., Meglan, D., & John, N. W. (2010). The role of haptics in medical training simulators: A survey of the state of the art. In IEEE Transactions on haptics, 4(1), 51-66. https://doi.org/10.1109/toh.2010.19
Gannis, C. (2017). The Augmented selfie. In Proceedings of the Electronic Visualisation and the Arts (EVA 2017). (pp. 319-326). http://dx.doi.org/10.14236/ewic/EVA2017.66
Goswami, P., Schlegel, P., Solenthaler, B., & Pajarola, R. (2010). Interactive SPH simulation and rendering on the GPU. In Proceedings of the Proceedings of the 2010 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (pp. 55-64). http://dx.doi.org/10.2312/SCA/SCA10/055-064
Huang, Y. M., & Chiu, P. S. (2015). The effectiveness of a meaningful learning‐based evaluation model for context‐aware mobile learning. British Journal of Educational Technology, 46(2), 437-447. https://doi.org/10.1111/bjet.12147
Isdale, J. (1998). What is virtual reality. http://isdale.com/jerry/VR/WhatIsVR/noframes/WhatIsVR4.1.html
Jamali, S. S., Shiratuddin, M. F., Wong, K. W., & Oskam, C. L. (2015). Utilising mobile-augmented reality for learning human anatomy. Procedia-Social and Behavioral Sciences, 197, 659-668. https://doi.org/10.1016/j.sbspro.2015.07.054
Jones, N., Blackey, H., Fitzgibbon, K., & Chew, E. (2010). Get out of MySpace! Computers & Education, 54(3), 776-782. http://dx.doi.org/10.1016/j.compedu.2009.07.008
Khachan, A. M., & Özmen, A. (2019). IMSSAP: After‐school interactive mobile learning student support application. Computer Applications in Engineering Education, 27(3), 543-552. https://doi.org/10.1002/cae.22096
Küçük, S., Kapakin, S., & Göktaş, Y. (2016). Learning anatomy via mobile augmented reality: Effects on achievement and cognitive load. Anatomical Sciences Education, 9(5), 411-421. https://doi.org/10.1002/ase.1603
Kurniawan, M. H., & Witjaksono, G. (2018). Human anatomy learning systems using augmented reality on mobile application. Procedia Computer Science, 135, 80-88. https://doi.org/10.1016/j.procs.2018.08.152
Lemole Jr, G. M., Banerjee, P. P., Luciano, C., Neckrysh, S., & Charbel, F. T. (2007). Virtual reality in neurosurgical education: Part-task ventriculostomy simulation with dynamic visual and haptic feedback. Neurosurgery, 61(1), 142-149. https://doi.org/10.1227/01.neu.0000279734.22931.21
Mekni, M., & Lemieux, A. (2014). Augmented reality: Applications, challenges and future trends. Applied Computational Science, 205-214. http://www.cs.ucf.edu/courses/cap6121/spr2020/readings/Mekni2014.pdf
Parkes, R., Forrest, N., & Baillie, S. (2009). A mixed reality simulator for feline abdominal palpation training in veterinary medicine. In Proceedings of the MMVR (pp. 244-246). https://pubmed.ncbi.nlm.nih.gov/19377159/
Popović, O., Marković, D. S., & Popović, R. (2016). mTester - Mobile learning system. Computer Applications in Engineering Education, 24(3), 412-420. https://doi.org/10.1002/cae.21719
Reitinger, B., Bornik, A., Beichel, R., & Schmalstieg, D. (2006). Liver surgery planning using virtual reality. In IEEE Computer Graphics and Applications, 26(6), 36-47. https://doi.org/10.1109/mcg.2006.131
Rhienmora, P., Gajananan, K., Haddawy, P., Suebnukarn, S., Dailey, M. N., Supataratarn, E., & Shrestha, P. (2010). Haptic augmented reality dental trainer with automatic performance assessment. In Proceedings of the Proceedings of the 15th international Conference on Intelligent User Interfaces (pp. 425-426). http://dx.doi.org/10.1145/1719970.1720054
Rose, F. D., Brooks, B. M., & Rizzo, A. A. (2005). Virtual reality in brain damage rehabilitation. Cyber Psychology & Behavior, 8(3), 241-262. https://doi.org/10.1089/cpb.2005.8.241
Ruthenbeck, G. S., & Reynolds, K. J. (2015). Virtual reality for medical training: the state-of-the-art. Journal of Simulation, 9(1), 16-26. https://doi.org/10.1057/jos.2014.14
Safi, A., Castaneda, V., Lasser, T., & Navab, N. (2010). Skin lesions classification with optical spectroscopy. In H. Liao, P. J. Edwards, X. Pan, Y. Fan & G. Z. Yang (Eds.), Proceedings of the International Workshop on Medical Imaging and Virtual Reality (pp. 411-418). https://doi.org/10.1007/978-3-642-15699-1_43
Sketchfab. (2019). Home page. https://sketchfab.com/
Tatar, I., Huri, E., Selcuk, I., Moon, Y. L., Paoluzzi, A., & Skolarikos, A. (2019). Review of the effect of 3D medical printing and virtual reality on urology training with MedTRain3DModsim'Erasmus + European Union Project. Turkish Journal of Medical Sciences, 49(5), 1257-1270. https://doi.org/10.3906/sag-1905-73
Unity3D. (2019). Home page. https://unity.com/
Vuforia. (2019). Home page. https://developer.vuforia.com/
Walsh, K. (2015). Mobile learning in medical education. Ethiopian Journal of Health Sciences, 25(4), 363-366. https://doi.org/10.4314/ejhs.v25i4.10
Wang, F. H. (2017). An exploration of online behaviour engagement and achievement in flipped classroom supported by learning management system. Computers & Education, 114, 79-91. https://doi.org/10.1016/j.compedu.2017.06.012
Wexelblat, A. (2014). Virtual reality: Applications and explorations. Cambridge: Academic Press.
How to Cite
Copyright (c) 2022 The Authors & LUMEN Publishing House
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant this journal right of first publication, with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work, with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g. post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g. in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as an earlier and greater citation of published work (See The Effect of Open Access).
BRAIN. Broad Research in Artificial Intelligence and Neuroscience Journal has an Attribution-NonCommercial-NoDerivs