Abstract
In a healthcare context, the success of a fire safety procedure in a real-life emergency mainly depends on staff decisions and actions. One of the factors influencing staff decision-making is their training. In most healthcare facilities, safety educators use slide-based lectures as a training tool. Virtual Reality (VR) is gaining fire safety community attention for being an interesting training tool. However, few studies have assessed the effectiveness of VR-based fire safety training simulators compared with a slide-based lecture. The present research proposes a novel non-immersive VR-based training for healthcare fire safety education. This paper describes the prototyping steps required to develop a non-immersive VR serious game (SG) to train the staff of Vincent Van Gogh (VVG) hospital in Belgium. The paper finally validates the VR SG comparing its effectiveness against slide-based lecture training. 78 staff from VVG hospital in Belgium participated in this study. They were divided into two groups: Group A was trained using a slide-based lecture, and Group B was trained using the VR SG. The results indicated that the VR SG was more effective than the slide-based lecture in terms of knowledge acquisition and retention and in terms of self-efficacy increment in short and long terms than the slide-based lecture.















Similar content being viewed by others
Availability of Data and Material
The data discussed in this research work cannot be shared for ethical issues.
References
Campbell R (2017) Structure fires in health case facilities, NFPA’s report. https://www.nfpa.org//-/media/Files/News-and-Research/Fire-statistics-and-reports/Building-and-life-safety/oshealthcarefacilities.pdf
Centre fédéral de connaissances pour la sécurité civile, Statistiques 2013 des services d’incendie belges, 2013. https://www.kcce.be/sites/default/files/explorer/partie_s_incendie/Rapport_Statistiques_services_dincendie_2013_FR_def.pdf
All A, Plovie B, Castellar EP, Looy JV (2017) Pre-test influences on the effectiveness of digital-game based learning: a case study of a fire safety game. Comput Educ 114:24–37
Gwynne SMV, Boyce KE, Kuligowski ED, Nilsson D, Robbins A, Lovreglio R, Roy-Poirier A, Thomas JR (2017) Enhancing egress drills: preparation and assessment of evacuee performance. Fire Mater. https://doi.org/10.1002/fam.2448
Gwynne SMV, Boyce KE, Kuligowski ED, Nilsson D, Robbins A, Lovreglio R (2016) Pros and cons of egress drills, Interflam 2016, Nr Windsor, UK, 4–6 July 2016
Gwynne S, Amos M, Kinateder M, Benichou N, Boyce K, van Der Wal CN, Ronchi E (2020) The future of evacuation drills: assessing and enhancing evacuee performance. Saf Sci 129:104767. https://doi.org/10.1016/j.ssci.2020.104767
Rahouti A, Lovreglio R, Gwynne S, Jackson P, Datoussaïd S, Hunt A (2020) Human behaviour during a healthcare facility evacuation drills: investigation of pre-evacuation and travel phases. Saf Sci. https://doi.org/10.1016/j.ssci.2020.104754
Gwynne S, Galea E, Parke J, Hickson J (2003) The collection and analysis of pre-evacuation times derived from evacuation Drills and their application to evacuation modelling. Fire Technol 39(2):173–195
Strating N (2013) Evacuation of bedridden building occupants (Thesis). Eindhoven University of Technology, Eindhoven
Chittaro L, Buttussi F (2015) Assessing knowledge retention of an immersive serious game vs a traditional education method in aviation safety. IEEE Trans Vis Comput Gr 21(4):529–538. https://doi.org/10.1109/tvcg.2015.2391853
Lovreglio R, Gonzalez V, Feng Z, Amor R, Spearpoint M, Thomas J, Trotter M, Sacks R (2018) Prototyping virtual reality serious games for earthquake preparedness: the Auckland city hospital case study. Adv Eng Inform. https://doi.org/10.1016/j.aei.2018.08.018
Rondon S, Sassi FC, Furquim de Andrade CR (2013) Computer game-based and traditional learning method: a comparison regarding students’ knowledge retention. BMC Med Educ 13:30. https://doi.org/10.1186/1472-6920-13-30
Makransky G, Peterson GB (2019) Investigating the process of learning with desktop virtual reality: a structural equation modeling approach. Comput Educ 134:15–30
Ronchi E, Mayorga D, Lovreglio R, Wahlqvist J, Nilsson D (2019) Mobile-powered head-mounted displays versus cave automatic virtual environment experiments for evacuation research. Comput Anim Virtual Worlds Mater Methods 30(6):e1873. https://doi.org/10.1002/cav.1873
Din ZU, Gibson E (2019) Serious games for learning prevention through design concepts: an experimental study. Saf Sci 115:176–187. https://doi.org/10.1016/j.ssci.2019.02.005
Ryan R, Deci E (2000) Self-determination theory and the facilitation of intrinsic motivation. Am Psychol 55(1):68–78. https://doi.org/10.1037/0003-066X.55.1.68
Schunk DH, DiBenedetto MK (2016) Self-efficacy theory in education. In: Wentzel KR, Miele DB (eds) Handbook of motivation at school. Routledge, New York, NY, pp 34–54
Shu Y, Huang YZ, Chang SH, Chen MY (2019) Do virtual reality head-mounted displays make a difference? A comparison of presence and self-efficacy between head-mounted displays and desktop computer-facilitated virtual environments. Virtual Real 23:437–446
Chittaro L, Sioni R (2015) Serious games for emergency preparedness: evaluation of an interactive vs. a non-interactive simulation of a terror attack. Comput Hum Behav 50:508–519
Tate DL, Sibert L, King T (1997) Virtual environments for shipboard firefighting training. In: Proceedings of IEEE 1997 annual international symposium on virtual reality, Albuquerque, NM, USA, pp 61–68. DOI: https://doi.org/10.1109/VRAIS.1997.583045
Smith S, Ericson E (2009) Using immersive game virtual reality to teach fire-safety skills to children. Virtual Real 13(2):87–99. https://doi.org/10.1007/s10055-009-0113-6
Lovreglio et al (2020) Comparing the effectiveness of virtual reality training and video training. Virtual Real. https://doi.org/10.1007/s10055-020-00447-5
Burigat S, Chittaro L (2016) Passive and active navigation of virtual environments vs. traditional printed evacuation maps: a comparative evaluation in the aviation domain. Int J Hum Comput Stud 87:92–105. https://doi.org/10.1016/j.ijhcs.2015.11.004
Chittaro L (2017) A comparative study of aviation safety briefing media: card, video, and video with interactive controls. Transp Res Part C 85:415–428
Chittaro L, Corbett CL, McLean GA, Zangrando N (2018) Safety knowledge transfer through mobile virtual reality: a study of aviation life preserver donning. Saf Sci 102:159–168. https://doi.org/10.1016/j.ssci.2017.10.012
Chittaro L, Buttussi F (2019) Exploring the use of arcade game elements for attitude change: two studies in the aviation safety domain. Int J Hum Comput Stud 127:112–123. https://doi.org/10.1016/j.ijhcs.2018.07.006
Feng Z, Gonzalez V, Amor R, Lovreglio R et al (2018) Immersive virtual reality serious games for evacuation training and research: a systematic literature review. Comput Educ. https://doi.org/10.1016/j.compedu.2018.09.002
Smith SP, Trenholme D (2009) Rapid prototyping a virtual fire drill environment using computer game technology. Fire Saf J 44:559–569
Gorisse G, Christmann O, Amato EA, Richir S (2017) First- and third-person perspectives in immersive virtual environments: presence and performance analysis of embodied users. Front Robot AI 4:33. https://doi.org/10.3389/frobt.2017.00033
Wahlqvist J, Van Hees P (2020) Visualization of fires in virtual reality. Brandforsk 2018:15
Deci EL, Eghrari H, Patrick BC, Leone DR (1994) Facilitating internalization: the self-determination theory perspective. J Pers 62(1):119–142. https://doi.org/10.1111/j.1467-6494.1994.tb00797.x
Lee EA-L, Wong KW, Fung CC (2010) How does desktop virtual reality enhance learning outcomes? A structural equation modeling approach. Comput Educ 55(4):1424–1442. https://doi.org/10.1016/j.compedu.2010.06.006
Davis FD (1989) Perceived usefulness, perceived ease of use, and user acceptance of information. MIS Q 13(3):319–340. https://doi.org/10.2307/249008
Sutcliffe A, Gault B, Shin JE (2005) Presence, memory and interaction in virtual environments. Int J Hum Comput Stud 62(3):307–327. https://doi.org/10.1016/j.ijhcs.2004.11.010
Tokel ST, İsler V (2015) Acceptance of virtual worlds as learning space. Innov Educ Teach Int 52(3):254–264. https://doi.org/10.1080/14703297.2013.820139
Cha M, Han S, Lee J, Choi B (2012) A virtual reality based fire training simulator integrated with fire dynamics data. Fire Saf J 50:12–24. https://doi.org/10.1016/j.firesaf.2012.01.004
Leder J, Horlitz T, Puschmann P, Wittstock V, Schütz A (2019) Comparing immersive virtual reality and powerpoint as methods for delivering safety training: impacts on risk perception, learning, and decision making. Saf Sci 111:271–286. https://doi.org/10.1016/j.ssci.2018.07.021
Gélinas-Phaneuf N et al (2014) Assessing performance in brain tumor resection using a novel virtual reality simulator. Int J Comput Assisted Radiol Surg 9(1):1–9
Grantcharov TP et al (2003) Impact of hand dominance, gender, and experience with computer games on performance in virtual reality laparoscopy. Surg Endosc Other Intervent Tech 17(7):1082–1085
Kinateder M, Pauli P, Müller M, Krieger J, Heimbecher F, Rönnau I, Bergerhausen U, Vollmann G, Vogt P, Mühlberger A (2013) Human behaviour in severe tunnel accidents: effects of information and behavioural training. Transp Res Part F Traffic Psychol Behav 17:20–32. https://doi.org/10.1016/j.trf.2012.09.001
Acknowledgments
The authors are grateful to the UHC of Charleroi safety management team and all staff members who participated in this study.
Funding
Not applicable.
Author information
Authors and Affiliations
Contributions
AR: Conception and design, Software implementation, Data collection and analysis, Writing, and Critical revision—major. RL: Conception and design, Writing—medium, Software implementation, Data collection and analysis—minor, and Critical revision—major. SD: Conception and design—medium, Software implementation, Data collection and analysis, Writing—minor, and Critical revision—major. TD: Conception and design—medium, Software implementation, Data collection and analysis, Writing—minor, and Critical revision—major.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Code Availability
This research work uses a custom code.
Ethical Approval
The ethics committee of the University of Mons has reviewed and approved this research. Participants were informed about the purpose of the study via an information sheet and signed a consent form for data collection and storage before undertaking the training. They were also informed that they had the possibility to stop the experiment at any time without any reason and that they can stop the experiment if they feel sick or any discomfort. All the training sessions were performed under the supervision of at least one researcher in case of an emergency.
Appendix: Questionnaires Items and Their Source
Appendix: Questionnaires Items and Their Source
Construct | Items | Source |
|---|---|---|
Intrinsic motivation | I enjoy fire safety training activities | |
Fire safety training activities are fun to perform | ||
Fire safety training activities are boring | ||
Fire safety training activities do not hold my attention at all | ||
I would describe fire safety training activities as very interesting | ||
Self-efficacy | I am confident and I can understand the basic concepts of fire safety | |
I am confident that I understand the most complex concepts of fire safety | ||
I am confident that I can do an excellent job on the assignments and tests in fire safety exercises | ||
I expect to do well in fire safety training | ||
I am certain that I can master the skills being taught during fire safety training sessions | ||
Knowledge | If you are inside a building of the hospital centre and you noticed an object inhibiting the functioning of a fire door (or an emergency exit) in case of fire, what would you do? | – |
If you are facing a small fire which was not detected via automatic smoke detectors (i.e. no internal or external alarm), what would you do first? | ||
How would you perform this action? | ||
If a fire is announced (i.e. internal alarm only) and you are in front of a confined room where the fire was detected, what would you do first? | ||
If you are facing a gaze, what would you do first? | ||
How would you perform this action? | ||
If the evacuation of patients is required, where would you transport patients? | ||
During evacuation, if several rooms are occupied by patients, in which order would you evacuate them? | ||
During evacuation, if you are in a room where two patients with different degrees of mobility (i.e. a semi-ambulant patient and an immobile (or bedridden patient) patient) require your help, which one would you assist first? | ||
During evacuation, if you notice that you forgot a personal item such as you cell phone, what would you do? | ||
Representational fidelity | The realism of the virtual world motivates me to learn | Lee et al. [33] |
The virtual world makes learning more interesting | ||
The realism of the virtual world enhances my learning | ||
Immediacy of controls | The ability to manipulate the 3D objects in the virtual world allows me to learn better | Lee et al. [33] |
The ability to manipulate the 3D objects in the virtual world makes learning more motivating and more interesting | ||
The ability to manipulate the 3D objects in the virtual world in real-time helps me to learn better | ||
Recommendations efficacy | The recommendations provided in the training experience are useful for my safety | Lovreglio et al. [22] |
Recommendations provided in the training experience are will help me to effectively act in real-life fire situations | ||
Recommendations simplicity | I could easily learn the recommendations provided in the virtual experience | |
I could easily remember the recommendations provided in the virtual experience | Lovreglio et al. [22] | |
I could easily carry out the recommendations provided in the virtual experience | ||
Perceived usefulness | Using this type of virtual reality simulation as an educational tool will enhance my learning | Davis [34] |
This type of simulation will allow me to progress at my own pace | ||
This type of simulation is useful as a learning supplement | ||
Perceived ease of use | Manipulating this simulation tool is ease for me | Davis [34] |
Manipulating this simulation tool is too complicated for me | ||
Overall, I think this training tool easy to use | ||
Presence | My interactions with the virtual objects seemed to be natural | Sutcliffe et al. [35] |
My experience in the virtual world seemed consistent with real-life experiences | ||
I was engaged in the virtual world experience | ||
I was involved in the experimental task to the extent that I lost track of time | ||
Perceived enjoyment | I find using this fire simulator enjoyable | Tokel and İsler [36] |
Using this fire simulator is pleasant | ||
I have fun using this fire simulator | ||
Control and active learning | This learning method helps me to have a better overview of the content learned | Lee et al. [33] |
This learning method allows me to be more active in the learning process | ||
This learning method allows me to have more control over my own learning | ||
This learning method allows promotes self-paced learning | ||
Cognitive benefits | This simulator makes the comprehension easier | Lee et al. [33] |
This simulator makes the memorisation easier | ||
This simulator helps me to better apply what was learned | ||
This simulator helps me to better analyse the problems | ||
Comparison with conventional training methods | I found this simulation more engaging than conventional training methods (like fire drills, non-interactive videos, health and safety inductions, recommendation leaflets, and seminars) | Lovreglio et al. [22] |
It was easy to remember the recommendations provided in this simulation compared with those provided during conventional training sessions | ||
I prefer fire safety training that uses this simulation over conventional training tools |
Rights and permissions
About this article
Cite this article
Rahouti, A., Lovreglio, R., Datoussaïd, S. et al. Prototyping and Validating a Non-immersive Virtual Reality Serious Game for Healthcare Fire Safety Training. Fire Technol 57, 3041–3078 (2021). https://doi.org/10.1007/s10694-021-01098-x
Received:
Accepted:
Published:
Version of record:
Issue date:
DOI: https://doi.org/10.1007/s10694-021-01098-x

