Skip to main content
Log in

Prototyping and Validating a Non-immersive Virtual Reality Serious Game for Healthcare Fire Safety Training

  • Published:
Fire Technology Aims and scope Submit manuscript

Abstract

In a healthcare context, the success of a fire safety procedure in a real-life emergency mainly depends on staff decisions and actions. One of the factors influencing staff decision-making is their training. In most healthcare facilities, safety educators use slide-based lectures as a training tool. Virtual Reality (VR) is gaining fire safety community attention for being an interesting training tool. However, few studies have assessed the effectiveness of VR-based fire safety training simulators compared with a slide-based lecture. The present research proposes a novel non-immersive VR-based training for healthcare fire safety education. This paper describes the prototyping steps required to develop a non-immersive VR serious game (SG) to train the staff of Vincent Van Gogh (VVG) hospital in Belgium. The paper finally validates the VR SG comparing its effectiveness against slide-based lecture training. 78 staff from VVG hospital in Belgium participated in this study. They were divided into two groups: Group A was trained using a slide-based lecture, and Group B was trained using the VR SG. The results indicated that the VR SG was more effective than the slide-based lecture in terms of knowledge acquisition and retention and in terms of self-efficacy increment in short and long terms than the slide-based lecture.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+
from $39.99 /Month
  • Starting from 10 chapters or articles per month
  • Access and download chapters and articles from more than 300k books and 2,500 journals
  • Cancel anytime
View plans

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15

Similar content being viewed by others

Availability of Data and Material

The data discussed in this research work cannot be shared for ethical issues.

References

  1. Campbell R (2017) Structure fires in health case facilities, NFPA’s report. https://www.nfpa.org//-/media/Files/News-and-Research/Fire-statistics-and-reports/Building-and-life-safety/oshealthcarefacilities.pdf

  2. Centre fédéral de connaissances pour la sécurité civile, Statistiques 2013 des services d’incendie belges, 2013. https://www.kcce.be/sites/default/files/explorer/partie_s_incendie/Rapport_Statistiques_services_dincendie_2013_FR_def.pdf

  3. All A, Plovie B, Castellar EP, Looy JV (2017) Pre-test influences on the effectiveness of digital-game based learning: a case study of a fire safety game. Comput Educ 114:24–37

    Article  Google Scholar 

  4. Gwynne SMV, Boyce KE, Kuligowski ED, Nilsson D, Robbins A, Lovreglio R, Roy-Poirier A, Thomas JR (2017) Enhancing egress drills: preparation and assessment of evacuee performance. Fire Mater. https://doi.org/10.1002/fam.2448

    Article  Google Scholar 

  5. Gwynne SMV, Boyce KE, Kuligowski ED, Nilsson D, Robbins A, Lovreglio R (2016) Pros and cons of egress drills, Interflam 2016, Nr Windsor, UK, 4–6 July 2016

  6. Gwynne S, Amos M, Kinateder M, Benichou N, Boyce K, van Der Wal CN, Ronchi E (2020) The future of evacuation drills: assessing and enhancing evacuee performance. Saf Sci 129:104767. https://doi.org/10.1016/j.ssci.2020.104767

    Article  Google Scholar 

  7. Rahouti A, Lovreglio R, Gwynne S, Jackson P, Datoussaïd S, Hunt A (2020) Human behaviour during a healthcare facility evacuation drills: investigation of pre-evacuation and travel phases. Saf Sci. https://doi.org/10.1016/j.ssci.2020.104754

    Article  Google Scholar 

  8. Gwynne S, Galea E, Parke J, Hickson J (2003) The collection and analysis of pre-evacuation times derived from evacuation Drills and their application to evacuation modelling. Fire Technol 39(2):173–195

    Article  Google Scholar 

  9. Strating N (2013) Evacuation of bedridden building occupants (Thesis). Eindhoven University of Technology, Eindhoven

    Google Scholar 

  10. Chittaro L, Buttussi F (2015) Assessing knowledge retention of an immersive serious game vs a traditional education method in aviation safety. IEEE Trans Vis Comput Gr 21(4):529–538. https://doi.org/10.1109/tvcg.2015.2391853

    Article  Google Scholar 

  11. Lovreglio R, Gonzalez V, Feng Z, Amor R, Spearpoint M, Thomas J, Trotter M, Sacks R (2018) Prototyping virtual reality serious games for earthquake preparedness: the Auckland city hospital case study. Adv Eng Inform. https://doi.org/10.1016/j.aei.2018.08.018

    Article  Google Scholar 

  12. Rondon S, Sassi FC, Furquim de Andrade CR (2013) Computer game-based and traditional learning method: a comparison regarding students’ knowledge retention. BMC Med Educ 13:30. https://doi.org/10.1186/1472-6920-13-30

    Article  Google Scholar 

  13. Makransky G, Peterson GB (2019) Investigating the process of learning with desktop virtual reality: a structural equation modeling approach. Comput Educ 134:15–30

    Article  Google Scholar 

  14. Ronchi E, Mayorga D, Lovreglio R, Wahlqvist J, Nilsson D (2019) Mobile-powered head-mounted displays versus cave automatic virtual environment experiments for evacuation research. Comput Anim Virtual Worlds Mater Methods 30(6):e1873. https://doi.org/10.1002/cav.1873

    Article  Google Scholar 

  15. Din ZU, Gibson E (2019) Serious games for learning prevention through design concepts: an experimental study. Saf Sci 115:176–187. https://doi.org/10.1016/j.ssci.2019.02.005

    Article  Google Scholar 

  16. Ryan R, Deci E (2000) Self-determination theory and the facilitation of intrinsic motivation. Am Psychol 55(1):68–78. https://doi.org/10.1037/0003-066X.55.1.68

    Article  Google Scholar 

  17. Schunk DH, DiBenedetto MK (2016) Self-efficacy theory in education. In: Wentzel KR, Miele DB (eds) Handbook of motivation at school. Routledge, New York, NY, pp 34–54

    Google Scholar 

  18. Shu Y, Huang YZ, Chang SH, Chen MY (2019) Do virtual reality head-mounted displays make a difference? A comparison of presence and self-efficacy between head-mounted displays and desktop computer-facilitated virtual environments. Virtual Real 23:437–446

    Article  Google Scholar 

  19. Chittaro L, Sioni R (2015) Serious games for emergency preparedness: evaluation of an interactive vs. a non-interactive simulation of a terror attack. Comput Hum Behav 50:508–519

    Article  Google Scholar 

  20. Tate DL, Sibert L, King T (1997) Virtual environments for shipboard firefighting training. In: Proceedings of IEEE 1997 annual international symposium on virtual reality, Albuquerque, NM, USA, pp 61–68. DOI: https://doi.org/10.1109/VRAIS.1997.583045

  21. Smith S, Ericson E (2009) Using immersive game virtual reality to teach fire-safety skills to children. Virtual Real 13(2):87–99. https://doi.org/10.1007/s10055-009-0113-6

    Article  Google Scholar 

  22. Lovreglio et al (2020) Comparing the effectiveness of virtual reality training and video training. Virtual Real. https://doi.org/10.1007/s10055-020-00447-5

    Article  Google Scholar 

  23. Burigat S, Chittaro L (2016) Passive and active navigation of virtual environments vs. traditional printed evacuation maps: a comparative evaluation in the aviation domain. Int J Hum Comput Stud 87:92–105. https://doi.org/10.1016/j.ijhcs.2015.11.004

    Article  Google Scholar 

  24. Chittaro L (2017) A comparative study of aviation safety briefing media: card, video, and video with interactive controls. Transp Res Part C 85:415–428

    Article  Google Scholar 

  25. Chittaro L, Corbett CL, McLean GA, Zangrando N (2018) Safety knowledge transfer through mobile virtual reality: a study of aviation life preserver donning. Saf Sci 102:159–168. https://doi.org/10.1016/j.ssci.2017.10.012

  26. Chittaro L, Buttussi F (2019) Exploring the use of arcade game elements for attitude change: two studies in the aviation safety domain. Int J Hum Comput Stud 127:112–123. https://doi.org/10.1016/j.ijhcs.2018.07.006

    Article  Google Scholar 

  27. Feng Z, Gonzalez V, Amor R, Lovreglio R et al (2018) Immersive virtual reality serious games for evacuation training and research: a systematic literature review. Comput Educ. https://doi.org/10.1016/j.compedu.2018.09.002

    Article  Google Scholar 

  28. Smith SP, Trenholme D (2009) Rapid prototyping a virtual fire drill environment using computer game technology. Fire Saf J 44:559–569

    Article  Google Scholar 

  29. Gorisse G, Christmann O, Amato EA, Richir S (2017) First- and third-person perspectives in immersive virtual environments: presence and performance analysis of embodied users. Front Robot AI 4:33. https://doi.org/10.3389/frobt.2017.00033

    Article  Google Scholar 

  30. https://www.linkedin.com/company/mixamo/

  31. Wahlqvist J, Van Hees P (2020) Visualization of fires in virtual reality. Brandforsk 2018:15

    Google Scholar 

  32. Deci EL, Eghrari H, Patrick BC, Leone DR (1994) Facilitating internalization: the self-determination theory perspective. J Pers 62(1):119–142. https://doi.org/10.1111/j.1467-6494.1994.tb00797.x

    Article  Google Scholar 

  33. Lee EA-L, Wong KW, Fung CC (2010) How does desktop virtual reality enhance learning outcomes? A structural equation modeling approach. Comput Educ 55(4):1424–1442. https://doi.org/10.1016/j.compedu.2010.06.006

    Article  Google Scholar 

  34. Davis FD (1989) Perceived usefulness, perceived ease of use, and user acceptance of information. MIS Q 13(3):319–340. https://doi.org/10.2307/249008

    Article  Google Scholar 

  35. Sutcliffe A, Gault B, Shin JE (2005) Presence, memory and interaction in virtual environments. Int J Hum Comput Stud 62(3):307–327. https://doi.org/10.1016/j.ijhcs.2004.11.010

    Article  Google Scholar 

  36. Tokel ST, İsler V (2015) Acceptance of virtual worlds as learning space. Innov Educ Teach Int 52(3):254–264. https://doi.org/10.1080/14703297.2013.820139

    Article  Google Scholar 

  37. Cha M, Han S, Lee J, Choi B (2012) A virtual reality based fire training simulator integrated with fire dynamics data. Fire Saf J 50:12–24. https://doi.org/10.1016/j.firesaf.2012.01.004

    Article  Google Scholar 

  38. Leder J, Horlitz T, Puschmann P, Wittstock V, Schütz A (2019) Comparing immersive virtual reality and powerpoint as methods for delivering safety training: impacts on risk perception, learning, and decision making. Saf Sci 111:271–286. https://doi.org/10.1016/j.ssci.2018.07.021

    Article  Google Scholar 

  39. Gélinas-Phaneuf N et al (2014) Assessing performance in brain tumor resection using a novel virtual reality simulator. Int J Comput Assisted Radiol Surg 9(1):1–9

    Article  Google Scholar 

  40. Grantcharov TP et al (2003) Impact of hand dominance, gender, and experience with computer games on performance in virtual reality laparoscopy. Surg Endosc Other Intervent Tech 17(7):1082–1085

    Article  Google Scholar 

  41. Kinateder M, Pauli P, Müller M, Krieger J, Heimbecher F, Rönnau I, Bergerhausen U, Vollmann G, Vogt P, Mühlberger A (2013) Human behaviour in severe tunnel accidents: effects of information and behavioural training. Transp Res Part F Traffic Psychol Behav 17:20–32. https://doi.org/10.1016/j.trf.2012.09.001

    Article  Google Scholar 

Download references

Acknowledgments

The authors are grateful to the UHC of Charleroi safety management team and all staff members who participated in this study.

Funding

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

AR: Conception and design, Software implementation, Data collection and analysis, Writing, and Critical revision—major. RL: Conception and design, Writing—medium, Software implementation, Data collection and analysis—minor, and Critical revision—major. SD: Conception and design—medium, Software implementation, Data collection and analysis, Writing—minor, and Critical revision—major. TD: Conception and design—medium, Software implementation, Data collection and analysis, Writing—minor, and Critical revision—major.

Corresponding author

Correspondence to Anass Rahouti.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Code Availability

This research work uses a custom code.

Ethical Approval

The ethics committee of the University of Mons has reviewed and approved this research. Participants were informed about the purpose of the study via an information sheet and signed a consent form for data collection and storage before undertaking the training. They were also informed that they had the possibility to stop the experiment at any time without any reason and that they can stop the experiment if they feel sick or any discomfort. All the training sessions were performed under the supervision of at least one researcher in case of an emergency.

Appendix: Questionnaires Items and Their Source

Appendix: Questionnaires Items and Their Source

Construct

Items

Source

Intrinsic motivation

I enjoy fire safety training activities

Deci et al. [32], Makransky and Peterson [13]

 

Fire safety training activities are fun to perform

 
 

Fire safety training activities are boring

 
 

Fire safety training activities do not hold my attention at all

 
 

I would describe fire safety training activities as very interesting

 

Self-efficacy

I am confident and I can understand the basic concepts of fire safety

Deci et al. [32], Makransky and Peterson [13]

 

I am confident that I understand the most complex concepts of fire safety

 
 

I am confident that I can do an excellent job on the assignments and tests in fire safety exercises

 
 

I expect to do well in fire safety training

 
 

I am certain that I can master the skills being taught during fire safety training sessions

 

Knowledge

If you are inside a building of the hospital centre and you noticed an object inhibiting the functioning of a fire door (or an emergency exit) in case of fire, what would you do?

–

 

If you are facing a small fire which was not detected via automatic smoke detectors (i.e. no internal or external alarm), what would you do first?

 
 

How would you perform this action?

 
 

If a fire is announced (i.e. internal alarm only) and you are in front of a confined room where the fire was detected, what would you do first?

 
 

If you are facing a gaze, what would you do first?

 
 

How would you perform this action?

 
 

If the evacuation of patients is required, where would you transport patients?

 
 

During evacuation, if several rooms are occupied by patients, in which order would you evacuate them?

 
 

During evacuation, if you are in a room where two patients with different degrees of mobility (i.e. a semi-ambulant patient and an immobile (or bedridden patient) patient) require your help, which one would you assist first?

 
 

During evacuation, if you notice that you forgot a personal item such as you cell phone, what would you do?

 

Representational fidelity

The realism of the virtual world motivates me to learn

Lee et al. [33]

 

The virtual world makes learning more interesting

 
 

The realism of the virtual world enhances my learning

 

Immediacy of controls

The ability to manipulate the 3D objects in the virtual world allows me to learn better

Lee et al. [33]

 

The ability to manipulate the 3D objects in the virtual world makes learning more motivating and more interesting

 
 

The ability to manipulate the 3D objects in the virtual world in real-time helps me to learn better

 

Recommendations efficacy

The recommendations provided in the training experience are useful for my safety

Lovreglio et al. [22]

 

Recommendations provided in the training experience are will help me to effectively act in real-life fire situations

 

Recommendations simplicity

I could easily learn the recommendations provided in the virtual experience

 
 

I could easily remember the recommendations provided in the virtual experience

Lovreglio et al. [22]

 

I could easily carry out the recommendations provided in the virtual experience

 

Perceived usefulness

Using this type of virtual reality simulation as an educational tool will enhance my learning

Davis [34]

 

This type of simulation will allow me to progress at my own pace

 
 

This type of simulation is useful as a learning supplement

 

Perceived ease of use

Manipulating this simulation tool is ease for me

Davis [34]

 

Manipulating this simulation tool is too complicated for me

 
 

Overall, I think this training tool easy to use

 

Presence

My interactions with the virtual objects seemed to be natural

Sutcliffe et al. [35]

 

My experience in the virtual world seemed consistent with real-life experiences

 
 

I was engaged in the virtual world experience

 
 

I was involved in the experimental task to the extent that I lost track of time

 

Perceived enjoyment

I find using this fire simulator enjoyable

Tokel and İsler [36]

 

Using this fire simulator is pleasant

 
 

I have fun using this fire simulator

 

Control and active learning

This learning method helps me to have a better overview of the content learned

Lee et al. [33]

 

This learning method allows me to be more active in the learning process

 
 

This learning method allows me to have more control over my own learning

 
 

This learning method allows promotes self-paced learning

 

Cognitive benefits

This simulator makes the comprehension easier

Lee et al. [33]

 

This simulator makes the memorisation easier

 
 

This simulator helps me to better apply what was learned

 
 

This simulator helps me to better analyse the problems

 

Comparison with conventional training methods

I found this simulation more engaging than conventional training methods (like fire drills, non-interactive videos, health and safety inductions, recommendation leaflets, and seminars)

Lovreglio et al. [22]

 

It was easy to remember the recommendations provided in this simulation compared with those provided during conventional training sessions

 
 

I prefer fire safety training that uses this simulation over conventional training tools

 

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rahouti, A., Lovreglio, R., Datoussaïd, S. et al. Prototyping and Validating a Non-immersive Virtual Reality Serious Game for Healthcare Fire Safety Training. Fire Technol 57, 3041–3078 (2021). https://doi.org/10.1007/s10694-021-01098-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Version of record:

  • Issue date:

  • DOI: https://doi.org/10.1007/s10694-021-01098-x

Keywords