National implementation of whole crew on-call in situ simulation in Norwegian HEMS; feasibility, challenges, and possibilities: An implementation study
Keywords:
medical orientated in situ simulation, in situ simulation, air ambulance, observed clinical practise, HEMS, emergency servicesSynopsis
This research project is a PhD-project on implementing medical orientated in situ simulation for on-call air ambulance crews in Norway, and the alternative use of “observed clinical practise” in real-life missions when simulations cannot be carried out. Since HEMS duty is typically a standby emergency service, there are periods between missions where training can be carried out. However, these free periods are unpredictable, and the planning of training can be challenging. Thus, we initially want to test in situ simulation training feasibility on HEMS bases in Norway.
This thesis consists of four different studies using several research methods. The first study is a prospective quantitative interventional study, where one facilitator introduces in situ simulation training on one HEMS base in Norway to evaluate the feasibility of such training. In Study II, the same training concept was sought introduced on all HEMS bases in Norway and one SAR base. Both Studies I and II evaluate the participants' experience with a Likert-style questionnaire as well as using descriptive data. In relation to introducing in situ simulation nationally, the expected barriers to the introduction were studied with a qualitative method. Facilitators from the participating bases underwent structured group interviews in Study III. After the one-year study period, the facilitators were interviewed about the experienced barriers and the tools used to overcome these. Finally, in Study IV, a solution was sought to use facilitators more efficiently by combining in situ training with live mission observations. Study IV combines descriptive data, questionnaires, and phone-based individual interviews.
We have found that in situ simulation training for on-call crews is feasible and can be implemented with a high level of satisfaction from participating crews. There were some challenges to the implementation that the facilitators have tried to overcome. A more rigid framework and follow up might have improved the implementation. It seemed difficult to conduct simulations successfully on the busier bases. Some of the key factors for the implementation was found to be the use of a facilitator with local knowledge, support from the departmental managers, dedicated time for the facilitators to prepare and lead the training, and the need for continuous development within the role as facilitator. We suggest live mission observation with post-mission debriefing as a feasible alternative to in situ simulation to maximise invested resources and maintain the learning output.
References
Wilson MH, Habig K, Wright C, Hughes A, Davies G, Imray CH. Pre-hospital emergency medicine. Lancet. 2015;386(10012):2526-34.
https://doi.org/10.1016/S0140-6736(15)00985-X
Langhelle A, Lossius HM, Silfvast T, Björnsson HM, Lippert FK, Ersson A, et al. International EMS systems: the Nordic countries. Resuscitation. 2004;61(1):9-21.
https://doi.org/10.1016/j.resuscitation.2003.12.008
Lossius H, Søreide E, Hotvedt R, Hapnes S, Eielsen O, Førde O, et al. Prehospital advanced life support provided by specially trained physicians: is there a benefit in terms of life years gained? Acta Anaesthesiol Scand. 2002;46(7):771-8.
https://doi.org/10.1034/j.1399-6576.2002.460703.x
Sollid SJ, Bredmose PP, Nakstad AR, Sandberg M. A prospective survey of critical care procedures performed by physicians in helicopter emergency medical service: is clinical exposure enough to stay proficient? Scand J Trauma Resusc Emerg Med. 2015;23:45.
https://doi.org/10.1186/s13049-015-0128-9
Barsuk D, Ziv A, Lin G, Blumenfeld A, Rubin O, Keidan I, et al. Using advanced simulation for recognition and correction of gaps in airway and breathing management skills in prehospital trauma care. Anesth Analg. 2005;100(3):803-9, table of contents.
https://doi.org/10.1213/01.ANE.0000143390.11746.CF
Neily J, Mills PD, Young-Xu Y, Carney BT, West P, Berger DH, et al. Association between implementation of a medical team training program and surgical mortality. JAMA. 2010;304(15):1693-700.
https://doi.org/10.1001/jama.2010.1506
Bredmose PP, Habig K, Davies G, Grier G, Lockey DJ. Scenario based outdoor simulation in pre-hospital trauma care using a simple mannequin model. Scand J Trauma Resusc Emerg Med. 2010;18:13.
https://doi.org/10.1186/1757-7241-18-13
Glasheen J, Regan L, Richmond C, Edwards B, Burns B. On shift simulation in aeromedical operations - making it work. 2017. 2017;2(1).
https://doi.org/10.32378/ijp.v2i1.31
Abelsson A, Rystedt I, Suserud B-O, Lindwall L. Mapping the use of simulation in prehospital care - a literature review. Scand J Trauma Resusc Emerg Med. 2014;22(1):22.
https://doi.org/10.1186/1757-7241-22-22
Abelsson A, Lundberg L. Trauma Simulation in Prehospital Emergency Care. J Trauma Nurs. 2018;25(3):201-4.
https://doi.org/10.1097/JTN.0000000000000370
Cheng A, Lockey A, Bhanji F, Lin Y, Hunt EA, Lang E. The use of high-fidelity manikins for advanced life support training--A systematic review and meta-analysis. Resuscitation. 2015;93:142- 9.
https://doi.org/10.1016/j.resuscitation.2015.04.004
Lazzara EH, Benishek LE, Dietz AS, Salas E, Adriansen DJ. Eight critical factors in creating and implementing a successful simulation program. Jt Comm J Qual Patient Saf. 2014;40(1):21- 9.
https://doi.org/10.1016/S1553-7250(14)40003-5
Hauer KE, Holmboe ES, Kogan JR. Twelve tips for implementing tools for direct observation of medical trainees' clinical skills during patient encounters. Med Teach. 2011;33(1):27-33.
https://doi.org/10.3109/0142159X.2010.507710
Boet S, Bould MD, Layat BC, Reeves S. Twelve tips for a successful interprofessional team-based high-fidelity simulation education session. Med Teach. 2014;36.
https://doi.org/10.3109/0142159X.2014.923558
Weinstock PH, Kappus LJ, Kleinman ME, Grenier B, Hickey P, Burns JP. Toward a new paradigm in hospital-based pediatric education: The development of an onsite simulator program*. Pediatr Crit Care Med. 2005;6(6):635-41.
https://doi.org/10.1097/00130478-200511000-00034
https://doi.org/10.1097/00130478-200511000-00022
https://doi.org/10.1097/00130478-200511000-00026
https://doi.org/10.1097/00130478-200511000-00038
https://doi.org/10.1097/00130478-200511000-00018
https://doi.org/10.1097/01.PCC.0000185489.07469.AF
Dotson MP, Gustafson ML, Tager A, Peterson LM. Air Medical Simulation Training: A Retrospective Review of Cost and Effectiveness. Air Med J. 2018;37(2):131-7.
https://doi.org/10.1016/j.amj.2017.11.012
Spurr J, Gatward J, Joshi N, Carley SD. Top 10 (+1) tips to get started with in situ simulation in emergency and critical care departments. Emerg Med J. 2016;33(7):514-6.
https://doi.org/10.1136/emermed-2015-204845
Luftambulansetjenesten. Helseforetakenes nasjonale luftambulansetjeneste ANS Årsrapport 2012 www.luftambulansetjenesten.no2013 [Available from: http://www.luftambulanse.no/system/files/internett-vedlegg/arsrapport%202012.pdf.
Den livsviktige jobben Forsvaret2021 [updated 210321. Available from: https://www.forsvaret.no/aktuelt-og- presse/aktuelt/den-livsviktige-jobben.
Knowles MS. The adult learner : a neglected species: Third edition. Houston : Gulf Pub. Co., Book Division, [1984] ©1984; 1984.
Kolb DA. Experience as the source of learning and development. Upper Sadle River: Prentice Hall. 1984.
Sawyer T, Eppich W, Brett-Fleegler M, Grant V, Cheng A. More Than One Way to Debrief: A Critical Review of Healthcare Simulation Debriefing Methods. Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare. 2016;11:209 17.
https://doi.org/10.1097/SIH.0000000000000148
Sargent E. The Link Trainer. Royal United Services Institution Journal. 1939;84(535):590-2.
https://doi.org/10.1080/03071843909419931
Woodling C, Faber S, Vanbockel JJ, Olasky CC, Williams WK, Mire JL, et al. Apollo experience report: Simulation of manned space flight for crew training. 1973.
Tjomsland N, Baskett P. Asmund S. Laerdal. Resuscitation. 2002;53(2):115-20.
https://doi.org/10.1016/S0300-9572(02)00033-3
Gaba DM, Howard SK, Fish KJ, Smith BE, Sowb YA. Simulation-based training in anesthesia crisis resource management (ACRM): a decade of experience. Simulation & Gaming. 2001;32(2):175-93.
https://doi.org/10.1177/104687810103200206
Dieckmann P, Friis SM, Lippert A, Østergaard D. Goals, success factors, and barriers for simulation-based learning: A qualitative interview study in health care. Simulation & Gaming. 2012;43(5):627-47.
https://doi.org/10.1177/1046878112439649
EuSIM courses Available from: https://eusim.org/courses/, access 080322
Issenberg SB, McGaghie WC, Petrusa ER, Lee GD, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005;27.
https://doi.org/10.1080/01421590500046924
Loughran JJ. Effective reflective practice: In search of meaning in learning about teaching. Journal of teacher education. 2002;53(1):33-43.
https://doi.org/10.1177/0022487102053001004
Eppich WJ, Hunt EA, Duval-Arnould JM, Siddall VJ, Cheng A. Structuring feedback and debriefing to achieve mastery learning goals. Acad Med. 2015;90(11):1501-8.
https://doi.org/10.1097/ACM.0000000000000934
Fanning R, Gaba D. The role of debriefing in simulation-based learning. Simul Healthc 2: 115-125. 2007.
https://doi.org/10.1097/SIH.0b013e3180315539
Rudolph JW, Simon R, Dufresne RL, Raemer DB. There's no such thing as "nonjudgmental" debriefing: a theory and method for debriefing with good judgment. Simul Healthc. 2006;1(1):49- 55.
https://doi.org/10.1097/01266021-200600110-00006
Eppich W, Cheng A. Promoting Excellence and Reflective Learning in Simulation (PEARLS): development and rationale for a blended approach to health care simulation debriefing. Simul Healthc. 2015;10(2):106-15.
https://doi.org/10.1097/SIH.0000000000000072
Møller TP, Østergaard D, Lippert A. Facts and fiction - Training in centres or in situ. Trends Anaesth Crit Care. 2012;2(4):174-9.
https://doi.org/10.1016/j.tacc.2012.03.006
Patterson MD, Blike GT, Nadkarni VM. Advances in Patient Safety. In Situ Simulation: Challenges and Results. In: Henriksen K, Battles JB, Keyes MA, Grady ML, editors. Advances in Patient Safety: New Directions and Alternative Approaches (Vol 3: Performance and Tools). Rockville (MD): Agency for Healthcare Research and Quality (US); 2008.
Patterson MD, Geis GL, Falcone RA, LeMaster T, Wears RL. In situ simulation: detection of safety threats and teamwork training in a high risk emergency department. BMJ Qual Saf. 2013;22(6):468-77.
https://doi.org/10.1136/bmjqs-2012-000942
Auerbach M, Kessler DO, Patterson M. The use of in situ simulation to detect latent safety threats in paediatrics: a cross- sectional survey. BMJ Simulation and Technology Enhanced Learning. 2015;1(3).
https://doi.org/10.1136/bmjstel-2015-000037
Petrosoniak A, Auerbach M, Wong AH, Hicks CM. In situ simulation in emergency medicine: Moving beyond the simulation lab. Emerg Med Australas. 2017;29(1):83-8.
https://doi.org/10.1111/1742-6723.12705
Craig S. Direct observation of clinical practice in emergency medicine education. Acad Emerg Med. 2011;18(1):60-7.
https://doi.org/10.1111/j.1553-2712.2010.00964.x
Fromme HB, Karani R, Downing SM. Direct observation in medical education: a review of the literature and evidence for validity. Mt Sinai J Med. 2009;76(4):365-71.
https://doi.org/10.1002/msj.20123
Norcini J, Burch V. Workplace-based assessment as an educational tool: AMEE Guide No. 31. Med Teach. 2007;29(9- 10):855-71.
https://doi.org/10.1080/01421590701775453
Burgess A, van Diggele C, Roberts C, Mellis C. Feedback in the clinical setting. BMC Med Educ. 2020;20(2):460.
https://doi.org/10.1186/s12909-020-02280-5
Cantillon P, Sargeant J. Giving feedback in clinical settings. BMJ. 2008;337.
https://doi.org/10.1136/bmj.a1961
Holmboe ES. Faculty and the observation of trainees' clinical skills: problems and opportunities. Acad Med. 2004;79(1):16-22.
https://doi.org/10.1097/00001888-200401000-00006
Goldshtein D, Krensky C, Doshi S, Perelman VS. In situ simulation and its effects on patient outcomes: a systematic review. BMJ Simulation and Technology Enhanced Learning. 2020;6(1):3-9.
https://doi.org/10.1136/bmjstel-2018-000387
Rubio-Gurung S, Putet G, Touzet S, Gauthier-Moulinier H, Jordan I, Beissel A, et al. In situ simulation training for neonatal resuscitation: an RCT. Pediatrics. 2014;134(3):e790-e7.
https://doi.org/10.1542/peds.2013-3988
Msemo G, Massawe A, Mmbando D, Rusibamayila N, Manji K, Kidanto HL, et al. Newborn mortality and fresh stillbirth rates in Tanzania after helping babies breathe training. Pediatrics. 2013;131(2):e353-60.
https://doi.org/10.1542/peds.2012-1795
Kobayashi L, Parchuri R, Gardiner FG, Paolucci GA, Tomaselli NM, Al-Rasheed RS. Use of in situ simulation and human factors engineering to assess and improve emergency department clinical systems for timely telemetry-based detection of life-threatening arrhythmias. BMJ Qual Saf. 2013;22.
https://doi.org/10.1136/bmjqs-2012-001134
Kjaergaard-Andersen G, Ibsgaard P, Paltved C, Irene Jensen H. An in situ simulation program: a quantitative and qualitative prospective study identifying latent safety threats and examining participant experiences. Int J Qual Health Care. 2021;33(1):mzaa148.
https://doi.org/10.1093/intqhc/mzaa148
Hengameh H, Afsaneh R, Morteza K, Hosein M, Marjan SM, Ebadi A. The effect of applying direct observation of procedural skills (DOPS) on nursing students' clinical skills: a randomized clinical trial. Global journal of health science. 2015;7(7):17.
https://doi.org/10.5539/gjhs.v7n7p17
Salas E, Wilson KA, Lazzara EH, King HB, Augenstein JS, Robinson DW, et al. Simulation-Based Training for Patient Safety: 10 Principles That Matter. Journal of Patient Safety. 2008;4(1):3-8.
https://doi.org/10.1097/PTS.0b013e3181656dd6
Likert R. A technique for the measurement of attitudes. Archives of psychology. 1932;140.
Campbell D, Fiske D. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol Bull. 1959;56 2:81- 105.
https://doi.org/10.1037/h0046016
Johnson RB, Onwuegbuzie AJ, Turner LA. Toward a definition of mixed methods research. Journal of mixed methods research. 2007;1(2):112-33.
https://doi.org/10.1177/1558689806298224
Denzin KN. Triangulation and the doing of sociology. Norman, K Denzin, The research act a theoretical introduction to sociological methods, EE UU Mc-Graw Hill. 1978:291-307.
Baron-Epel O, Kaplan G, Weinstein R, Green MS. Extreme and acquiescence bias in a bi-ethnic population. Eur J Public Health. 2010;20(5):543-8.
https://doi.org/10.1093/eurpub/ckq052
Furnham A. Response bias, social desirability and dissimulation. Pers Individ Dif. 1986;7(3):385-400.
https://doi.org/10.1016/0191-8869(86)90014-0
Meisenberg G, Williams A. Are acquiescent and extreme response styles related to low intelligence and education? Pers Individ Dif. 2008;44(7):1539-50.
https://doi.org/10.1016/j.paid.2008.01.010
Armstrong RL. The Midpoint on a Five-Point Likert-Type Scale. Percept Mot Skills. 1987;64(2):359-62.
https://doi.org/10.2466/pms.1987.64.2.359
Hayes M. Experimental developement of the graphics rating method. Physiol Bull. 1921;18:98-9.
Reips U-D, Funke F. Interval-level measurement with visual analogue scales in Internet-based research: VAS Generator. Behav Res Methods. 2008;40(3):699-704.
https://doi.org/10.3758/BRM.40.3.699
Malterud K. Qualitative research: standards, challenges, and guidelines. The Lancet. 2001;358(9280):483-8.
https://doi.org/10.1016/S0140-6736(01)05627-6
Powell RA, Single HM. Focus groups. Int J Qual Health Care. 1996;8(5):499-504.
https://doi.org/10.1093/intqhc/8.5.499
DeJonckheere M, Vaughn LM. Semistructured interviewing in primary care research: a balance of relationship and rigour. Family Medicine and Community Health. 2019;7(2):e000057.
https://doi.org/10.1136/fmch-2018-000057
Kvale S. Interviews: An introduction to qualitative Research interviewing, thousandvaks. London, new Dehli, and Soge Publications; 1996.
Malterud K. Systematic text condensation: a strategy for qualitative analysis. Scand J Public Health. 2012;40(8):795-805.
https://doi.org/10.1177/1403494812465030
Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349-57.
https://doi.org/10.1093/intqhc/mzm042
O'Cathain A, Murphy E, Nicholl J. Why, and how, mixed methods research is undertaken in health services research in England: a mixed methods study. BMC Health Serv Res. 2007;7(1):85.
https://doi.org/10.1186/1472-6963-7-85
Stecher B, Borko H. Integrating findings from surveys and case studies: examples from a study of standards-based educational reform. Journal of Education Policy. 2002;17(5):547-69.
https://doi.org/10.1080/02680930210158311
Mays N, Pope C. Qualitative research in health care. Assessing quality in qualitative research. BMJ. 2000;320(7226):50-2.
https://doi.org/10.1136/bmj.320.7226.50
Hamberg K, Johansson E, Lindgren G, Westman G. Scientific rigour in qualitative research-examples from a study of women's health in family practice. Fam Pract. 1994;11(2):176-81.
https://doi.org/10.1093/fampra/11.2.176
Chapple A, Rogers A. Explicit guidelines for qualitative research: a step in the right direction, a defence of the'soft'option, or a form of sociological imperialism? Fam Pract. 1998;15(6):556-61.
https://doi.org/10.1093/fampra/15.6.556
Winter R. Action-research and the nature of social inquiry: Professional innovation and educational work: Ashgate Publishing Company; 1987.
Dodgson JE. Reflexivity in Qualitative Research. J Hum Lact. 2019;35(2):220-2.
https://doi.org/10.1177/0890334419830990
Kukull WA, Ganguli M. Generalizability: the trees, the forest, and the low-hanging fruit. Neurology. 2012;78(23):1886-91.
https://doi.org/10.1212/WNL.0b013e318258f812
Pearl J, Bareinboim E. External validity: From do-calculus to transportability across populations. Statistical Science. 2014;29(4):579-95.
https://doi.org/10.1214/14-STS486
Lydersen S. How to summarise ordinal data. Tidsskrift for Den norske legeforening. 2020. DOI: 10.4045/tidsskr.20.0033
https://doi.org/10.4045/tidsskr.20.0033
Mogey N. So you want to use a Likert scale. Learning technology dissemination initiative. 1999;25.
Huber P. Robust Statistics, Wiler. New York. 1981.
https://doi.org/10.1002/0471725250
Association WM. World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA. 2013;310(20):2191-4.
https://doi.org/10.1001/jama.2013.281053
Tariq U, Sood M, Goodsman D. The Facilitator's Role in London's Air Ambulance's simulation "moulage" training. Air Med J. 2015;34(2):92-7.
https://doi.org/10.1016/j.amj.2014.12.012
Zimmermann K, Holzinger IB, Ganassi L, Esslinger P, Pilgrim S, Allen M, et al. Inter-professional in-situ simulated team and resuscitation training for patient safety: Description and impact of a programmatic approach. BMC Med Educ. 2015;15:189.
https://doi.org/10.1186/s12909-015-0472-5
Walker ST, Sevdalis N, McKay A, Lambden S, Gautama S, Aggarwal R, et al. Unannounced in situ simulations: integrating training and clinical practice. BMJ Qual Saf. 2013;22.
https://doi.org/10.1136/bmjqs-2012-000986
Forstrønen A, Johnsgaard T, Brattebø G, Reime MH. Developing facilitator competence in scenario-based medical simulation: Presentation and evaluation of a train the trainer course in Bergen, Norway. Nurse Educ Pract. 2020;47:102840.
https://doi.org/10.1016/j.nepr.2020.102840
Tapia V, Waseem M. Setup and Execution of In Situ Simulation. 2019.
Celenza A, Rogers I. Qualitative evaluation of a formal bedside clinical teaching programme in an emergency department. Emerg Med J. 2006;23(10):769-73.
https://doi.org/10.1136/emj.2006.037796
Jahanshir A, Bahreini M, Banaie M, Jallili M, Bagheri-Hariri S, Rasooli F, et al. Implementation a Medical Simulation Curriculum in Emergency Medicine Residency Program. Acta Med Iran. 2017;55:521-4.
Thomas A, Burns R, Sanseau E, Auerbach M. Tips for Conducting Telesimulation-Based Medical Education. Cureus. 2021;13(1):e12479-e.
https://doi.org/10.7759/cureus.12479
Krogh K, Bearman M, Nestel D. "Thinking on your feet"-a qualitative study of debriefing practice. Adv Simul (Lond). 2016;1:12.
https://doi.org/10.1186/s41077-016-0011-4
Cheng A, Palaganas J, Eppich W, Rudolph J, Robinson T, Grant V. Co-debriefing for Simulation-based Education: A Primer for Facilitators. Simulation in Healthcare. 2015;10(2):69-75.
https://doi.org/10.1097/SIH.0000000000000077
Dieckmann P, Stricker E, Rall M. Methods for formative evaluations of debriefing as a tool for feedback and improvement. Simulation in Healthcare. 2006;1(3):193.
https://doi.org/10.1097/01266021-200600130-00057
Roach E, Okrainec A. Telesimulation for remote simulation and assessment. J Surg Oncol. 2021;124(2):193-9.
https://doi.org/10.1002/jso.26505
Major S, Krage R, Lazarovici M. SimUniversity at a distance: a descriptive account of a team-based remote simulation competition for health professions students. Advances in Simulation. 2022;7(1):6.
https://doi.org/10.1186/s41077-021-00199-5
Ohta K, Kurosawa H, Shiima Y, Ikeyama T, Scott J, Hayes S, et al. The Effectiveness of Remote Facilitation in Simulation-Based Pediatric Resuscitation Training for Medical Students. Pediatr Emerg Care. 2017;33(8):564-9.
https://doi.org/10.1097/PEC.0000000000000752
Cheng A, Kolbe M, Grant V, Eller S, Hales R, Symon B, et al. A practical guide to virtual debriefings: communities of inquiry perspective. Advances in Simulation. 2020;5(1):18.
https://doi.org/10.1186/s41077-020-00141-1
Hunt EA, Duval-Arnould JM, Nelson-McMillan KL, Bradshaw JH, Diener-West M, Perretta JS, et al. Pediatric resident resuscitation skills improve after "rapid cycle deliberate practice" training. Resuscitation. 2014;85(7):945-51.
https://doi.org/10.1016/j.resuscitation.2014.02.025
Yan DH, Slidell MB, McQueen A. Using rapid cycle deliberate practice to improve primary and secondary survey in pediatric trauma. BMC Med Educ. 2020;20(1):131.
https://doi.org/10.1186/s12909-020-02038-z
Stocker M, Burmester M, Allen M. Optimisation of simulated team training through the application of learning theories: a debate for a conceptual framework. BMC Med Educ. 2014;14.
https://doi.org/10.1186/1472-6920-14-69
Kolbe M, Eppich W, Rudolph J, Meguerdichian M, Catena H, Cripps A, et al. Managing psychological safety in debriefings: a dynamic balancing act. BMJ Simulation & Technology Enhanced Learning. 2020;6(3):164.
https://doi.org/10.1136/bmjstel-2019-000470
Rudolph JW, Raemer DB, Simon R. Establishing a Safe Container for Learning in Simulation: The Role of the Presimulation Briefing. Simulation in Healthcare. 2014;9(6):339- 49.
https://doi.org/10.1097/SIH.0000000000000047
Qadan L, Al-Ozairi E, Ayed A, Huang G. Avoiding honest feedback: discordance between formal evaluations and candid assessments of Kuwaiti PBL students. Med Teach. 2013;35(6):459-64.
https://doi.org/10.3109/0142159X.2013.774337
Dieckmann P, Patterson M, Lahlou S, Mesman J, Nyström P, Krage R. Variation and adaptation: learning from success in patient safety-oriented simulation training. Advances in Simulation. 2017;2(1):21.
https://doi.org/10.1186/s41077-017-0054-1
EuSim. EuSim course description www.eusim.org2015 [Available from: https://eusim.org/courses/#EuSim simulation instructor course.
Wisborg T, Brattebø G, Brattebø J, Brinchmann-Hansen A. Training multiprofessional trauma teams in Norwegian hospitals using simple and low cost local simulations. Educ Health (Abingdon). 2006;19(1):85-95.
https://doi.org/10.1080/13576280500534768
Wisborg T, Brattebo G, Brinchmann-Hansen A, Uggen PE, Hansen KS, Norwegian BFB, et al. Effects of nationwide training of multiprofessional trauma teams in norwegian hospitals. J Trauma. 2008;64(6):1613-8.
https://doi.org/10.1097/TA.0b013e31812eed68
Bredmose PP, Hooper J, Viggers S, Linde J, Reid C, Grier G, et al. Prehospital Care: An International Comparison of Independently Developed Training Courses. Air Med J. 2021.
https://doi.org/10.1016/j.amj.2021.10.009
Kirkpatrick D. Evaluation of training. In: RL C, editor. Training and Development Handbook: A Guide to Human Resource Development. New York: McGraw-Hill; 1976.
Skjærseth EÅ, Haugland H, Krüger AJ, Pleym LE-N, Uleberg O. Developing Quality Indicators for Helicopter Emergency Medical Services Coordination in Norwegian Emergency Medical Communication Centrals: A Consensus Process. Air Med J. 2021;40(1):20-7.
