Retention of Skills with and without Debriefing Three-Months after Cardiopulmonary Resuscitation Training in Makkah, Saudi Arabia: A Randomized Controlled Trial ()
1. Introduction
Cardiac arrest refers to the sudden cessation of cardiac activity with hemodynamic collapse takes place, typically due to sustained ventricular tachycardia/ventricular fibrillation (VF) [1] [2]. Cardiac arrest strikes suddenly, hence the name “sudden cardiac arrest” (SCA), leaving less than 5% chance to survive the attack [3]. In addition to the number of lives lost, cardiac arrest has a considerable economic impact; measured in terms of productive years of life lost due to premature death or avoidable neurologic disability, it constitutes a societal burden equal to or greater than that of other leading causes of death in the community [4]. This is why only prevention and the need to develop strategies for management of sudden cardiac death are warranted. Several factors influence the development of risk factors for SCA, including the presence of underlying cardiovascular disease (CVD), including coronary heart disease (CHD), atherosclerosis, hypertension, heart failure, as well as inherited disorders affecting cardiac rhythm, such as long QT interval syndrome [1]. The setting where SCA takes place is an important determinant for the survivability outcome of an SCA incident. Around 347,000 out-of-hospital cardiac arrest (OHCA) and 209,000 in-hospital cardiac arrests (IHCAs) occur in adults each year in the US; millions more occurring across the rest of North America, Europe, and Asia [5]. Cardiac arrest becomes more common with age; and males are more often affected [1]. Sudden cardiac death (SCD) may often follow, unless a successful intervention, e.g., defibrillation or spontaneous reversion restores circulation, has been achieved; in which case the event is referred to as aborted SCD. However, a bradyarrhythmia is responsible for some cases of SCD [2] [6]. Absence of pulse is the prominent sign of cardiac arrest [1], however the exact mechanism of the collapse may be impossible to establish. For the vast majority of patients who die suddenly, cardiac activity is not being monitored at the time of their collapse. As a result, the mechanism can only be inferred, based upon information obtained after the process has been initiated. On the other hand, there have been many cases in which the initiating event has been witnessed or recorded [6] [7].
Management and prevention through public awareness and preparedness: The prevention of OHCAs is the most important factor for increasing the survival rate. In many cases, time from recognition of cardiac arrest to the arrival of emergency medical service (EMS) is long, leaving bystanders in a critical position to potentially influence patient prognosis. Prior training in CPR and use of AED may influence bystander interventions. The European Resuscitation Council has published that there will be a European cardiac arrest awareness day each year (Oct. 16) [8]. More than 70 percent SCA incidents occur in the home, which is why home AEDs have the potential to save the lives of countless loved ones struck by cardiac arrest.
The sequence of actions whereas joining the victim of SCA with survival is called “chain of survival (COS)” [9]. System-based improvements to the COS had yielded increases in survival from OHCA. However, in order for the patient to have the best chance of surviving an OHCA, early recognition, early CPR and defibrillation must be provided within the first 4 minutes of the cardiac arrest. Geri et al. [10] define CPR as a therapeutic intervention performed for patients with cardiac and respiratory arrest. Bystander CPR is a key life-saving factor in the COS. Further, adequate post-resuscitation care of OHCA victims should be considered for transportation to a specialized cardiac arrest center as part of a broader regional system of care [9]. The Saudi Heart Association (SHA) set CPR guidelines practically suite SCA and chocking incidents in the Saudi populations [9]. The SHA recommends starting CPR with the sequence of circulation-airway-breathing (CAB) in the pre-hospital situations, while the sequence of ABC is still effective within the healthcare facilities. Thereby, delivering proper starting chest compressions as soon as possible before trying to open the airway and give rescue breathing is vital to high-quality CPR and optimizes the chance of return of spontaneous circulation and surviving the attack [11]. Unfortunately, the lack of interest in learning CPR and the fear of doing something wrong or of legal liability are obstacles limiting bystander to learn and perform CPR. Further, the retention of skills after CPR training has been demonstrated to be poor in several domains after only a few months [12].
Debriefing and retention of resuscitation performance: Debriefing involves a guided reflection in the cycle of experiential learning [13]. Especially in medical emergency, debriefing is a powerful tool to assure retention of resuscitation practice knowledge and skills, and hence positively influence patient outcome [14]. A variety of debriefing approaches are available to help refresh and maintain previously acquired CPR skills [15] [16]. Pre-training evaluation and feedback have been shown to improve CPR skills immediately following training. The need for efficient retraining is obvious, but the optimal format for refresher training is still one of the knowledge gaps to be addressed [14]. The research suggests that resuscitation training should be carried out at least every three to six months to prevent decay of information and skills which may well be lost during this duration. A resuscitation manikin with a real-time feedback mechanism to allow self-study and practice enhances performance both during training and after debriefing [15] [16]. New HFM designed for timely measuring of the core components of CPR performance (e.g., compression rate and depth, ventilation volume), using intuitive graphics and easy-to-follow guidance have been in line [17] [18].
Creating communities of lifesavers: After one minute of cardiac arrest, brain cells without oxygen begin to die. Meanwhile, an EMS response time can average 7 - 12 minutes, or even longer. By increasing bystander CPR works, there is a huge potential for increasing survival rates. The HSCI of Makkah [19] is a public safety program sponsored by Makkah governorate in partnership with the Ministry of Health (MoH) and Ministry of Education (MoE) in collaboration with SHA. The program seeks to save emergency heart conditions and proceed directly to the nearest health facility in a time consistent with what is universally recognized. Given the importance of Makkah in receiving huge numbers of pilgrims annually, improving the outcomes of OHCAs through training of target groups, civil defense staff, scouts, and hotels personnel around Makkah holy places is mandated. In addition, providing AEDs at all these places and equipping mobile teams with such devices, especially during peak times in the central Makkah region would be so helpful.
Rationale and study aim: One of the essential skills to achieve the prospective national health goals is having qualified public performing excellent life-saving CPR which is a cornerstone for life-saving following OHCA. Studies on the role of retention of the public’s CPR skills through debriefing in KSA are scarce. To the best of our knowledge, no studies were conducted concerning the CPR skills retention among public living in Makkah. The aim of the current study was to investigate retention of skills with and without debriefing three months after CPR training on HFMs among participants involved in the HSCI program of Makkah during the period from October 2017-January 2018. The participants’ ability to recall their performance, their response to debriefing after immediate post-training as a criterion standard, would be evaluated.
2. Subjects and Methods
A randomized controlled approach was adopted to achieve study aim. The experiment was held at the Simulation Center at Hera General Hospital, Makkah, KSA. Knowingly, Makkah is the holiest city to all Muslims and the spiritual capital of KSA. The study population encompassed all participants targeted in the HSCI program of Makkah during the period from October 2017 until January 2018. All male and female participants of all nationalities and professions would be included in the study, and only those who refused to participate were excluded.
Study sampling: The sample size for this study was based on primary outcome variable which was the score of retention 3-month post-training test for two groups of participants: experimental group (those who would receive debriefing among the training plan, and those who would not, i.e., control group) (see randomization). The score was calculated as a percentage out of 100. The sample size (n) was generated using the formula:
(where: μ1 = mean test score in the debriefing group, μ2 = mean test score in the control group, σ = standard deviation (SD) of 3-month post-training score, mean difference in the same score between experimental group and control group and = 30, assumptions of “n” = 10, SD of the retention post-training score = 10, α = 0.05, power = 80%) (http://www.sample-size.net/sample-size-proportions/). A sample size of 84 per group was calculated. In order to account for withdrawals, loss to follow up (LFU), or invalid data, “n” would be increased to 100 per group. Participants were stratified by gender and then from each stratum an equal number of participants was selected using a simple random technique (using a true random number generator) (http://www.random.org/).
Data collection: A registration form predesigned by the HSCI program was used to record the participants’ demographic data, including name, ID, date of birth, address, qualifications, occupation and working place. The training was on HFMs which were set up according to the standard CPR requirements of the SHA (connected to SimPad PLUS with SkillReporter to record data) [9]. Participants were asked to respond to a case scenario and were applying their skills on the HFM. Each participant was required to give constructive feedback while performing the CPR. The summary screen provides instant feedback of the session to debrief participant individually, (up to six manikins could be controlled while using SimPad PLUS with SKillReporter at a time). The training sessions were held on Sunday and Monday of every week for 16 weeks of study duration. Participants were briefed of the study’s aim and procedures; a verbal consent was considered as an acceptance to participate. The participants were further reassured of the voluntary nature of the study and that they could opt out of it at any time without giving reasons. They were also assured of the utmost confidentiality of the collected information and that only grouped and unanimous data would be disclosed for scientific purposes. At the beginning of the training day, participants would check in and fill the registration form. The session starts by pre-training test, and then to watch a video for an hour (the video demonstrates standard CPR for adults, children, and infants, and AED and choking rescue). Presentation then wraps up by answering participants’ questions.
Randomization: By the end of training session, each participant chose between two papers: one for debriefing and the other for control. Learners who choose the debriefing paper would be given a feedback on their performance and allowed to reflect by the instructor. Those who chose the control group, the instructor greeted them and asked them to come back again after three months for the post-training test. Following the trial, the instructor recorded the performance of a one-minute compression and ventilation-only CPR. By using SimPad PLUS with SkillReporter, each trainee performance was recorded by his/her name and compared with his/her retention test score. The passing score on each test was 50%. The score of final result includes the total mark of compression rate and depth and ventilation volume which was in total out of 100%. A participant who scores less than 50% would be debriefed again and the immediate post-training test score retaken.
Study variables and statistical analyses: The independent study variables include demographic data, as above, intervention (debriefing), pre-training test scores (often called pretest score), and immediate post-training score. The study’s dependent variable is represented by retention 3-month post-training score (often called retention or late test). First, descriptive statistics, including frequency data, would be displayed. Qualitative data, e.g., sex, profession, were summarized as count (%), and quantitative data, e.g., age and scores were summarized as the mean ± SD, range or the median [interquartile range (IQR)], where appropriate. The study’s inferential statistics plan was set so that first, the difference in scores of the selected tests would be analyzed between subjects and controls, e.g. to measure the influence of training upon the subjects’ retained CPR skills; second, the difference in scores would be measured within each individual group, e.g., debriefing group or the control group, and also within the study population as a whole group, and so forth. Utilized statistical techniques included parametric techniques (PMTs), such as t-test, e.g., to measure the difference between the means scores of two groups. In which case normality assumption would first be assessed suing normality tests, such as Shapiro Wilk test. Otherwise, a non-PMT alternative test, such as Mann-Whitney U, would be used. Likewise, paired t-test sample for the difference in the mean scores, e.g., before and after debriefing may be used. Chi-square test, or Fisher’s exact, where appropriate, would be used to test the differences between two categorical groups. Pearson correlation was conducted to assess the linear relationship between the retention score and other continuous variables, such as age, pretest score, and immediate score. The SPSS for Windows, version 21 (IBM Corp. Armonk, NY, USA) was used to perform the study’s statistical analyses. Our alpha level for tolerating type-1 error was α = 0.05; results with p-value < 0.05 were considered significant. An approval to conduct the study was obtained from the concerned agencies, including the Research Ethics Committee of the General Directory of Health Affairs of Makkah, MoH. A permission to conduct the experiment at Hera General Hospital was also granted from the hospital’s administration.
3. Results
Among a total 202 participants, 106 (52.5%) were men and 96 (47.5%) were women, with mean age 37.62 ± 9.40 (Table 1). Only 11 (5.4%) were non-Saudi and 191 (94.6%) were Saudi. The number of participants with teaching profession accounted 78 (81.3%) in the debriefing group and 68 (70.8%) in the control group, while 23 (11.4%) participants were staff from Umm Al-Qura University (UQU) (in the two groups). Otherwise, neighborhood-centers participants were males with different age strata 29 (14.4%); and students were only 4 (4.2%) in both groups (Table 1).
Only whole study population’s retention score was significantly higher among debriefing than the control group [means = 65.2% ± 16.8% and 32.4 ± 18.2%, respectively, t(df = 200) = 27.7, p < 0.001] (Table 2). There were not significant differences in the two group’s scores either before or immediately after training (U = 5079.5, p = 0.98; U = 4529.5, p = 0.18, respectively).
As in Table 3, individual “within group” comparisons are conducted. The immediate scores were significantly higher than pretest scores in the three analyses: whole study population [mean difference 38.05% ± 27.59%, t(df = 201) = 13.5, p < 0.001]; debriefing group [mean difference 40.68 ± 29.26, t(df = 105) = 14.31, p < 0.0001]; and control group [mean difference 35.06% ± 25.44%, t(df = 95) = p < 0.0001]. Likewise, the retention scores were significantly higher than those before the training for all analyses: all study population (n = 202) [mean difference 40.35% ± 27.5%, t(201) = 20.85, p < 0.0001]; debriefing group (n = 106) [mean difference 52.57% ± 25.22%, t(105) = 21.46, p < 0.0001]; control group (n = 96) [mean difference 26.86% ± 23.39%, t(95) = 22.12, p < 0.0001].
In Table 4, the debriefing group reported significantly higher scores in 3-month than the immediate post-training scores [mean difference 11.88% ± 25.67%, p < 0.0001]. Conversely, controls had performed significantly worse on the 3-month test than the immediate test (mean difference −8.19% ± 27.20%, p < 0.0001).
In Table 5, there was a significantly mild correlation between the retention and immediate post-training scores of the study population as a whole group (r = 0.37, p < 0.0001). The debriefing group scored significantly higher on the retention test than the controls [58.84% ± 20.89% vs. 33.60% ± 19.01%, t(df 200) = 8.76, p < 0.0001]. Teachers also tended to score higher on the same test than other professions [49.81 ± 22.28 vs. 39.13% ± 26.61%, t(df 200) = 2.88, p < 0.004].
![]()
Table 1. Comparing intervention and control groups by demographics criteria.
![]()
Table 2. Pretest, immediate, and 3-month retention scores: Debriefing group vs. control group comparisons [n (debriefing) = 106] [n (control) = 96].
* Debriefing: Mean: 6.7 ± 14.0; median 3.5; Controls: Mean 6.7 ± 14.0, median 3.7. ** Debriefing: Mean: 49.8 ± 23.1; median 50.0; Controls: Mean 46.6 ± 24.1, median 50.5.
![]()
Table 3. Pre-training and post-training scores: Within group comparisons.
![]()
Table 4. Comparison of immediate and 3-months post-training-retention scores.
![]()
Table 5. Factors affecting 3-months post-training retention scores of the study population.
4. Discussion
Cardiac arrest is a universal health problem correlated with high levels of mortality [3]. During the VF dysrhythmia which usually takes place in OHCA [2], CPR does provide a source of oxygenation to the tissues and may lead to restoration of a viable cardiac rhythm [20] [21]. The earlier and more successful CPR, the more likelihood of a favorable cardiac arrest outcome [9]. Since most OHCA occurs in the home and public places, training public about quality CPR has the potential to save the lives of countless loved ones stricken by cardiac arrest. Alarmingly, too, OHCAs may often originate from non-cardiac conditions, e.g., trauma, drowning, drug overdose, electrocution [22] [23]. Yet, most OHCA incidents, irrespective of the etiology, do not get bystander-assisted CPR [24]. The American College of Emergency Physicians (ACEP) supports and strongly encourages CPR training for the lay public. This training should be short, easy to understand, and easy to remember [25]. This study aimed to investigate retention of skills with and without debriefing 3 months after CPR training among participants involved in HSCI program. Most of the participants were teachers, probably because the study’s data collection coincided with the MoE-sponsored HSCI program, the enrollees of which are MoE-affiliated staff and school teachers.
The current study demonstrates that people debriefed about their CPR performance could achieve a higher score on 3-month post-training test compared with those who were not. This finding is consistent with some other studies [26] [27], with some differences in study design and the outcome measures used. First, our participants were randomly assigned to the study tracks and their resuscitation skills were evaluated with the same system. Second, we took the time needed for debriefing among intervention group and assessed appropriate high-quality CPR skills. Previous studies [26] [27] only used a questionnaire to evaluate knowledge. In support of our finding, too is that multiple guidelines recommend debriefing of resuscitations to improve retention of CPR skills [15]. Fanning et al. (2000) [28] found that much of the research regarding teaching adults indicates that active “participation” is an essential factor in increasing the effectiveness of learning and retained knowledge in this population. Although many learning practices require feedback, debriefing is a particular kind of feedback process. On the other hand, there is substantial evidence about the declination of CPR skills after the initial training [15]. However, there was not a consensus regarding the optimal time interval between practice and the evaluation results at the end of CPR training [27]. Moser et al. studied CPR skills retention in 31 family members of cardiac patients. Of those tested at seven months, more than half were rated ‘‘poor’’ in the initial assessment, chest compression, ventilation, and overall CPR [29]. Thiagarajan et al. [30] reported that, although many learning practices require feedback to keep in mind, debriefing was the best feedback process to enhance improvement of learning. Basic skills, such as asking for help; chest compression, and ventilation, decay 3 - 6 months after the training. However, these data were based on independent studies regarding the courses’ duration and design, characteristics of instructors and participants and frequency of participants’ involvement in real resuscitations [27] [31]. Woollard et al. [32] training laymen from a UK airport, observed that the interval in CPR training should not exceed 7 months. Riegel et al. [29] studying lay volunteers, found a satisfying degree of retention in CPR and AED, even after as long as 17 months of primary training.
In a telephone survey about public knowledge and attitudes towards CPR in Hong Kong [26], the skills appeared to have deteriorated with time. The present study expectedly shows a deficient quality of CPR skills regarding pre-training test performance among all participant groups. This result is similar to Edelson et al. [33] who showed that CPR performance immediately after training was as limited as good as that seen with basic Heart saver training. Korttila et al. [34] reported that CPR performance of the laymen was measured with a recording manikin before 2-months after the training. Before training, none of the subjects passed the surprise resuscitation test. Fernandes et al. [27] reported that 96% of their high-school students reported meager rates of correct answers before training about essential life support. The present study showed significant high rates of the immediately posttest scores both in the debriefing and the control groups. As in this work, the use of standardized training kits, including videos and manikins, proved effective in resuscitation training. Ribeiro et al. [35] demonstrated the effectiveness of a commercially available training tool encompassing a video and manikin in immediate and delayed retention of knowledge and skills 6 months after CPR training. Using debriefing as the principal intervention to measure its effect on retaining previously-acquired CPR skills in this study allowed our participants to reflect on their performance regarding their psychomotor skills immediately after training and highlight where they performed well and where they needed to improve. Such immediate post-event debriefing has been shown to yield significant results regarding improving performance when combined with hands-on training [36] [37]. The HFM proved a valuable tool, since it promotes physiological changes via an electronic system in response to training, and registers performance in a timely fashion [36]. High-fidelity-based simulation enables a lay bystander to experience such scenarios and potentially reduces anxiety in real situations [38]. In line with the notion that high-quality CPR by far requires building-up efficacious psychomotor skills of trainee candidates, the current study focused primarily on practice regarding measuring skills in performance throughout the training experience, thanks to providing hands-on training and debriefing to the study subjects. With this respect, the study shows a high rate of CPR skills retention 3-months after training in the intervention group. Miotto et al. (2010) [38], and Everett-Thomas et al. (2016) [39], too provide evidence to the positive role of hands-on training combined with debriefing upon CPR performance. In contradiction, theoretical training alone has been shown to produce poor-quality gains [38] [39].
Our study presents that being a teacher, immediate post-training test status, and debriefing are likely predictors for a positive change in the retention test performance, a finding that pretty much agrees with what has been found in literature [36] [37]. However, age, gender and nationality did not influence the retention score, e.g., in disagreement with Papalexopoulou et al. [40] who reported that age, and education could affect retention of CPR/AED skills in lay rescuers. As age progresses, one may become more and more unfamiliar with computer-based presentations, as well as with the use of technical equipment, such as the manikins or the AED [40]. The study may have been limited by the inability to recruit a wide scope of Makkah population. However, being the first randomized controlled study to compare retention of CPR skills among the general public of Makkah adds to the experimental design adopted, in addition to the blindness of participants to the performance measurements used. Based on the findings of the current study, it can be concluded that retention of CPR skills among Makkah people was improved with debriefing compared with non-debriefing. Debriefing does enhance retention in the publics’ group for 3-months after the initial training. High-quality CPR and the percentage of compressions at correct depth, all are improved, significantly. As such, we recommend encouraging the public to attend CPR courses, pretty much of which are sponsored by the SHA in collaboration with MoH. Participant would rather be debriefed after the CPR session to enhance the retention of skills. Putting in place refresher courses, especially for those types of participants would also be useful in achieving the ultimate goal of turning Makkah into a heart safe city.
Acknowledgements
We wish to express our sincerest thanks to Dr. Bakr Kalo for his helpful advice and unlimited assistance. We also thank Dr. Noha Saleh Mohamed, professor of public health, High Institute of Public Health; Alexandria University, Egypt for her valuable advice on the methodological and statistical plan outlines for this work. Also, thanks to all the members and participants of “A Heart Safe City Initiative” for their cooperation and kindness. Many thanks to Miss. Faizah Al-Dosary and Mr. Maher Al-Hazmi for their scientific and technical support.