Satisfaction of Patients Examined with Mobile X-Ray vs. X-Ray at the Hospital—A Randomized Controlled Trial ()
1. Introduction
1.1. Background
1.1.1. Mobile X-Ray
Mobile X-ray examination takes place outside the hospital setting using transportable X-ray equipment. It is offered to patients when a transfer to the hospital at the radiology department may be an obstacle, and the referring doctor, therefore, considers it preferable for the patient to be examined in their homes. Mobile X-ray is used in countries including Norway, Sweden and Italy [1] - [8]. In Aarhus Municipality of Denmark, elderly patients living in aged care facilities have been offered mobile X-ray examination since the year 2014 [9]. Patient’s frailty is the reason why they are offered mobile X-ray.
1.1.2. Satisfaction
Patient satisfaction is important for compliance with care, continuity of care, and the relationship with the care giver [10] [11]. Various validated and general tools have been developed to explore the patient’s experience with the given care, such as the “Quality of Care through the Patient’s Eyes” and the “Consumer Assessment of Healthcare Providers and Systems” surveys [12] [13]. Unfortunately, the questionnaires in these tools are intended to measure the experience of care at the meso level of healthcare and not satisfaction with the examination. Even though measuring patient satisfaction is challenging, it is important in order to improve and assure the quality of care in the use of mobile X-ray. Therefore, a tool specifically developed using questions concerning patient’s satisfaction is needed [14].
1.1.3. Satisfaction with Mobile X-Ray
Qualitative and quantitative studies report that patients, relatives and healthcare staff are satisfied with mobile X-ray [2] [7] [8] [15]. Eklund studied patient’s satisfaction in a descriptive study, but only half of the patients were able to respond [2]. Ricauda studied patient’s satisfaction in a pilot Randomized Controlled Trial (RCT), and reported a high level of satisfaction, but the authors did not describe the data collection methods [7]. Vigeland studied satisfaction by interviewing the referring doctors, but not the patients [8]. A commonality of the studies is that they report a high level of satisfaction with using mobile X-ray.
1.1.4. Measuring Satisfaction with Mobile X-Ray
Measuring patient satisfaction is complex due to the multiple variables affecting satisfaction, especially in a frail and very ill patient population. Therefore, determining how to measure patient satisfaction was a challenge. In a pilot questionnaire study of 10 aged care facility patients, we asked questions concerning the patients’ moods or physical aspects, which were possible for the patients to answer. However, in terms of questions concerning the X-ray examination, some of the patients did not even know that they had been examined and therefore were unable to answer questions concerning their satisfaction with the examination, probably because the majority of the patients were very frail and had cognitive impairments [16].
1.1.5. Aim
Our aim was to investigate whether patients in aged care facilities, who were offered mobile X-ray, were more satisfied with the X-ray examination compared to patients examined with X-ray at the Department of Radiology at Aarhus University Hospital.
2. Materials and Methods
The reason to develop a questionnaire measuring satisfaction was so that we could develop a questionnaire specific to our context, with a focus on the specific patient group, to compare the level of satisfaction. We found that asking healthcare staff to answer on behalf of fragile patients was the best method, even though the proxy answers from healthcare staff and family differ from the patients’ answers for both patients with or without cognitive impairments. However, when nursing home residents are both more and less cognitively impaired, the agreement of answers between nursing home residents and proxies is slightly better [17] [18] [19]. Therefore, proxy answers were the best method in our study.
2.1. Patients
2.1.1. Inclusion Criteria
Patients were recruited from nursing homes and homes for the elderly in Aarhus Municipality. Patients were eligible for inclusion if they had been referred for a mobile X-ray examination.
2.1.2. Exclusion Criteria
Patients hospitalized at the University Hospital, homeless patients, handicapped patients and patients already examined with mobile X-ray in the study period were excluded.
2.1.3. Ethical Considerations
We had several ethical considerations in conducting a RCT in this study population, because the patients were fragile. The patients needed a mobile X-ray examination because of a referral and therefore, it may not have been ethically appropriate to offer them an X-ray at the hospital, as the patients may not have been able to attend their appointment. On the other hand, had mobile X-ray not existed, the patient would not have been offered a mobile X-ray and therefore would have had to be examined with X-ray at the hospital. Also, mobile X-ray was not offered with solid evidence and therefore, the patients were randomized in order to study the evidence of mobile X-ray, where half of the patients were examined with mobile X-ray and the other half was examined with X-ray at the hospital. Therefore, we thought that it was ethically appropriate to randomize the patients.
The study was approved by the Ethical Committee (53,811) and Data Protection System (1-16-02-124-15) in the Central Denmark Region and registered at https://clinicaltrials.gov/ (NCT04005040). Involved departments at Aarhus University Hospital gave their consent for examining the Electronic Patient Journal (EPJ). Informed consent was not obtained because the study was approved as an organizational study by the Ethical Committee.
2.2. Study Design
The study reported in this paper, was part of a non-blinded RCT where we studied and documented the effect of mobile X-ray in aged care facility patients as a part of a Ph.D. study, where hospitalizations was the primary outcome [16]. Patients examined with mobile X-ray were compared to patients examined with X-ray at the hospital. A power analysis was conducted for the main study, but no power analysis was conducted for the study reported in this paper. Assessing satisfaction with mobile X-ray, was one of the studies conducted.
2.2.1. Randomization and Blinding
After the patients were referred for mobile X-ray, they were randomized to either be examined with mobile X-ray in their own home (nursing homes or homes for elderly) or X-ray at the University Hospital, at the Department of Radiology. The computer program Redcap was used to randomize patients via a computer-generated block randomization with blocks of eight patients in each group. It was not possible to blind anyone in the study due to the characteristics of the intervention.
2.2.2. Inclusion of Patients
The inclusion period started on May 1, 2018 and lasted until April 12, 2019. In that period, 177 patients were randomized to be included in the study. Of the 177 patients, 43 patients were excluded due to not fulfilling the inclusion criteria and three patients were excluded because they did not complete the examination. A total of 131 patients were included as treated and of those questionnaires were answered on behalf of 66 patients in the intervention group and 63 patients in the control group. In Figure 1, patient inclusion flow is shown.
2.2.3. Intervention Group (n = 66)
The intervention group comprised patients examined using mobile X-ray in their own home/institution and their careers, who answered the questionnaire.
2.2.4. Control (n = 63)
The control group comprised patients examined using X-ray at Aarhus University Hospital and their careers in their respective nursing homes, who answered the questionnaire.
2.3. Development of the Questionnaire
2.3.1. Evaluation of the Pilot Project Mobile X-Ray
In 2015, we conducted an evaluation of mobile X-ray, where we measured satisfaction using self-developed questionnaires for patients, relatives and healthcare staff. The items were formulated using knowledge from the literature and observations from our own project [2] [5] [7] [8] [9] [15] [16] [20]. In the evaluation, we concluded that the questionnaires needed to be further developed [9]. The further development of the questionnaire was based on observation studies and interviews to develop the questions.
2.3.2. Observation and Interview Study
Observation studies of 10 patients (selected patients who were examined with mobile X-ray or X-ray at the hospital) and interview studies of 10 different healthcare staff, four patients and two healthcare staff were conducted to gain knowledge to further the development of the existing questions. In that process, we found that relatives did not participate in the examination as often as we thought. Many of the patients were too fragile to answer questions concerning satisfaction.
2.3.3. The Questionnaire
From the knowledge gained in the observation and interview studies, we decided to develop a questionnaire for patients, where healthcare staff would be asked to answer on their behalf. We used the knowledge gained from the evaluation, literature, observations and interviews to develop new questionnaires for patients, relatives and healthcare staff [2] [6] [7] [8] [9] [15]. This resulted in 13 questions.
A pilot was conducted with 10 participants including both patients and staff. We tested the questionnaire using both a binary yes/no answer category and Likert style scale. The pilot confirmed that patients were not able to answer questions concerning the examinations. The response from the majority of healthcare staff was that answers should be expressed on a scale. None had time for writing comments. We ended up with five different answer categories and included 13 questions related to patient experience for patients and one question related to healthcare experience for healthcare staff. In the questionnaire, patients are called citizens because this is the term used by nursing homes in Aarhus Municipality. After the pilot, the final questionnaire was tested on five random healthcare staff members and afterwards, we conducted the study [21] [22].
2.3.4. Themes in the Questionnaire
In order to analyze satisfaction and understand mobile X-ray, we categorized the questions into themes inspired by the literature and from our own observations, interviews and pilot study [2] [7] [8] [9] [15]. The answers to questions 1 - 3 expressed overall satisfaction with X-ray in general. Questions 4 - 9 were about satisfaction with the X-ray examination. Questions 10 - 12 were about satisfaction concerning circumstances after the X-ray examination and question 13 dealt with the possible mental effects following the patient’s X-ray examination.
2.3.5. Data Collection
The data collector in the observation study, interview study and the questionnaire pilot was the same researcher. This researcher also administered the questionnaire, which healthcare staff answered. The researcher developed the observation guide, interview guide and questionnaires in cooperation with the supervisors and staff at the Department of Radiology.
The data of the final questionnaire were collected by a data collector trained for the purpose. Before the data collection started, the data collector was trained in using the questionnaire on a similar study population. The data collector had no interest in the final results.
The data collector collected data within a week after the X-ray examination in the patients’ homes.
2.4. Statistical Analysis
The statistical comparison of each question in the questionnaire data was done using Fisher’s exact test to determine if there were nonrandom associations between the intervention group and the control group. We used this test because Fisher’s exact test allows values below 5, which was the case in all questions [23]. The analysis was performed on single items and not on scale items. The analysis was performed as treated and not intention to treat because of missing after the randomization. The intervention group was the explanatory variable and a two-sided P-value below 0.05 was considered as an indicator of statistical significance. We gave the answers values in order to conduct the statistical analysis. The answer “extremely” had the value of 1, “quite a bit” 2, “slightly” 3, “not at all” 4 and “do not know” 5. The value of 5 was excluded in the statistical analysis, but the answers are shown in Table 1. The reason for exclusion of “do not know” was that this answer had the value of 5. This value may point at an unintended meaning in the analysis as we do not know what value the respondent would have given when the other categories are categorical. The answer “do not know” is not a missing value, because no one answered “do not know” in all questions for a patient.
3. Results
The results in Table 1 show that patients living in aged care facilities in Aarhus Municipality asked by proxy were significantly more satisfied with being examined by mobile X-ray (intervention) in their own homes than having an X-ray at the hospital (control). All results were significant, but those with the highest effect size were question four, where 92% in the mobile X-ray group vs. 60% in the X-ray at the hospital group experienced an extremely respectful examination. Also in question seven, 92% in the mobile X-ray group vs. 40% in the X-ray at the hospital group felt extremely safe in the surroundings where the examination was performed.
The responses of healthcare staff about patients’ overall satisfaction showed that 85% of the patients in the mobile X-ray group and 27% of the patients in the X-ray at the hospital group were extremely satisfied. In response to whether the patient was satisfied, the results from healthcare staff show that 89% of the mobile X-ray group and 35% of the X-ray at the hospital group were satisfied.
The clinical meaningfulness of the differences in the results is that both healthcare staff and patients have a higher level of satisfaction, when the patient is examined at home. However, at the same time we do not have documentation over whether the significant difference in patient satisfaction impacts patient treatment outcomes.
4. Discussion
The collected data of the questionnaire we developed showed a significantly higher level of satisfaction with mobile X-ray compared to X-ray at the hospital in all questions.
Ricauda et al. also studied patient satisfaction with mobile X-ray and found that 49% of patients reported that satisfaction with mobile X-ray was very good or excellent. This result is in accordance with our study of patient satisfaction
Table 1. Patient satisfaction measured using a self-developed questionnaire tested by using Fisher’s exact test (n = 129).
* P-value below 0.05 determines statistical significant differences between the intervention and control group.
[7]. Eklund and colleagues studied satisfaction with mobile X-ray and found that both patients and healthcare staff members had positive experiences with mobile X-ray. Of the 123 patients included in their feasibility study, 62 patients were able to answer the questions and none gave a negative response [2]. Unfortunately, the authors did not describe why only half of the patients answered. It might be the healthiest patients who were able to answer, which could result in a positive bias in favor of mobile X-ray. In our RCT studying the effect of mobile X-ray on hospitalizations as the primary outcome, we experienced missing values in the cognitive test with patients, because they were very ill and fragile [16]. Therefore, it seems to be the best choice to have healthcare staff answering on behalf of the patients due to the otherwise expected low response rate.
To our knowledge, this RCT is the first to measure the satisfaction of patients examined with mobile X-ray outside the hospital compared with patients examined with X-ray at the hospital. Our aim was to measure satisfaction from the patient’s point of view. We wanted to examine whether patients offered mobile X-ray are equally or more satisfied than patients offered X-ray at the hospital.
High satisfaction with mobile X-ray is well known in other non-RCTs. The main strength of our study is that we were able to measure the satisfaction of aged care facility patients; in this patient group it is difficult to measure satisfaction due to the large number of patients who are frail and have cognitive impairments. We measured satisfaction using a questionnaire, but the questionnaire may need to be further developed in order to better differentiate between the patient groups, because in general all answers were positive. It might be preferable to use another scale in the answer categories, because it could be easier for patients to choose between yes or no. We only had three non-respondents due to the patient not completing the examination and a response rate of 98% from healthcare staff. The positive result and high response rate could be an expression of healthcare staff finding it important to examine the patient with X-ray, because aged care facility patients in our study are so frail [16]. The result was extremely dependent on the willingness of healthcare staff and them having time to participate, but it is our opinion that the healthcare staff is the ones who have the best contact with the patient.
It was not possible to measure satisfaction by asking the patients and therefore the results might reflect the healthcare staff’s satisfaction rather than patient satisfaction. However, healthcare staff was asked to answer from the patient’s point of view and using this method was the only possibility of measuring patient satisfaction. Therefore, in our opinion this was the best way to guarantee the scientificity and reliability of the study.
It was well known in Aarhus Municipality that mobile X-ray was a pilot project and in measuring satisfaction based on healthcare staff, the results may have led to bias towards positive statements about mobile X-ray in order for the project to continue. If mobile X-ray were not to be offered, the patients in the aged care facilities may not be examined with X-ray at all, which may result in a treatment encumbered with uncertainty. Studies report that when mobile X-ray is offered, more patients are X-ray examined, leading to further treatment and prevention of hospitalization [8] [24]. If healthcare staff members were unsatisfied, it could result in mobile X-ray not being offered any more. Kjelle et al. studied satisfaction in implementing mobile X-ray in nursing homes and found that healthcare staff only had positive experiences [25]. We experienced the same in our interview study, where healthcare staff reported that it eased the work day by not having to administer and coordinate the examination, including transporting the patient to the hospital. The same result was found by Thinges et al. in their qualitative interview study of expectations when implementing mobile X-ray in nursing homes [6]. We are aware that the positive response from healthcare staff could reflect bias in order to keep mobile X-ray going as part of the existing health services for a very vulnerable patient group, but on the other hand, the positive result may also reflect mobile X-ray being a good alternative for frail patients and healthcare staff.
5. Conclusion and Prospect
Our questionnaire study shows that healthcare staff answering on behalf of frail patients thought that the patients were significantly more satisfied at being examined by mobile X-ray in their home than having an X-ray at the hospital. This is relevant to clinical practice, because the X-ray examination is adapted to the patients’ needs and the patients are more satisfied being examined at home compared to being examined at the hospital.
Recommendation for Further Research
Our recommendation for further research is to directly study the satisfaction with mobile X-ray from the patients’ point of view, because satisfaction might influence the treatment of the patient.
6. Ethical Approval and Consent to Participate
The study was approved by the Ethical Committee (53 811) and Data protection system (1-16-02-124-15) in the Central Denmark Region and registered in Clinicaltrials.gov (NCT04005040). Involved Departments at Aarhus University Hospital gave their consent for looking in the Electronic Patient Journal (EPJ).
Acknowledgements
We thank the Department of Radiology at Aarhus University Hospital for providing general support to conducting the study.
Funding
This work was financially supported by The Department of Radiology, Aarhus University Hospital, Denmark.