Construction of the First Certification Evaluation Index System for Diabetes Specialist Nurses by Delphi Method ()
1. Introduction
With the development of social economy, the prevalence of diabetes is rising world widely. According to the statistics of the International Diabetes Federation (IDF), it is estimated that 380 million people will be diagnosed with diabetes by 2025 [1]. A survey conducted by the Diabetes Branch of the Chinese Medical Association, published in the New England Journal in March 2010, shows that the number of patients with diabetes in China has exceeded 92 million [2], making it a major diabetic country. In order to cope with the growing population of diabetic patients and the resulting economic and medical burdens, diabetes specialist nurses have been trained throughout the country [3]. However, there is no uniform standard for the selection, training, assessment and certification of diabetes nurses in China so far [4] [5]. In this study, the Delphi method was used to establish an evaluation index for the first certification of diabetes specialist nurses, which is expected to provide a reference basis for the certification of diabetes specialist nurses.
2. Steps and Methods
2.1. Set up a Research Team and Select Consulting Experts
The research team consisted of 5 people, including 1 director of nursing department, 1 head nurse, and 3 graduate students. 30 clinical experts, involving nursing management, nursing education, clinical nursing, community nursing, medicine, were selected from 10 provinces in East China, South China, West China, North China, and Central China. Every expert is either from Class A First Class Hospital or from college of advanced nursing with the technical title of deputy senior or above (except the experts from clinical nursing, whose minimal title is intermediate level). The experts with bachelor degree or above have more than 10 years of experience in diabetes or related majors.
2.2. Research Tools
After the research team has determined the theme, it will consult the development of A) specialist nursing through the library, Internet and electronic literature database; B) the history of the development of specialist nurses in diabetes and other fields; C) the selection criteria of specialist nurses; D) the training of specialist nurses System, assessment method; E) specialist nurse certification body, evaluation standards and certification standards and other related documents, literature, books and report materials. The author established the preliminary index system through literature review, specialist interview and group discussion and used Delphi method to organize three rounds of 30 experts’ consultations. Key words of database retrieval include: diabetes specialist nurses, current situation and development of specialist nursing, selection criteria, system specifications, assessment methods, certification bodies, evaluation criteria, etc. Review the collected literature content (see Figure 1 for the selection process of literature data and Table 1 for the selection content).
![]()
Figure 1. Selection process of research materials.
![]()
![]()
Table 1. Research materials of literature review and selection.
The first round of expert consultation questionnaire was formed based on literature review and expert interviews. The questionnaire contains three parts: the basic information of the expert, the text of the questionnaire comprising of the importance of indicators and the recommended modification by the expert as well as the familiarity of the expert with the question and the main basis for the expert to judge. The importance of indicators is based on the Likert scoring method, which is from very important to unimportant (1 - 5 points, respectively) [6]. Experts’ familiarity with various indicators is divided into 5 levels: unfamiliar, not very familiar, general, relatively familiar, very familiar. Three rounds of questionnaires were distributed and received by email.
2.3. Statistical Methods
The results were processed and analyzed by Microsoft Excel 2003 and SPSS17.0 to establish a database. The questionnaire response rate (%) is used to reflect the enthusiasm of experts. The degree of coordination of expert opinions is expressed by the coefficient of variation (Vj) of the evaluation results of various indicators and the Kendall’s W coefficient of expert opinions and its significance test, where Vj represents the degree of fluctuation of the relative importance of the indicators, and the smaller the Vj, the higher degree of coordination of expert opinions; The coordination coefficient (W) ranging between 0 - 1 is used to test whether the opinions of experts on the indicators are consistent, the larger the value, the higher the coordination of the opinions of the experts. Significance test was performed on W, if P < 0.05, it means that the experts have consistent scores on the indicators, indicating the results are desirable. The selection of research indicators is based on the criteria of satisfying both the mean value of importance value > 3.50 and the coefficient of variation ≤ 0.25. At the same time, combined with expert opinions, the indicators are screened by the collective review of the research team.
3. Results
3.1. Basic Situation of Consulting Experts
A total of 30 consulting experts participated, 17 of them aged 40 - 49 years old, accounting for 56.7%. 90% of the experts had more than 20-year working experience and had professional titles as deputy senior or higher. All of them had bachelor’s degree or above including 11 professors (36.7%). There were 15 experts major in clinical nursing (50%) and 8 experts major in nursing management (26.7%). Except for one from nursing colleges, the remaining 29 were from the Class A First Class Hospitals.
3.2. The Questionnaire Recall Situation
30 questionnaires were distributed each round, and the first round had the effective response rate 100%; the second round, 86.7%; the third round, 100%.
3.3. The Degree of Authority of Experts
The degree of expert authority is reflected by the basis of experts’ judgment on indicators and the familiarity of experts with indicators [7] [8] [9]. The average authoritative degree of experts in three rounds of consultation were 0.77 - 0.94, 0.87, 0.87, respectively. It is generally considered that the degree of expert authority ≥ 0.7 is acceptable [7]. Thus, the degree of expert authority in this study is relatively high.
3.4. The Degree of Concentration of Expert Opinions
The degree of concentration of expert opinions is expressed by the mean and standard deviation of importance assignment. The larger the mean, the more important the indicator is. The average values of the indicators in the three rounds of investigation were: 3.38 - 4.93, 2.67 - 5.00, 2.90 - 5.00; and corresponding standard deviations were: 0.13 - 0.91, 0.10 - 1.06, 0.00 - 1.01, respectively.
3.5. Degree of Coordination of Expert Opinions
After three rounds of consultation, the coefficient of variation of the third round of index assignment was 0.00 - 0.38. The Kendall harmony coefficients W of experts in the three rounds of consultation were 0.366, 0.374, and 0.382, respectively, and the significance test P < 0.01 indicated that the experts’ opinions were well coordinated, and the results were desirable.
3.6. Expert Consultation Results
According to the selection criteria of the indicators and discussion by the research group, the indicators that failed both directions were deleted, and the indicators that failed one way were included in the next round of continued discussion. Due to space limitations, only the first two rounds of results were attached (Table 2).
4. Discussion
4.1. Representativeness of Experts and Reliability of Prediction
The selection of experts plays a key role in the Delphi method. In the study, we fully considered the professional representativeness, academic authority and geographical representation of experts. The selected experts include East China, West China, South China, North China, and Central China; their research areas include clinical nursing, nursing management, nursing education, community nursing and clinical medicine. The experts have a high level of knowledge and years of working experience in their professional fields. Many experts serve as Master or PhD supervisor. Moreover, the average authoritative coefficient, coordination coefficient and consistency of experts are relatively high; therefore, the representativeness and predictability of experts in this study are satisfied.
4.2. Analysis of the Evaluation Index System for the First Certification of Diabetes Specialist Nurses
Diabetes specialist nurses are nursing experts, and thus it requires that they should have certain professional abilities. Educational background and professional title are important factors that reflect the theoretical knowledge level and clinical professional skills of clinical nurses [8]. The years of working experience as a diabetes specialist can indirectly reflect the accumulated experience of the diabetes specialist nurses. The computer skill is a necessary part of the knowledge structure of expert talents. Nursing scientific research is an important means to promote the development of nursing science and to improve the quality of clinical nursing [9] [10] [11]. Specialized nurses conduct evidence-based
![]()
Table 2. Mean value and coefficient of variation of the first and second round evaluation indicators.
Note: * indicates that it does not meet the criteria for index screening.
nursing research on new evidence found to continuously improve nursing practice [12]. However, according to the actual situation in China, the overall English level and scientific research level are limited. Even graduated from the nursing department, they have difficulties in communication in English resulting in that they can only obtain the latest foreign knowledge and information indirectly [13]. Thus, treating “Funded research” and “English proficiency” as fundamental indicators is not desirable, but in view of their importance, we decided to include the “annual average paper publication status”, which is relatively easier, and the “English proficiency” is listed as one of the first-level indicators.
The construction of this research indicator framework is guided by the “Attitude Skill Knowledge” (ASK) theory. The ASK theory [14] [15] was proposed by professor Mayo from Harvard University in the 1860s and he pointed out that there is a progressive relationship among knowledge, attitudes and skills, in which knowledge is the foundation of skills; attitude is the motivation to acquire skills, and acquisition of skills is the goal. The first-level indicators of this study not only cover professional attitudes, professional knowledge, professional skills, and core competencies, but also consider personal characteristics; in the second-level indicators, there are specific requirements for each item, which can be used to systematically and comprehensively evaluate diabetes specialist nurses. In terms of professional attitude, nursing is the most humanized profession. Only people with love and service consciousness can be qualified for this noble profession. In terms of professional knowledge, diabetes specialist nurses are nursing experts in the field of diabetes, and they are required not only to master precise and specialized nursing theory, basic knowledge, and specialist knowledge, but also to be familiar with the frontier knowledge in the field of diabetes, health policies, organizational management, health economics and social sciences. IN terms of professional technology, a diabetes specialist nurse should not only master the nursing skills of this specialty, but also master the use of diabetes related instruments and the skills of cooperation with other medical personnel to provide systematic, comprehensive and holistic care for patients.
In terms of core competence, in order to enable diabetes specialist nurses to be competent for different tasks, including disease prevention, health promotion, and nursing of acute and chronic diseases, it is necessary to cultivate the professional attitude, professional knowledge and technology of diabetes specialist nurses. As for personal characteristics, nursing tasks are heavy, and only a nurse with a healthy body can be competent. When dealing with pressure from work and life, they should reasonably control their emotions, adjust themselves, fully understand themselves and make appropriate evaluations of themselves.
4.3. Suggestions on the Implementation of the First Certification Evaluation Index System for Diabetes Specialist Nurses
1) It is necessary to establish relevant systems and legal regulations for the certification of diabetes specialist nurses. At present, the current status of the practice of diabetes specialist nurses in our country is neither compliant nor rule-based [16]. Only by guaranteeing the legal certification of diabetic specialist nurses and having the law to be able to guarantee the healthy operation of the diabetic nurse certification mechanism, should the government be given full play to standardize the management of diabetic nurses and ensure the quality and control of diabetic nurses.
2) It is also necessary to encourage the establishment of statutory social intermediary institutions, which are entrusted or authorized by the government to certify diabetes specialist nurses and other specialist nurses. It is an independent non-profit organization between the government, society and medical units. The organization can be scientific groups or professional associations. The legal social intermediary organization can guarantee the objectivity and fairness of the certification and evaluation of diabetes nurses.
3) It is recommended to formulate the first certification procedure for diabetic specialist nurses according to the following procedures: a) An individual submits a certification application to the relevant certification organization with corresponding application materials; b) The certification organization conducts the qualification review of the applicant according to the certification standards; c) Applicants are required to conduct theoretical assessment; d) Interview; e) Comprehensive evaluation of clinical ability; f) Issue of diabetes specialist nurse certificate. Standardized first-time certification procedure of diabetes specialty nurses can make the certification of nurses more convenient and standardized.
The government should strengthen the selection of certified experts, closely connect academic experts. In additional to management authorities and industry, other parties should participate and cooperate with one another in order to give full play to their respective advantages. To strengthen the combination of certification and the practice registration system, we must not only allow practice registration to promote the development of professional certification, but also reflect that certification is the basis for the effective implementation of the practice registration system.
NOTES
*Co-first author.
#Corresponding author.