Improvement of the Quality of Basic Clinical Skills Training and Evaluation of the Efficacy of Objective Structured Clinical Examination (OSCE): An Action Research with a Mixed Method

AUTHORS

Esmat Nouhi 1 , * , Sakineh Sabzevari ORCID 2 , Hakime Hosainrezaee 3

1 Medical and Nursing Education, Nursing Research Center, Physiologic Research Center, Kerman University of Medical Sciences, Kerman, Iran

2 Medical Surgical Nursing Department, Razi Nursing Faculty , Kerman University of Medical Sciences, Kerman, Iran

3 Nursing Research Center, Kerman University of Medical Science, Kerman, Iran

How to Cite: Nouhi E, Sabzevari S, Hosainrezaee H. Improvement of the Quality of Basic Clinical Skills Training and Evaluation of the Efficacy of Objective Structured Clinical Examination (OSCE): An Action Research with a Mixed Method, Strides Dev Med Educ. Online ahead of Print ; 15(1):e64982. doi: 10.5812/sdme.64982.

ARTICLE INFORMATION

Strides in Development of Medical Education: 15 (1); e64982
Published Online: January 29, 2019
Article Type: Research Article
Received: December 10, 2017
Revised: July 25, 2018
Accepted: July 29, 2018
Crossmark

Crossmark

CHEKING

READ FULL TEXT
Abstract

Background: One of the main goals of action research is to improve the quality of education at both individual and organizational levels. Management enables organizations to improve their performance in areas, which have the greatest impact on students’ learning and empowerment, without compromising the quality of education.

Objectives: In this study, we aimed to improve the quality of basic clinical skills training for nursing students in an action research, using the available resources.

Methods: In this action research, a sequential mixed method was applied. The participants in the qualitative phase included experts in the field of education, students, and stakeholders responsible for training at the nursing skills, midwifery, and medical-surgical nursing units of Razi Faculty of Nursing and Midwifery in Kerman, Iran. Assessment of facilities and resources in the quantitative phase was also carried out using a data collection form, a student survey form, and a checklist of basic clinical skills. The stages of action research included action planning for problem-solving, implementation, evaluation, and reflection. The students’ problems with the basic clinical skills and their possible causes were also identified. The most effective and practical solutions for quality improvement included improvement of the educational environment of skill laboratories, followed by the enhancement of skills assessment process using an objective structured clinical examination (OSCE).

Results: The conventional method failed in the assessment of students’ competence and lacked adequate objectivity and reliability. A significant difference was observed in the mean scores of basic clinical skills (e.g., injection, measurement of vital signs, and dressing) between the conventional method and OSCE (P < 0.05). From the viewpoint of students, OSCE is more reliable and accurate than the conventional method and uses more suitable educational materials and facilities.

Conclusions: Based on the findings, by improving the educational environment of clinical skills laboratories and implementation of OSCE, nursing students can translate their knowledge of basic clinical skills into practice. We can also improve the quality of health services and clinical care for patients and reduce the incidence of practical errors made by nursing students.

Keywords

Education Clinical Skills Nursing Midwifery Students Action Research

Copyright © 2019, Strides in Development of Medical Education. This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/) which permits copy and redistribute the material just in noncommercial usages, provided the original work is properly cited.

1. Background

One of the important parts of educational development in a country is improvement of education quality through modifying and balancing educational goals with educational performance and activities. According to the literature, theoretical and practical aspects of an efficient educational system should be reviewed and revised unceasingly in order to meet the current and future needs of the community (1-3).

The “principles and techniques” course is a basic course related to the clinical activities of nursing and midwifery students. Identification of the current and desired status of theoretical, practical, and clinical training is of great importance in this course (4). The clinical experience acquired during this course by nursing and midwifery students is in fact their first experience and earliest clinical exposure in the first year of education (5).

The students’ preparation for safe clinical activities, without making any errors or experiencing anxiety, is important in clinical skills training and student learning. Learning through practice in a simulated environment before exposure to the actual workplace can facilitate the students’ acquisition of clinical skills. However, the quality and quantity of health services provided by nursing and midwifery students indicate that these students have failed to meet the educational goals.

The low quality of health services may be partly attributed to deficiencies in the curriculum and teaching methods applied by instructors (6, 7). As mentioned earlier, the educational content presented in the “principles and techniques” course is the first exposure of students to professional and clinical environments and has great impacts on their academic achievement and clinical practice. The quality of this course depends on accurate and efficient planning, engagement of proficient instructors, and effective assessment (8).

In order to improve the process of educational decision-making and practice, students’ cooperation and participation, along with an understanding of experts’ experiences, are essential. Moreover, knowledge of the viewpoints of students (as recipients of education)about educational activities is valuable for instructors (as leaders of the educational process), especially when changes are introduced in the educational process (2, 3, 9).

Modification of the management structure and increasing productivity are among factors, which not only improve the quality of health services, but also lead to the achievement of competitive advantages. Clinical education is known to play an important role in nursing education and is recognized as a key factor in shaping the professional identity of nursing students (10, 11). Also, application of theoretical concepts in practice is the main reason for acquiring professional and clinical skills (8).

According to studies by Baxter (12) and Corlett (13), application of a management plan and an action research model is necessary for eliminating the gap between theoretical knowledge and its application in actual work environments. This approach is also considered suitable for revising problem-solving strategies in the development of educational methods, introducing new educational methods and combining them with the conventional ones, and finally improving methods of clinical assessment (14). Identification and management of interrelated processes in the educational system, application of the acquired knowledge in the clinical environment, and optimization of educational planning can also improve the efficiency of educational organizations in achieving their goals (15-17).

Action research is a multi-purpose approach for collecting data from a target group. It is a process through which problems and revisions are described and identified. One of its main goals is to improve education at both individual and organizational levels. Generally, the most important phases in the implementation of action research include “problem appraisal”, “action planning”, “implementation”, “evaluation”, and “reflection” (14).

Systemic management, which is used to integrate and classify different processes, is considered the best strategy for achieving the preset organizational goals. This approach also enables the organization to focus on the key processes and fosters a sense of trust, adjustment, efficiency, and growth among stakeholders (18-20). On the other hand, action research is an appropriate solution for problems such as educational problems, leading to the development of novel and creative solutions and improvement of unfavorable conditions. In this approach, theoretical solutions are replaced by practical solutions (4).

Action research is a type of systematic study and a focused attempt for improving the quality of organizational performance. The researcher and the involved team conduct action research, and the researcher is an active participant in the process of change. The main stages of action research include action planning for problem-solving, implementation, evaluation, and reflection (21). The participants concentrate on problem appraisal and providing effective solutions to improve performance with the participation of all people involved in the process (22).

2. Objectives

With this background in mind, the aim of this study was to improve the quality of basic clinical skills training for students, using action research based on the available resources.

3. Methods

This action research was performed using a sequential mixed method. Mixed method research, due to the use of both quantitative and qualitative methods, can present acceptable and reproducible results (1). One of the unique characteristics of action research is the interaction between researchers, stakeholders, and research samples, which is accomplished through review and revision, along with accurate observation and continuous outcome assessment (17).

In this study, experiences of nine faculty members (seven women and two men) from midwifery, nursing skills, and medical-surgical nursing units were evaluated regarding basic clinical skills training through focus group discussion and individual interviews by asking questions, such as “How do you evaluate the status of nursing skills training and assessment? and “What are your experiences of theoretical and practical training?” The interviews continued for 45 to 60 minutes. All interviews were transcribed, re-read, and analyzed. MAXQDA version 10 was used for the management and analysis of qualitative data, and semantic units, categories, and main themes were extracted through text analysis.

In the quantitative phase, a total of 80 students (27 midwifery and 53 nursing students), who were enrolled in the “techniques and principles” program, were recruited, using purposive sampling method. The students’ skills were assessed using the conventional test (random selection of a card related to a skill), followed by objective structured clinical examination (OSCE).

The students' mean score of skill assessment was calculated using a check list. The efficacy of OSCE was measured using a questionnaire, which consisted of 20 questions and was rated on a Likert scale, ranging from completely disagree (score 1) to completely agree (score 5) (score range, 20 - 100).Finally, five open questions were presented to the participants about the tests, and the drafts were collected. Ethical concerns, including anonymity of the questionnaires, disclosure of research objectives, and confidentiality of data, were considered during the study.

Data were analyzed using descriptive (mean and standard deviation) and inferential (independent t-test and Pearson’s correlation coefficient test) statisticsin SPSS version 19 (SPSS Inc., Chicago, IL).

The required revisions and corrective measures, with a descending order of priority, were as follows: Promotion of practical training through mastery of practical skills; development of basic practical skills of nursing and midwifery students by modifying the educational setting of skill laboratories and use of hospital-based simulations; availability of all required equipment and facilities for nursing and midwifery skills training; and improvement of the process of practical skills assessment by conducting OSCE in the clinical skill laboratory. The students were evaluated using both conventional and OSCE tests.

In OSCE, the examination stations were designed to focus on a sample of clinical competencies, which were randomly selected from the training materials. All students were exposed to similar simulation conditions and examination stations. The assessment checklist was designed in accordance with each situation (11, 22-25) and was approved by the team members during group meetings. After obtaining the final confirmation, the examination stations were designed for evaluating clinical competence and implemented.

The facilities required for each test were available in the examination stations, and the examiner was identified by an identification card. After the students were sequentially exposed to the stations, the test was initiated by the examiner, and different stages of the practical exam were conducted within the specified timeframe. After finishing each station, the students moved to the next station for the next test. All students were evaluated in six stations and left the facility after the end of the exam. Code of ethics of this study was K. 90.11.

4. Results

Based on the analysis of qualitative data and review of expert experiences, the main reasons for the inadequacy of clinical skills among nursing students were lack of a coherent curriculum, unavailability of qualified instructors, unsuitable educational environment, and unreliable evaluation. On the other hand, the corrective measures included: Development of educational processes; engagement of experienced instructors; curriculum optimization; optimization of the educational environment of skill laboratories; and assessment of basic clinical skills in OSCE (Table 1).

Table 1. Themes and Categories Extracted from the Data Analysis
ThemesCategories
Improved student understanding of the fieldStudents’ perceptions and feelings about their professional future
Students’ perceptions and feelings about the clinical environment
First exposure to the simulated clinical environment and early exposure to the clinical setting
Unsuitable educational environment and facilitiesInappropriate facilities for teaching and practicing basic nursing and midwifery skills in traditional practice rooms
Non-standard training environments dis similar to real-life clinical setting sand lack of professional or occupational similarities
Coherent and efficient educational managementDevelopment of an uncoordinated educational curriculum based on routine methods
Inconsistency between the curriculum and different professional skills requirements and basic skills
Need for experienced instructors and a strong professional background
Effective assessmentAmbiguity in assessment and inaccurate analysis of training
Inadequate practical efficacy and poor preparation of students
Disregard for critical situations in clinical settings and need for early preparation
Corrective measures (i.e., curriculum optimization, engagement of experienced instructors, optimization of the educational environment of skill laboratories, and application of OSCE)Restrictive factors: Inadequate preparation and poor clinical competence of students, unsuitable training environments, and unsuitable assessment methods

Abbreviation: OSCE, objective structured clinical examination.

The analysis of quantitative data showed that the mean age of the students was 18.57 ± 3.8 years (range, 18 - 30 years). In total, 37 (46.5%) participants were male, and 43 (53.5%) were female. In terms of marital status, two (2.2%) students were married, and 78 (98%) were single. With respect to the field of study, 27 (33.7%) participants were midwifery students, and 53 (76.3%) were nursing students. In addition, 31 (38.8%) students were non-native, while 49 (61.2%) were native.

Based on the findings, there was a significant difference in the scores of basic clinical skills, including injection, evaluation of vital signs, and dressing, between the conventional method (2.24 ± 0.13) and OSCE (2.13 ± 0.14) (t = 6.05; P < 0.050). From the viewpoint of students, OSCE had acceptable reliability and accuracy, and the stations were relevant to the educational content and fully equipped. There was a significant positive correlation between the students’ opinions about the exam and its effectiveness (P = 0.030) (Table 2).

Table 2. Association of the Participants’ Viewpoints About OSCE with Variables: Test Score, Effectiveness and Average Score
Students’ CharacteristicsOSCE Characteristics
Test ScoreEffectivenessAverage Score
P ValuerP ValuerP Valuer
Station relevance0.5060.040.0550.130.0990.100
Equipment and facilities0.338060.060.7170.020.4660.500
Test time0.3530.060.4930.040.8460.010
Test accuracy and reliability0.4310.050.9140.080.9670.003
Total score0.6620.030.0300.150.0800.120

Abbreviation: OSCE, objective structured clinical examination.

According to the analysis of open questions, students stated that OSCE increased their motivation and effort for exam preparation. They also pointed out that participation in OSCE scenarios reduced their anxiety and fear of real-life clinical situations and familiarized them with the principles of clinical practice.

5. Discussion

According to the qualitative data analysis, four main themes, including “students' understanding of the field of study”, “unsuitable educational environment and facilities”, “coherent and efficient educational management”, and “effective assessment" were extracted in this study.

The underlying causes of problems and deficiencies in the clinical skills and preparation of nursing and midwifery students included inefficient curriculum development, lack of qualified instructors, unsuitable educational environment, and unreliable assessment. Engagement of experienced instructors in teaching nursing and midwifery techniques is of particular importance in strengthening the organizational structure.

The corrective measures in this study included curriculum optimization, optimization of the educational environment of skill laboratories, and basic clinical skills assessment using OSCE. The quantitative analysis of one of the corrective measures, i.e., implementation of OSCE, was indicative of its effectiveness. Based on the findings, there was a significant difference in the students’ skill scores between the conventional method and OSCE (P < 0.050).In a study by Alinier, 93% of students and 94.4% of instructors reported that OSCE was a useful and appropriate method for clinical evaluation. It should be noted that this test has particular requirements in terms of space, facilities, environment, and financial and human resources (26).

We did not face any particular problems during the study, as the OSCE examiners were experienced instructors or involved in the training of nursing principles and skills. Due to space limitations of the skill laboratory, the designed examination stations had limited space. Therefore, efforts were made to administer the exam in a suitable environment with a pre-fabricated wall in an organized manner, and one of the training classes was renovated.

From the perspective of students, OSCE is more reliable and accurate than the conventional method and increases their motivation, effort, and preparation for the test. The results of multiple studies have confirmed the satisfaction of instructors and students with this evaluation method. In this regard, a study by Furlong et al. reported that OSCE is an objective evaluation method rather than a subjective one (27). Generally, the possibility of random responses reduces in clinical assessments using OSCE. In addition, OSCE has relatively higher validity and reliability than the conventional method; therefore, it is possible to carefully examine the skills using an appropriate tool (checklist)for each skill. Newble also reported that objectivity increases in the OSCE method due to the use of checklists by examiners (28).

Validation of nursing education plays an important role in improving the quality of education. Use of proper educational and evaluation methods has increasingly expanded in academic education (15, 29). For many years, healthcare professionals have been looking for valid and reliable methods, which could effectively measure the clinical competence of students. Evidence suggests that routine assessment of students is limited to their acquired knowledge and discards their clinical skills. In fact, evaluation determines how well the educational system’s performance is in accordance with its objectives (15, 30).

Previous research shows that OSCE is a clinical examination, which improves the students’ performance and promotes their professional roles. It is also a valid method for assessing the students’ technical and clinical skills, with the highest validity, reliability, and applicability (31). Nursing faculties need to move towards improving the quality of their educational processes, using action research as part of higher education in medical sciences, to continuously correct and overcome the existing deficiencies (4).

Although there is often no systematic mechanism in clinical skills education centers to control or improve educational quality and balance performance with goals, evaluation of the course of “nursing and midwifery principles and techniques” and continuous improvement of the quality of educational processes in these centers are essential through optimal use of resources for describing nursing education standards. It is also necessary to improve nursing clinical skills training in order to assign standards for nursing education and promote the quality of clinical education in nursing.

The limitations of this study included barriers to teamwork for coordination, lack of educational and assessment facilities, props, and space, and dual role of the researcher (research and organizational roles). In order to investigate the effectiveness of corrective measures and actions and to improve the quality of clinical education, action research studies and assessments in other related domains are suggested.

Acknowledgements

Footnotes

References

  • 1.

    Sallis E. Total quality management in education. 3rd ed. London: Routledge; 2014. 180 p.

  • 2.

    Shoghi Shafagh Aria F, Dorrani K, Lameei A, Labbaf Ghasemi R. [Approaches of iranian medical universities to quality management in education]. Iran J Med Educ. 2011;10(4):350-6. Persian.

  • 3.

    Allami A, Sarreshtehdari M, derakhshan F, safdari F. [Innovation in medical education based on quality management model: An experiment in medical school, Ghazvin University of Medical Sciences]. Iran J Med Educ. 2011;11(3):291-3. Persian.

  • 4.

    Asadizaker M, Abed Saeedi Z, Abedi HA. [Development of clinical teaching process of the fundamentals of nursing with participatory approach: An action research]. J Qual Res Health Sci. 2014;3(2):175-89. Persian.

  • 5.

    Hoyles A, Pollard C, Lees S, Glossop D. Nursing students' early exposure to clinical practice: An innovation in curriculum development. Nurse Educ Today. 2000;20(6):490-8. doi: 10.1054/nedt.1999.0444. [PubMed: 10959138].

  • 6.

    Hamidi Y, Tabibi SJ. [A study of TQM implementation outcomes in Hamadan Province, district health systems 2000-2002]. J Hamadan Univ Med Sci. 2004;11(1):37-43. Persian.

  • 7.

    Young LE, Paterson BL. Teaching nursing: Developing a student-centered learning environment. 1st ed. Philadelphia: Lippincott Williams & Wilkins; 2007.

  • 8.

    Quinn FM. The principles and practice of nurse education. 4th ed. London: NelsonThornes; 2000.

  • 9.

    Kanji G. Total quality management: Proceedings of the first world congress. Springer Science & Business Media; 2012. doi: 10.1007/978-94-011-0539-2.

  • 10.

    Schuring RW, Luijten H. Reinventing suggestion systems for continuous improvement. Int J Tech Manag. 2001;22(4). doi: 10.1504/IJTM.2001.002969.

  • 11.

    Davis AH, Kimble LP. Human patient simulation evaluation rubrics for nursing education: Measuring the essentials of baccalaureate education for professional nursing practice. J Nurs Educ. 2011;50(11):605-11. doi: 10.3928/01484834-20110715-01. [PubMed: 21751764].

  • 12.

    Baxter P. The CCARE model of clinical supervision: Bridging the theory-practice gap. Nurse Educ Pract. 2007;7(2):103-11. doi: 10.1016/j.nepr.2006.06.007. [PubMed: 17689431].

  • 13.

    Corlett J. The perceptions of nurse teachers, student nurses and preceptors of the theory-practice gap in nurse education. Nurse Educ Today. 2000;20(6):499-505. doi: 10.1054/nedt.1999.0414. [PubMed: 10959139].

  • 14.

    Soh KL, Davidson PM, Leslie G, Bin Abdul Rahman A. Action research studies in the intensive care setting: A systematic review. Int J Nurs Stud. 2011;48(2):258-68. doi: 10.1016/j.ijnurstu.2010.09.014. [PubMed: 21030021].

  • 15.

    Noohi E, Motesadi M, Haghdoost A. [Clinical teachers 'view points to wards objective structured clinical examination in Kerman University of Medical Science]. Iran J Med Educ. 2008;8(1):113-20. Persian.

  • 16.

    Humani Magd Abadi F, Jalalmanesh Sh, Salahshoorian Fard A, Haghani H. [A comparative study of two OSCE clinical evaluation techniques and gradingin one hospital affiliated to Arak University of Medical Sciences]. Teb va Tazkiye. 2005;14(2):24-9. Persian.

  • 17.

    Jalili Z, Nouhi E, Ahmadpour B. [Investigation of medical stagers and interns satisfaction on OSCE as a clinical skill evaluation method in Kerman University of Medical Sciences]. Strides Dev Med Educ. 2005;2(1):18-24. Persian.

  • 18.

    Martinez-Lorente AR, Sánchez-Rodriguez C, Dewhurst FW. The effect of information technologies on TQM: An initial analysis. Int J Prod Econ. 2004;89(1):77-93. doi: 10.1016/j.ijpe.2003.06.001.

  • 19.

    Dehghan Nayeri N. Nursing Management Principles. Tehran: Bashari; 2009.

  • 20.

    Lamie A. Comprehensive quality management. Principles of use and lessons from an experience. Tehran: Modernmedicine; 2003.

  • 21.

    Speziale HS, Streubert HJ, Carpenter DR. Qualitative research in nursing: Advancing the humanistic imperative. 5th ed. Philadelphia: Lippincott Williams & Wilkins; 2011.

  • 22.

    Mortazavi H, Mohammadnejad E, Tabatabaee A. [Actionresearch: A way fornursing development in future]. J North Khorasan Univ Med Sci. 2014;6(1):215-21. Persian.

  • 23.

    Boyer MJ. Brunnerand suddarth’s textbook of medical-surgical nursing. 10th ed. Philadelphia: Lipincott Williams & Wilkins; 2009.

  • 24.

    Black JM, Hawks JH. Medical-surgical nursing: Clinical management for positive outcomes. 8th ed. Philadelphia: Saunders Elsevier; 2009.

  • 25.

    Lynn P, LeBon M. Skill check lists for taylor's clinical nursing skills: A nursing process approach. 3rd ed. Netherlands: Wolters Kluwer; 2011.

  • 26.

    Alinier G. Nursing students’ and lecturers’ perspectives of objective structured clinical examination incorporating simulation. Nurse EducToday. 2003;23(6):419-26. doi: 10.1016/S0260-6917(03)00044-3.

  • 27.

    Furlong E, Fox P, Lavin M, Collins R. Oncology nursing students' views of a modified OSCE. Eur J Oncol Nurs. 2005;9(4):351-9. doi: 10.1016/j.ejon.2005.03.001. [PubMed: 16027036].

  • 28.

    Newble D. Techniques for measuring clinical competence: Objective structured clinical examinations. Med Educ. 2004;38(2):199-203. [PubMed: 14871390].

  • 29.

    Reza Masouleh S, Zare A, Chehrzad M, Atr Kar Ruoshan Z. [Comparing two methods of evaluation, objective structured practical examination and traditional examination, on the satisfaction of students in Shahid Beheshti Faculty of Nursing and Midwifery]. J Holist Nurs Midwifery. 2008;18(1):22-30. Persian.

  • 30.

    Hoseini BL, Mazloum SR, Jafarnejad F, Foroughipour M. Comparison of midwifery students' satisfaction with direct observation of procedural skills and current methods in evaluation of procedural skills in Mashhad Nursing and Midwifery School. Iran J Nurs Midwifery Res. 2013;18(2):94-100. [PubMed: 23983736]. [PubMed Central: PMC3748577].

  • 31.

    Chehrzad MM, Mirzaei M, Kazemnejad E. [Comparison between two methods: Objective structured clinical evaluation (OSCE) and traditional on nursing students’ satisfaction]. J Guilan Univ Med Sci. 2004;13(50):8-13. Persian.

  • COMMENTS

    LEAVE A COMMENT HERE: