jrnls.org logo
Submit

BROWSE ALL JOURNALS

SEE ALL 19 JOURNALS
Indian Journal of Pharmaceutical Education and ResearchNOW IN
Article

An Analysis of the Extent of Intra and Inter-rater Variability in OSCE

Swanand Shrikant Pathak1, Gaurav Vedprakash Mishra2, Rupesh Anna Warbhe1★★ Corresponding author

  1. 1Department of Pharmacology, JNMC, DMIHER, Sawangi, Wardha, Maharashtra, INDIA.
  2. 2Department of Radiology, AVBRH, Sawangi, Wardha, Maharashtra, INDIA.

CORRESPONDENCE

Rupesh Anna Warbhe

Department of Pharmacology, JNMC, DMIHER, Sawangi, Wardha, Maharashtra, INDIA.

warbherupesh5@gmail.com

Received: 27-06-2022; Revised: 08-03-2023; Accepted: 08-06-2023.

Volume 57, Issue 3S · pp. s507–s510 · PUBLISHED 2023 · DOI: 10.5530/ijper.57.3s.58

View on IJPER original site ↗

ABSTRACT

Background: OSCE is an objective structured clinical examination, though the tool is designed to increase the objectivity in the examination of the clinical cases, the inter and intra rater variability of the tool needs to analysed. Aim: To determine the extent of intra and inter-rater variability in OSCE. Settings and Design: The study was conducted in a medical college and is a cross sectional study. Materials and Methods: 5 OSCE stations were designed and videos recorded of the candidates performing the clinical exercise, 9 teachers were selected, three of assistant professor grade (junior level), three of associate grade (middle level) and three of professor grade (senior level), all the teachers were shown the videos on day 1 and the scores recorded, the same videos were shown to the teachers on the second day and the scores recorded, each teacher graded all the 5 OSCE recordings. Statistical Analysis Used: Student paired t test, One-Way ANOVA and multiple comparison to Tukey test and Cronbach alpha. Software used for analyses was SPSS 27.0 version. Results: when the scores were segregated according to level of Assessors it was observed that there was significant intra-rater variability at senior level, while there is significant inter-rater variability between junior and mid-level assessors. Conclusion: There is intra and inter-rater variability observed in OSCE assessment when assessors were segregated in groups as per their seniority levels.

KEYWORDS

Open in new tab

REFERENCES

As published

Showing references and in-text citations exactly as published.

    Cite this article

    SELECT FORMAT

    Pathak, S. S., Mishra, G. V., & Warbhe, R. A. (2023). An Analysis of the Extent of Intra and Inter-rater Variability in OSCE. Indian Journal of Pharmaceutical Education and Research, 57(3S), s507–s510. https://doi.org/10.5530/ijper.57.3s.58