Multilevel Modeling of Longitudinal Data on Academic Evaluation of the Academic Staff of Kerman University of Medical Sciences, Iran

AUTHORS

Somayeh Shahroudi 1 , Ali-Akbar Haghdoost 2 , Farzaneh Zolala 3 , Maryam Okhovati 4 , Mohammad Reza Baneshi 5 , *

1 M.Sc. in Biostatistics, Student Research Committee, Kerman University of Medical Sciences, Kerman, Iran, Iran

2 Ph.D. in Epidemiology, Professor, Regional Center of Care HIV, World Health Organization Collaborating Center, Institute for Futures Studies in Health, Kerman University of Medical Sciences, Kerman, Iran, Iran

3 Ph.D. in Epidemiology, Assistant Professor, Regional Center of Care HIV, World Health Organization Collaborating Center, Institute for Futures Studies in Health, Kerman University of Medical Sciences, Kerman, Iran, Iran

4 Ph.D. in Library and Information Sciences, Assistant Professor, Physiology Research Center, Institute of Neuropharmacology, Kerman University of Medical Sciences, Kerman, Iran, Iran

5 Ph.D. in Biostatistics, Associate Professor, Research Center for Modeling in Health, Institute of Futures Studies in Health, Kerman University of Medical Sciences, Kerman, Iran, Iran

How to Cite: Shahroudi S , Haghdoost A, Zolala F , Okhovati M, Baneshi M R. Multilevel Modeling of Longitudinal Data on Academic Evaluation of the Academic Staff of Kerman University of Medical Sciences, Iran, Strides Dev Med Educ. 2015 ; 12(S1):e59440.

ARTICLE INFORMATION

Strides in Development of Medical Education: 12 (S1); e59440
Published Online: March 28, 2015
Article Type: Research Article
Received: August 05, 2017
Accepted: September 07, 2014

Crossmark

CHEKING

READ FULL TEXT
Abstract

Background & Objective: In order to promote quality of education, teaching performances of all academic staff are evaluated by students every semester. This study aims to address the changing trend of staff scores in different semesters, and factors affecting it, in Kerman University of Medical Sciences, Iran, using multilevel modeling. Moreover, the results were compared to that of simple linear regression modeling.

Methods: In the present analytical study, the scores of 336 academic staff of Kerman University of Medical Sciences during 2008 to 2012 were extracted from the students’ monitoring website. The tutor’s code was used for the identification of their scores in different semesters and was entered into the multilevel models. In order to investigate the effects of gender, work experience (in years), school (seven schools), and academic rank (master, assistant professor, associate professor, professor), the simple regression and multilevel models were compared. To study the significance of the random intercepts, the likelihood ratio test was used. In addition, to study the goodness of fit of the models, the Akaike information criteria (AIC), Bayesian information criteria (BIC), and the mean squared error (MSE) were used.

Results: The results showed that time had a significant positive impact on the improvement of staff scores. However, the scores of male and female staff were not significantly different. The scores of professors were significantly higher than assistant professors. In addition, the score of dental school staff was significantly higher than that of medical school staff. The comparison of the goodness of fit of models showed that the multilevel modeling provided a better fit to the longitudinal data. In the linear regression model, variables such as work experience and academic rank (professors in comparison to assistant professors and nursing school staff in comparison to pharmacology school staff) were falsely considered significant, due to the lack of consideration of the dependence of longitudinal observations of the evaluation and correction of standard errors.

Conclusion: The multilevel model, due to the consideration of the dependence of longitudinal observations of the evaluation, provides a better fit to data. Moreover, the incorrect use of the linear regression model, considering longitudinal observations to be independent, led to erroneous conclusions. The results of the present study, in terms of the goodness of fit of the models, showed a positive trend in scores of academic staff of Kerman University of Medical Sciences. In other words, the scores have improved over time.

Keywords

Teacher evaluation Student Added value Evaluation Longitudinal data Multilevel modeling

© 2015, Medical Education Development Center. This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/) which permits copy and redistribute the material just in noncommercial usages, provided the original work is properly cited.

Fulltext

 

References

  • 1.

    Reference is available in pdf

  • COMMENTS

    LEAVE A COMMENT HERE: