Student Evaluations: Synchronous Tripod of Learning Portfolio Assessment—Self-Assessment, Peer-Assessment, Instructor-Assessment

Jenna-Lynn Senger, Rani Kanthan

Department of Pathology and Laboratory Medicine, University of Saskatchewan, Saskatoon, Canada.

DOI: 10.4236/ce.2012.31025                

Abstract

Background: Learning portfolios are increasingly being introduced in higher education including undergraduate and postgraduate medical education. Due to their highly personalized nature, creation of an assessment tool that accurately reflects the value for the learner of the ‘work’ created is challenging, and has prevented a more widespread use of this valuable tool. Innovation & Evaluation: Forty-one physical therapy students were asked to create a learning portfolio as a component of their pathology course. This collection of evidence of learning was evaluated at the midterm and final examination by a synchronous tripod of assessors-the ‘self’, a peer, and the instructor- to provide a formative and summative evaluation. Results: Grades awarded by the three assessors were more similar at the end of the semester when compared with those at the midterm. A quantitative and qualitative satisfaction questionnaire was additionally given to students to determine the usefulness of this educational activity. Though the majority of students responded favourably, with notable self-reported improvements in communication, team-work, and professional growth, primary challenges included negative perceptions related to increased time commitment, student and teacher-related stress, and uncertainty regarding the value and the immediate and long-term relevance of this creative learning activity. Conclusion: Reflection on our study authenticates that the combination of formative and summative evaluations from such tripod assessments of learning portfolios is particularly suited for explicit inclusion in higher educational programs including medicine and allied health professionals. We recommend learning portfolios as a creative learning tool and assessment tool in higher education.

Keywords

Learning Portfolio; Self-Assessment; Peer-Assessment; Instructor-Assessment; Tripod Assessment

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	Amsellem-Ouazana, D., Van Pee D., & Godin, V. (2006). Use of portfolios as a learning and assessment tool in a surgical practical session of urology during undergraduate medical training. Medical Teacher, 28, 356-359. doi:10.1080/01421590600628100
[2]	David, M. F. B., Davis, M. H., Harden, R. M., Howie, P. W., Ker, J., & Pippard, M. J. (2001). AMEE medical education guide no. 24: Portfolios as a method of student assessment. Medical Teacher, 23, 535- 551. doi:10.1080/01421590120090952
[3]	Davis, D. A., Mazmanian, P. E., Fordis, M., Van Harrison, R., Thorpe K. E., & Perrier, L. (2006) Accuracy of physician self-assessment compared with observed measures of competence. The Journal of the American Medicine Association, 296, 1094-1102. doi:10.1001/jama.296.9.1094
[4]	Davis, M. H., Ben-David, M. F., Harden, R. M., Howie, P., Ker, J., McGhee, C., Pippard, M. J., & Snadden, D. (2001) Portfolio assessment in medical students’ final examinations. Medical Teacher, 23, 357- 366. doi:10.1080/01421590120063349
[5]	Driessen, E., & Norman, G. (2008). Are learning portfolios worth the effort? British Medical Journal, 337, 320-321. doi:10.1136/bmj.39540.415822.AD
[6]	Driessen, E., Overeem, K., van Tartwijk, J., van der Vleuten, C. P. M., & Muijtjens, A. M. M. (2006). Validity of portfolio assessment: Which qualities determine ratings? Medical Education, 40, 862-866. doi:10.1111/j.1365-2929.2006.02550.x
[7]	Driessen, E., van Tartwijk, J., van der Vleuten, C., & Wass, V. (2007). Portfolios in medical education: Why do they meet with mixed success? A systematic review. Medical Education, 41, 1224-1233. doi:10.1111/j.1365-2923.2007.02944.x
[8]	Driessen, E., Van Tartwijk, J., Vermunt, J., & van der Vleuten, C. (2003). Use of portfolios in early undergraduate medical training. Medical Teacher, 25, 18-23. doi:10.1080/0142159021000061378
[9]	Elango, S., Jutti, R. C., & Lee, L. K. (2005). Portfolio as a learning tool: Students’ perspective. Annuals Academy of Medicine, 24, 511-514.
[10]	Endacott, R., Gray, M. A., Jasper, M. A., McMullan, M., Miller, C., Scholes, J., & Webb, C. (2004). Using portsolios in the assessment of learning and competence: The impact of four models. Nurse Education in Practice, 4, 250-257. doi:10.1016/j.nepr.2004.01.003
[11]	Epstein, R. M. (2007). Assessment in medical education. The New England Journal of Medicine, 356, 387-396. doi:10.1056/NEJMra054784
[12]	Galbraith, R. M., Hawkins, R. E., & Holmboe, E. S. (2008). Making self-assessment more effective. Journal of Continuing Education in the Health Professions, 28, 20-24. doi:10.1002/chp.151
[13]	Gordon, M. (1991) A review of the validity and accuracy of self assessment in health professions training. Academic Medicine, 66, 762- 769. doi:10.1097/00001888-199112000-00012
[14]	Kanthan, R., & Senger, J. L. (2011). An appraisal of students’ awareness of “self-reflection” in a first-year pathology course of undergraduate medical/dental education. BMC Medical Education, 11.
[15]	Langendyk, V. (2006). Not knowing that they do not know: self-assessment accuracy of third-year medical students. Medical Education, 40, 173-179. doi:10.1111/j.1365-2929.2005.02372.x
[16]	Norcini, J. J. (2003). Peer assessment of competence. Medical Education, 37, 539-543. doi:10.1046/j.1365-2923.2003.01536.x
[17]	Pitts J., Coles C., & Thomas, P. (2001). Enhancing reliability in portfolio assessment: “Shaping” the portfolio. Medical Teacher, 23, 351-356. doi:10.1080/01421590120057021
[18]	Rees, C. E., Shepherd, M., & Chamberlain, S. (2005) The utility of reflective portfolios as a method of assessing first year medical students’ personal and professional development. Reflective Practice, 6, 3-14. doi:10.1080/1462394042000326770
[19]	Roberts, C., Newble, D. I., & O’Rourke, A. J. (2002). Portfolio-based assessments in medical education: Are they valid and reliable for summative purposes? Medical Education, 36, 899-900. doi:10.1046/j.1365-2923.2002.01288.x
[20]	Ten Cate, O. T., & Durning, S. (2007). Peer teaching in medical education: Twelve reasons to move from theory to practice. Medical Tea- cher, 29, 591-599. doi:10.1080/01421590701606799
[21]	Teng, C. L. (2007). Portfolio assessment. Malaysian Family Physician, 2, 125-126.
[22]	van Tartwijk, J., Driessen, E., van der Vleuten, C., & Stokking, K. (2007). Factors influencing the successful introduction of portfolios. Quality in Higher Education, 13, 69-79. doi:10.1080/13538320701272813