Assessment and Evaluation of Students, Faculty and Curriculum Policy

It is the policy of the University of Arizona College of Medicine – Phoenix to provide constructive and timely feedback in all settings and to take an active approach to improving or enhancing teaching and assessment skills.

Feedback is provided in a manner that protects student confidentiality and any potential concerns of retribution.

Faculty and students are expected to review their evaluations with the goal of learning from both positive comments and constructive criticism.

“Faculty,” as it relates to this policy, refers to any preceptor or affiliate who teaches medical students, including residents, fellows, graduate students, and postdoctoral fellows.

Process

Required Assessments Completed by Faculty

Faculty are expected to identify students throughout the length of the curricular unit who are not meeting required elements in a timely manner and provide corrective mentoring, as well as a specific corrective plan.

Each student is provided regular formative and summative feedback based on the behavior competencies listed in the Competency Assessment Policy and the grading listed in the syllabus. The structure and timing of this feedback is listed in the following policies:

• Competency Assessment Policy.
• Grading and Progression for Clerkships Policy.
• Enrollment, Sequencing and Grading for Pre-Clerkships Policy.

Required Evaluations Completed by Students

Depending on the week length of the curricular unit, the student will be responsible for completing anywhere between one and 35 session evaluations. Ten percent of the students are randomly assigned to evaluate each session, which causes the fluctuation in the range above. This system is designed so that all teaching faculty are provided feedback and student survey fatigue is minimized. Students also have the opportunity to evaluate any session at any time as an optional and additional source of professional feedback.

The Overall Curricular Unit evaluations will use a sampled method for evaluation collection with a 90 percent confidence interval (CI) and a 10 percent margin of error (MOE). Out of 80 students, 38 will receive overall evaluations, out of 100 students, 41 will receive overall evaluations, and out of 120 students, 47 will receive overall evaluations.

Blocks – Students are required to complete the following evaluations in each block:

• All assigned session evaluations.
• Two Case Based Instruction evaluations (mid- and end-), with the exception of the Oncology Block.
• Assigned Overall Evaluations.

Courses – Students are required to complete assigned mid- and end-of-course evaluations in all courses, with the exception of Intersessions. Additionally, students will complete site-specific evaluations at the end of each Capstone course experience.

Clerkships and Longitudinal Integrated Clerkship – Students are required to complete the following evaluations in each clerkship:

• All assigned session evaluations.
• A clerkship evaluation for each site and rotation.
• A faculty evaluation per clerkship (student’s choice).
• Assigned Overall Evaluation.

Electives – Students are required to complete an overall elective evaluation for each site.

Selectives – Students are required to complete the following evaluations for each selective:

• All assigned session evaluations.
• An evaluation for each site and rotation.
• A faculty evaluation.
• Assigned Overall Evaluation.

Timeliness of Evaluations by Students

Students must complete required evaluations within one week after the middle and end of each block or course, and at the end of each clerkship, selective or elective.

If the student does not complete the required evaluations within one week after the middle or end of the block clerkship, course, elective or selective, the student is required to submit the missing evaluation data in narrative form within the second week to the Office of Assessment and Evaluation and will receive a formative Level 1 in Professionalism.

Once the student has successfully submitted their evaluation in narrative form within the second week after the block clerkship, course, elective or selective, the student has successfully demonstrated meeting expectations in Professionalism. If the narrative form is not completed within the second week after the curricular unit ends, then this will result in a summative Level 1 in Professionalism.

Multiple incomplete evaluations within the same curricular unit will only result in one summative Level 1 towards the cumulative level ratings listed in the Competency Assessment Policy.

Self and Peer Evaluations – Students are provided with optional opportunities to complete self and peer evaluations of developmental behavior in Interpersonal and Communication Skills and Professionalism. Reports of self and peer evaluations are provided to the Office of Student Affairs as a part of the student’s academic growth progression and holistic review.

Evaluation Anonymity – The student's identity is withheld on all evaluations, and reports are compiled in aggregate for each of the designated Directors by the Office of Assessment and Evaluation.

Constructive Feedback Expectations

All comments from students or faculty must be honest, respectful, succinct, focused on issues rather than emotions, be unbiased(see Conflict of Interest Physician-Student Personal Relationship Policy), supportive, genuine and solution-oriented.

Faculty and students are trained in providing feedback on an ongoing basis. They are instructed to provide feedback that contains references and comments to specific behaviors and/or events (positive or negative). The suggested format is the “3 W’s” model to identify: What worked well? What did not work well? What could be done differently next time?

The primary responsibility for identifying potentially non-constructive feedback relies on the Office of Assessment and Evaluation for written feedback and the Course Director or faculty for verbal feedback. For written assessments or evaluations, the Office of Assessment and Evaluation reviews data weekly for the designated period to identify potentially non-constructive feedback. Any comments that are not considered constructive will be returned to the writer for revision. If egregious (containing obscenities or malicious statements) or inappropriate comments are not revised, the evaluation comments and the author’s name (if known) are referred to the Associate Dean, Student Affairs for comments made by students, and to the Associate Dean, Curricular Affairs and Program Evaluation, Associate Dean, Clinical Curriculum and Senior Associate Dean, Undergraduate Medical Education for comments made by faculty. Non-constructive comments will not be included as part of the evaluation of the faculty member or student.

Faculty Receiving and Responding to Student Feedback

Feedback is provided in a manner that protects student confidentiality and any potential concerns of retribution. The primary responsibility for monitoring the quality of teaching rests with the individual departments and is communicated with the Offices of Academic Affairs and Faculty Affairs and Development.

Blocks and Course Evaluation Circulation and Timing:

• Block/Intersession Directors who have the primary responsibility for overseeing the feedback process receive compiled summaries of all evaluations within five weeks after the block/course ends.
• The faculty teaching in the course receive their feedback for their specific sessions within seven weeks of the block ending.
• Course Directors who have the primary responsibility for overseeing the feedback process receive compiled summaries of all evaluations twice a year: at mid-year in January and at year-end in June.

Clerkship Evaluation Circulation and Timing:

• Clerkship Directors who have the primary responsibility for overseeing the feedback process receive compiled summaries of all evaluations twice a year: at mid-year in late November/early December and at year-end in July.
• Clerkship Directors share evaluation summaries with Program Directors, Site Directors and Institutional Department Chairs annually in July.
• Clinical Department Chairs receive summaries of evaluations in their department annually in July at the end of the academic year.
• Faculty, residents and fellows receive their individual evaluations annually in July through the One45 system.
• Clerkship Directors are primarily responsible for supporting the feedback process and providing specific feedback as needed. They work with Site Directors, Program Directors and Institutional Chairs as appropriate, as well as the Department Chairs in providing this feedback.

Elective and Selective Evaluation Circulation and Timing:

• Elective and Selective Directors who have the primary responsibility for overseeing the feedback process receive compiled summaries of all evaluations twice a year: at mid-year in late November/early December and at year-end in July.

Supervisory Evaluations of Faculty

Department chairs conduct reviews of their full-time faculty on an annual basis. These reviews include direct observation and data from student evaluations in the areas of teaching and delivery, student feedback, professionalism and interpersonal communication. Feedback is provided by the department chair to the faculty member as a part of their annual review. Part-time faculty are evaluated on a rotational basis and provided feedback by their department chair within a timely manner after the session is evaluated.

Peer Evaluations of Faculty

Faculty have the option of participating in a process of peer-reviewed teaching. This feedback is shared with the faculty member evaluated by their respective administrative head for developmental purposes to assist with professional growth. This data, in aggregate, is also shared with the Block, Course or Clerkship Director in the area in which they teach, as well as the Office of Faculty Development to assist with offering pertinent and relevant faculty development sessions.

Clinical Curriculum Student Evaluation Release Workflow for Faculty/Resident/Fellow/Graduate Student/Postdoctoral Fellow Feedback

Click to enlarge

Focus on Professionalism in Assessment and Evaluation

The College of Medicine – Phoenix fosters professionalism at all levels. While the vast majority of student evaluation comments are positive, the leadership of Academic Affairs, supported by the Office of Assessment and Evaluation and the Professional Resource Office, review and flag evaluations for potential professionalism and student mistreatment issues. See Professionalism Policy.