Timeliness Assessment Methods & Process Quality Assessment National Resources
Feedback & Assessment 1: Timeliness
There is a standard in the program that all written evals are completed within 2 weeks of assignment (level 2)
Implementation:
- Add the standard to your program manual
- PD makes announcements at faculty and trainee meetings on the requirement to complete evaluations in a timely fashion
- Coordinator emails faculty and trainees two weeks prior to start of rotation that evaluations have been assigned
- Coordinator sends out emails after conclusion of the rotation to remind faculty and trainees to complete the evaluations
|
Regularly create reports on the timeliness of completion of evals to improve compliance (Level 4)
Tools:
Implementation:
- Program pulls data every month to assess the completeness rate evaluations
|
Includes data about faculty compliance as part of faculty feedback (level 2-4)
Tools:
Implementation:
- Create an award to recognize trainees and faculty who meet/exceed the program’s expectations for timely feedback
- PD sends a personal email to faculty to complete evals if they are more than one month late. The email reminds them of the 2-week standard
- Report of evaluation timeliness included in annual faculty feedback or other regular communication
|
Feedback & Assessment 2: Assessment Methods & Process
Enhance assessment tools and the anchors (Level 1-5)
Tools:
Implementation:
- The STFM CBME task force recommends the following entrustment scale:
- Participated only as an observer or required faculty to do.
- Required significant faculty assistance.
- Required minimal faculty assistance.
- Completed independently, without need for assistance.
- Demonstrated the ability to role model or teach others.
|
Semi annual meetings and documentation (level 2)
Tools:
Implementation:
- Each trainee receives a copy of their milestones at semi-annual evaluation with PD/APD/advisor
- Trainees can review their evaluations and milestones on new innovations.
|
Direct observation of specialty specific skills/entrustable professional activities (Level 3)
Tools:
Implementation:
- Create a QR code linking to a Microsoft form so that it is easy to access for all
- Create a New innovations “on demand eval” for the EPA
|
Annual review of assessment forms (level 4)
Tools:
Implementation:
Add to the CCC agenda &/OR use faculty survey- Question to consider are: Which forms/questions are helping? What gaps do we have in our assessments. Could they be shortened? Are people using the NI app to help complete in more real time, etc.
|
Feedback & Assessment 3: Quality
Narrative feedback enhancements
Tools:
Implementation:
- Overall brief and general feedback terms are avoided by faculty like: “good job,” “perfect,” “well done,” “read more,” “at level of PGY year”
- PD review evaluations and identify faculty members that should be coached on how to provide descriptive, non-judgmental language on the narrative box.
|
Faculty Development Related to Assessment (level 2-4)
Tools:
Implementation:
- PD or CCC chair has individual conversations with faculty who seem to be overly harsh, lenient or consistent (all trainees get the same rating) in the use of the scale on assessment forms.
- Add a faculty development assessment pearl to division/program meetings.
- Invite an institutional or national leader to present grand rounds for your faculty.
|
Regularly create reports on the timeliness of completion of evals to improve compliance (Level 4)
Tools:
Implementation:
- Program pulls data every month to assess the completeness rate evaluations.
|
Do you have a tool to share or need more help? Contact Yasmin.Alishahi@va.gov
Assessment National Resources (update quarterly)