evaluations

Clinical Education

Evaluating an activity

Evaluations demonstrate the outcomes of an activity. This can serve many purposes: Many providers like to ensure that the attendees enjoyed the conference and collect data to assist in planning the next meeting. It is also the time to answer a few questions:

What did the attendees learn?
Were the targeted gaps closed?
Was there something that we hope to do, but were unable to accomplish?
Was this meeting a success?

ACCME Criteria 11: The provider [the Academy and its joint sponsors] analyzes changes in learners (competence, performance, or patient outcomes) achieved as a result of the overall program's activities/educational interventions.

As clarified by the ACCME, this does not mean that that every activity achieve a change in outcomes, but all activities must be evaluated in order to see if a change in competence, performance, or patient outcomes was made. What level an activity will be evaluated at will be determined by your Gap Analysis, and Learning Objectives.

Tools and Resources

The following PowerPoints and articles will lead to an improved understanding of how to plan and implement activity evaluations.

Articles on evaluation

Achieving Desired Results and Improved Outcomes: Integrating Planning and Assessment Throughout Learning Activities, by Donald E. Moore, Jr., PhD, JCEHP, 29 (1):1-15, 2009- Begin on page 10 for information on Evaluation
Evaluating Your Evaluations: A Practical Guide, by John A. Owen, EdD, CEMeasures, 2008, 2:74-80

Guides for writing multiple choice questions:

14 Rules for Writing Multiple-choice Questions, Brigham Young University

Evaluation information - Past Activities

Tips and Recommendations

Begin with the end in mind. When creating your activity, think about what information you will need and how you will collect it later.
Write measuable objectives, based upon established gaps.
Include the objectives on the evaluation form or pre/post test.
Compare your post-activity evaluations to your pre-activity needs assessment. Are you measuruing the problem that you're attempting to solve?
Using a pre-test serves several purposes:
- You verify that the audince which you're teaching has the gaps that your activityis designed to change.
- Coupling pre with post-testing measures a transition in the abilites of your audience.
- Pre and post-test can capture gaps data for later activities


All Academy Content Clinical Content Only Advanced Search