Let’s face it, as training professionals, we have a love-hate relationship with evaluation. We know that evaluation and its results can represent important information. However, the process of evaluation can seem daunting and even mysterious at times. One thing’s for certain, the call for accountability is being heard louder than ever in today’s tough economic climate.
At Langevin, we teach a 3-day workshop called Evaluation of Training where we lay out a user-friendly plan of attack to conduct all four levels of evaluation. I find that most trainers are surprised at how easy it is to measure the effectiveness of their programs, once they understand what I refer to as “PDA”! And, by the way, this PDA doesn’t mean “personal digital assistant” or “public display of affection!”
PDA is an acronym that represents three major phases of the evaluation process. Let’s take a closer look:
P is for Planning
Recently I saw a quote by HRD Blogger Patti Phillips that read, “Plan your work, work your plan.” In the evaluation process, the more time you spend in the planning phase, the simpler the execution. The planning phase, if done correctly, will make the rest of the process less daunting. In my opinion, the planning phase offers the most potential for improvement in the entire evaluation process. When planning an evaluation remember to:
- Determine the purpose of the evaluation (revise an existing course or secure more funding?).
- Determine expected and baseline performance.
- Determine the timing of the evaluation.
D is for Design
Design instruments, that is. In the evaluation process, “Instrument” is another word for data collection method. We teach a total of 27 instruments for all four levels in our Evaluation of Training workshop. Once you’ve determined the levels at which your training program will be evaluated, the instruments can be identified. Instruments can be traditional or not-so-traditional in nature. A few examples of evaluation instruments include: surveys, observations, focus groups, and tests/work samples.
A is for Analyze
Once the instruments have been designed and implemented, the analysis begins. Without proper analysis, it’s tough to explain the results. I refer to this phase as “the heart of evaluation.” This is the phase where you analyze tangible and intangible data and calculate an ROI if applicable. What you do, and when you do, it are dependent on the purpose of the evaluation, the type of data, time to analyze, cost, your corporate culture, and practicality.
PDA is an abbreviated version of the evaluation process we teach in our 3-day Evaluation of Training workshop. Hopefully this brief synopsis is enough to get you thinking about it. Evaluation is a must if you want to know whether or not your training programs are successful!
I’d love to hear how you are using measurement & evaluation in your organization.
Melissa
You can leave a response, or trackback from your own site.
Comments RSS