Product Details

Needs assessment
Formative evaluation
Reaction evaluation
Learning evaluation
Performance evaluation
Impact evaluation

CompleteROI Reaction Evaluations measure training participants' immediate impressions of the effectiveness of learning programs. The reaction evaluation is the lowest-level, most straightforward, and easiest-to-implement measure of a training program's effectiveness.

Corresponding to Level 1 of Jack Phillips' ROI model, the Reaction Evaluation component of the CompleteROI system is an application for administering reaction surveys, collecting data, and viewing reports that compare reaction data between classes or training programs. End users can be surveyed directly online, or indirectly with paper-and-pencil surveys or in-person interviews and focus groups.

Typical areas probed in reaction evaluations include:

  • Difficulty of the course material
  • Degree to which course objectives were accomplished
  • Relevance of training to on-the-job performance
  • Instructor's overall effectiveness
  • Suggestions for improvement

It is essential that the questions asked to evaluate training programs be consistent across the programs, so that answers to the same questions can be compared across different programs. C3 provides default measures that can be evaluated, and can assist organizations to create others.

Using the Reaction Evaluation component, administrators can:

  • Administer individual reaction surveys, either directly to end users online, or indirectly with paper and pencil or through focus interviews.
  • Edit, administer, and display the results of individual reaction surveys.
  • Collect and sort comments from learners for easy viewing.
  • View summary reports that clearly display users' responses to each question in the survey, along with each user's average response and the average response for each question.
  • View the percentage of users that assign a particular response to a question, and the range of responses.
  • Import data into Microsoft Excel or databases for further processing.
  • Display graphs comparing average reaction evaluations of instructors and courses.
  • Visually display the variance of responses across courses.
  • View reports by hierarchy, possibly including geographical region and class type.
  • View summary statistics on the number of evaluations returned and courses rated.
  • Display a list of best and worst course performers.
  • Establish reaction goals or benchmarks and compare individual course performance to these benchmarks.

Top How to Buy/Pricing

    CompleteROI Reaction Evaluations are a component of the CompleteROI System. Reaction Evaluations can be bought separately without purchasing an entire suite of measurements. Pricing depends on desired components and usage. Please contact an account representative for a quote for your organization.

©2007 C3 Statistical Solutions, Inc. All rights reserved