Once you have a solid design for your reaction level evaluation in place, the next challenge is to determine the modality for delivery.
Paper and pencil surveys are efficient because they can be handed out in any training environment and you can ensure an almost 100% response rate by requiring completion before learners leave.
The downside of paper and pencil surveys is they create a lot of paper waste and all of the data analysis must be entered manually for analysis.
The other option is an online survey. Online surveys save waste and allow for automating parts of data entry, making analysis much quicker. If the training occurs in a room with computers, evaluations can be required before learners leave the room, ensuring a 100% response rate.
If the evaluation is conducted via a learning management system (LMS), a 100% response rate can be achieved by requiring completion of the survey before the course is considered complete. If a course evaluation is sent via email, expect a low response rate, no better than 15-20% in many cases.
If opting for an online survey that is not delivered through an LMS with a survey capability, there are a number of free and paid online survey tools available with varying levels of features and functionalities. Three popular options, among many on the market, include:
• Google Form: Free with a Google account as part of Google Drive. Offers numerous question types and unlimited response collection. Template choices and customization options are limited. Distribution is primarily via web link or website embedding. Data is collected in a Google Spreadsheet, allowing for easy analysis.
• Survey Gizmo: Free and premium accounts. Free accounts include limited question types, templates, reporting, and distribution options. Premium accounts range from $15 per month to $300 per month, enhancing the features available in each service category.
• Survey Monkey: Free and premium accounts. Free accounts allow for creating surveys with up to 10 questions and are limited to 100 responses. Free accounts provide limited templates, customization options, distribution, and reporting methods. Premium options range from $26 per month to $780 per year, enhancing the features available in each service category.
Designing quality reaction evaluations is a time consuming task, but one that can provide higher quality data to drive program improvement and enhance learning. Consider writing questions that focus on the learner and aim to touch on more than just the first level of evaluation: learning, behavior, or results. As you consider the delivery method of your surveys, look to online software, either through stand-alone survey software or integrated solutions such as through an LMS to drive efficiency of data collection and make your data analysis process easier.
Evaluating Your Team - Feature