Efficacy Testing
Animal Care Academy Courses: High Value to Keepers
Course topics were selected for their broad applicability to zoos, parks and aquariums. This pilot involved the first four animal care modules. Participant responses confirmed the relevance of these topics. When asked to rate the value of each course for a new keeper, the following results were recorded.
A total of 155 individuals completed one or more of the Academy courses. Pre- and post-tests, aligned with each course’s designated outcomes, were administered just prior to and immediately following training. A follow-up assessment was also administered to a smaller group to gauge knowledge retention.
Gains in knowledge were recorded for each of the four tested courses. Average gains ranged from a low of 7 percentage points to a high of almost 23 percentage points. In all cases, the difference between pre- and post-test means was statistically significant—indicating little to no probability that the observed mean differences were the result of random chance (significance varied between p ≤ .004 — p ≤ .000). While pre-test scores varied by course, recorded post-test score means all clustered between 93.8% and 96.8%. This indicates a high degree of mastery, regardless of the individual’s performance level when the course began.
For each of the four e-learning courses, participants raised their performance from pre- to post-test. In addition, the variance across participant scores was effectively reduced. Upon post-testing, participants possessed greater knowledge of the content—and the range between the highest and lowest test score was significantly reduced.
For example, Zoonosis course pretest scores averaged 80.3% with a standard deviation of 9.5 points. After completing the Zoonosis e-learning module, the post-test average score was 96.3% with a standard deviation of 3.4. Similar growth patterns, including this reduction in range of participant pre- and post-test scores, were noted for each of the four courses.
Retention of learned skills and knowledge over time is an equally important factor for determining the efficacy of the Academy courses. Two of the pilot testing organizations agreed to conduct a follow-up assessment. Participants completed a follow-up test for the Zoonosis course 90 days after post-test administration. Results indicate that, following an initial gain of 15.7 percentage points and achieving a post-test mean of 96.5%, students maintained 10.2 of the original percentage 15.7-point gain. This equates to 67% retention of the gained knowledge, relative to post-test performance.
Participants gave the full range of course components high marks. In particular, these learners favored the real-world video case studies featured in each course. On average, participants believed that they had learned each course’s content—suggesting confidence with the subject matter. The majority of participants indicated a willingness to complete additional online training. This proved true regardless of the learner’s age. In fact, the older, more experienced participants indicated a greater desire to engage in online learning and a greater enjoyment of the online learning experience.
We will be pleased in the coming months to share with you additional results of efficacy testing completed by Dr. James Marshall at SDSU on the initial Animal Care Training course series. Thank you to all who participated in the study.
See the preliminary results for yourself here. Or stop by our booth (#104-106) at the AZA Conference in Kansas City to discuss the results.
Would you like to hear more about San Diego Zoo Global Academy?
Please contact Linda Duca at (516) 815-2886, or LDuca@Cypherworx.com |
