Empower Boys Evaluation 2024/25 | Page 7

Year 10
Year 10 students showed a moderate increase in confidence expressing their thoughts and beliefs( from M = 3.11 to M = 3.34). A paired-samples t-test found that this change was not statistically significant, t( 37) = – 1.46, p =. 15( two-tailed). The effect size was small to moderate( Cohen’ s d = 0.30), indicating a more noticeable shift compared with other year groups, although the small sample size limits statistical power. Year 10 showed the biggest practical improvement though with a small sample size hampered the ability to be statistically significant.
Question 2: I am good at dealing with setbacks in and out of school
Combined Year 9 and 10 responses
Students showed a significant improvement in their ability to deal with setbacks( from M = 3.03 to M = 3.31). A paired-samples t-test confirmed that this increase was statistically significant, t( 126) = – 3.33, p =. 001( two-tailed). The effect size was small but meaningful( Cohen’ s d = 0.26), suggesting a clear positive shift across the cohort. There was also a stronger than usual correlation for attitudinal data, meaning:
• Students who were resilient before tended to remain resilient.
• Students with lower resilience at baseline remained lower— but showed improvement. A high correlation strengthens the paired t-test and makes the change more reliable. Year 9
Year 9 students showed a significant improvement in their ability to deal with setbacks( from M = 3.06 to M = 3.40). A paired-samples t-test confirmed this increase was statistically significant, t( 88) = – 3.53, p <. 001( two-tailed). The effect size was small-to-moderate( Cohen’ s d = 0.32), indicating a meaningful positive shift in resilience across the cohort.
Year 10
Year 10 students showed a small increase in their ability to deal with setbacks( from M = 2.97 to M = 3.08), but this change was not statistically significant, t( 37) = – 0.70, p =. 49( two-tailed). The effect size was very small( Cohen’ s d = 0.11), indicating negligible practical impact for this question within the Year 10 group.
Overall, the programme seems to have had the greatest effect on the Year 9 students as Year 10 showed little or no measurable impact on this question.
Question 3: I’ m confident at taking on new challenges
Page 7 of 14