Using KS4 data to track progress in attainment
Make Happen were keen to understand whether two of their pre-16 activities had an impact on participants ’ KS4 exam attainment . These activities were run in partnership with two external providers . First , Fix Up , which offers a range of sessions related to providing support with motivation and exam preparation . Second , Positively Mad , which runs whole day workshops in schools focused on exam and revision skills .
The results of the study showed that , for Fix Up participants ( n = 165 ) Attainment 8 Scores were on average + 6.1 grades higher than the average scores for the schools the participants came from . This remained true after breaking down by prior attainment at Key Stage 2 : participants with low prior attainment ( n = 20 ) demonstrated the greatest positive difference , achieving on average + 5.7 grades higher across eight GCSEs than their similarly low attaining classmates . The Fix Up result was not significant at the 5 % significance-level , likely due to the small observed effect size of 1 grade increase combined with the sample size available for analysis .
Positively Mad participants ( n = 130 ) also demonstrated higher Attainment 8 Scores than their schools ’ average scores , achieving on average + 6.6 grades higher . Participants with medium prior attainment ( n = 70 ) demonstrated the greatest positive difference , achieving on average + 5.5 grades higher across eight GCSEs than their classmates from the same attainment band . The Positively Mad result was statistically significant ( p =. 019 ).
The analysis above uses the school average as a comparator group against which to compare the outcomes of activity participants . For this reason it can be considered strong Type 2 : Empirical Evidence , according to the OfS Standards of Evidence . Uni Connect Partnerships may be a in a better position than individual higher education institutions using the HEAT database when it comes to sourcing data for a comparator group . Many partnerships have been baselining , and tracking , all pupils within year groups as part of the Uni Connect national evaluation , providing a comparator group for such analysis .
From the HEAT website : A Case Study with the Uni Connect Partnership Make Happen
Positively Mad participants ' attainment scores compared with non-participants
12