Evaluation design
The logic models below outline the macro-level evaluation for each key stakeholder group . For the majority of activity the SUN will be using type 2 empirical evaluation . For low intensity i interventions the SUN will collect narrative evaluation only and evaluate in a periodic manner .
The SUN team will update a data dashboard which outlines how interventions are linked to the following frameworks :
• SUN progression framework
• Gatsby benchmarks
• CDI careers framework
• PHSE programme of study
• OfSTED framework
• National Careers Strategy
The dashboard is a live document so new activities will be added over the time of the project .
The limitations of our method of evaluation are that , at a macro-level we are unable to evidence causal links with the programme as a whole and any change we see in progression data . Timescales of longitudinal outcomes are also a major limitation . There is always a time-lag with the data received from HESA and matching it to participants , which does affect .
We are interested in the dosage effect for both targeted and strategic outreach . We are keen to understand the different dosages of outreach interactions and if / how this effects learners ’ decision-making processes with regards to education choices .
Through the use of a combination of primary data compared with data from regional and national data sets , we aim to provide an in-depth understanding from an HE outreach programme point of view of the correlation between the number and type of interventions and progression .
For the attainment raising strand , we will also use control and treatment groups to gain an understanding of the combined interventions from the targeted / strategic programme with the new attainment raising programme and to view whether this influences the attainment levels of the target learners .