Phase 3 Evaluation Plan 2024 - 2025 | Page 9

Evaluation Approach : The SUN uses a mixed methods approach to evaluation . The quantitative data collected focuses on the ‘ what ’ i . e ., any changes in HE participation , attainment etc . The SUN will make use of secondary datasets available from national open data sources alongside primary datasets collected from participants , local authorities , schools / FE Colleges and third sector organisations working in collaboration with SUN .

In support of the quantitative data , the SUN will be conducting qualitative evaluation and data capture which will provide the ‘ why ’ to any changes identified in quantitative datasets . Crucially this aspect ensures that stakeholder voice is represented and embedded within our evaluation and dissemination of findings .

Using a mixed methods approach , we aim to provide a holistic evaluation of the project and will be able to identify any unintended outcomes and / or impact of the project across our stakeholders .

We welcome the use of experimental methods such as RCTs following our involvement in this during Phase 1 and 2 . However , our approach to this will be at a micro level with specific and quantitative objectives which reflect behaviour change . Again , any experimental methods will be supported by qualitative data to understand the processes and reasons behind project findings .

We aim to enter a mixture of high , medium and low intensity interventions 1 to ensure we are able to analyse dosage effect on cohorts who are engaged in sustained and progressive outreach .

For Phase 3 , the SUN has moved to Public Task to record the majority of interventions and activities on HEAT , therefore we have been able to increase the number of learners tracked . However , it is important to note that with public task the SUN can only collect the following student information : name , school , date of birth and postcode . This allows SUN to target the ‘ Uni Connect ’ learner within targeted outreach and the ‘ Strategic Outreach ’ Learner with POLAR 4 Q1 / TUNDRA LSOA and MSOA Q1 postcodes . For the mediumhigh intensity interventions , we still aim to collect HEAT consent forms , allowing us to the get special category data .

1

Intensity is defined by the SUN Intensity Matrix which is used in all activity planning to ensure consistency across our programme