HOW IS THE PROGRAMME BEING EVALUATED AT A LOCAL LEVEL ? A very brief overview of how evaluation is being conducted :
1 . This evaluation framework , and specifically the progression framework , is the cornerstone of all decisions on SUN interventions . 2 . The SUN takes a mixed methods approach to evaluation across all interventions at both formative and impact levels . 3 . The SUN will use HEAT ( Higher Education Access Tracker ) to monitor engagement in activity by target students , their key influencers and education professionals . 4 . The SUN will not be evaluating all interventions . Programme staff will utilise an intensity matrix that provides a systematic way of assessing the intensity of an intervention and the need for evaluation . 5 . All interventions are monitored . 6 . Innovative evaluation methods will be used where deemed appropriate and where resource allows . The SUN has participated in a flagship Randomised Control Trial and we hope to undertake at least one additional innovative evaluation method during the lifetime of the project 7 . Evaluation projects will be disseminated appropriately , and all high-cost project reports will be published on the SUN website ( Our Impact - Southern Universities Network ( sunoutreach . org ) )
Following the principles of effective evaluation research set out by Rossi et al . ( 2004 ), the evaluation focuses on evidencing impact via systematic data collection and analysis . The principles adopted include :
o Collection of multiple data sets with a similar focus to support triangulation , enhance reliability and compare views of different stakeholders o Ethical principles of integrity , honesty , and respect for people . Informed consent will be sought from all participants , with confidentiality and anonymity in data collection and analysis assured .
In addition to this , the SUN adheres to the UK Evaluation Society ’ s Good Practice in Evaluation Guide ( Guidelines for Good Practice in Evaluation , no date ) and guidance outlined by TASO ( https :// taso . org . uk / evidence / research-ethics-guidance / ) in all of its evaluation activity . Evaluation plans have been given Ethics approval by the University of Southampton ensuring the overall approach , processes , and methods are appropriate for the communities and individuals engaged in the project .
A central focus of the evaluation is to promote active engagement , making it a collaborative process involving participants – something that happens with participants rather than to them . Stakeholder voice is a vital aspect of this , and the SUN will invest in emancipatory projects and evaluation methodologies for Phase 3 .
The partnership believes that ascertaining a causal relationship at a macro level of the project is not achievable . Progression to higher education is impacted via a wide range of aspects including contexts , circumstances , cultures , and processes outside of the SUN ’ s control and funding remit ( Thomas , 2000 ; Bowes et al ., 2013 ; Harrison and Waller , 2017 ; Clements and Short , 2020 ; Clements , Davies and Mountford- Zimdars , 2021 ).
The following sections of this document outline in detail how evaluation will take place along with short- , medium- and long-term success measures . HOW IS THE PROJECT BEING EVALUATED ON A NATIONAL LEVEL ?
The Office for Students is responsible for the national evaluation of the Uni Connect Programme . For full details of how the programme is evaluated at a national level please visit https :// www . officeforstudents . org . uk / advice-and-guidance / promoting-equal-opportunities / uni-connect / evaluating-uni-connects-impact / .
PROGRESSION FRAMEWORK : SUSTAINED AND PROGRESSIVE OUTREACH The progression framework should be used to plan interventions in the following ways :
1 . Decide on the learning objectives you want to test with an intervention 2 . Link to applicable policies and framework ( e . g . the Gatsby Benchmarks ) to make the document as user-friendly and relevant as possible . 3 . Link the objectives to evaluation themes and progression stages 4 . Discuss the best evaluation methods and how to collect evidence of impact 5 . Ensure that identified themes , objectives and evaluation methods contribute to the learner logic model
The progression framework can be accessed here : https :// southernuniversitiesnetwork . glasscubes . com / share / s / d805anqld61q9lopctrk5rdiv0
4