Total quantity or scope of tender
The objectives of the final external evaluation are to:
(i) assess overall progress of the Pan Wales CEMET operation against the objectives set out in the business plan.
(ii) assess whether the Mid-Term evaluation recommendations were implemented successfully.
(iii) provide an up-to-date review of the policy context and logic model.
(iv) identify whether the wider impacts of the operation, as identified in the logic model have, or are likely to be realised in the future and can be attributed to the Operation. Consider any unintended effects that have or may be attributed to the operation and any issues relating to additionality, displacement substitution and deadweight.
(v) assess whether output indicators been met and what contribution has the operation made to the result indicator? How appropriate were the operation indicators / WEFO targets?
(vi) assess whether monitoring and evaluation mechanisms have been fit for purpose in measuring evidence of impact over the life of the programme.
(vii) assess how successfully the Operation integrated with other funded programmes /ERDF operations
(viii) assess how has the operation performed against the delivery of CCT aims, objectives and indicators, as well as CCT case (project) related indicators, including what worked well/what didn’t work, problems identified and how these were addressed?
(ix) assess how and to what extent, the operation has provided opportunities to promote the Welsh language through its activity?
(x) assess how has the operation contributed to the goals of the Well Being of Future Generations Act?
(xi) summarize how well the referral mechanism, (established by the Smart Innovation Gateway) has worked to deliver the Cross Cutting Themes indicators?
(xii) assess how effective CEMET’s contribution to Academic Research has been in the area of mobile and emerging technologies
(xiii) identify the conversion rate of those companies signing a collaborative agreement compared to those engaging in a successfully completed collaborative research project.
(xiv) assess what elements of the Operation were considered successful.
(xv) assess what areas of the Operation could have been improved and what lessons have been learnt?
(xvi) conclude on the overall progress of CEMET (Pan Wales) and if applicable, make recommendations for the long-term funding options for the operation when it comes to an end on 30th June 2023.
This makes suggestions on the methodological approach. Please note that the approaches stated here are intended as a guide, and that bidders may propose any combination of desk-based, quantitative or qualitative methods they deem appropriate.
(i) Conduct a literature review exploring innovation activity and the key challenges to growing innovation activity and investment in Wales, making comparisons with the UK and other small or devolved nations where appropriate. The literature review should add to the evidence set out in strategy documents and identify the ‘fit’ of the operation and its interventions with this context and identify any gaps in operation’s activity to address the issues around innovation in Wales.
(ii) Conduct a workshop with the delivery team, and consult others where relevant, to understand the key changes to CEMET since the production of the respective operation logic tables during the Mid Term Evaluations for WWV and EW.
(iii) Undertake an assessment of the emerging counterfactual utilising methods to be agreed in the inception meeting.
(iv) Conduct qualitative, semi-structured scoping interviews with key stakeholders, including participating SMEs.
(v) Generate case studies based on collaborative research projects with participating SMEs to demonstrate project deliverables and impact.
|