Methodology
The evaluation aims to assess the effectiveness of the project in relation to five key themes. It incorporates external and internal strands which are inter-related to maximise formative impact on the project.
The external evaluation is assessing whether, to what extent and how the objectives of the ICT Test Bed policy have been met. It identifies challenges encountered and lessons learnt. There is an emphasis on measuring change against benchmarks (using quantitative methods) and developing explanatory theories about the development and implementation of good practice (using qualitative methods).
The internal evaluation, in partnership with teachers, school and college leaders, is using an action research approach to support the development of good practice and its dissemination. The evaluation team provides guidance and mentoring for teachers and school/FE leaders in carrying out research, including support materials for carrying out data collection, analysis and publication.
The qualitative team is using three main approaches:
- Overviews of developments within and across clusters
- Focused studies linked with ICT Test Bed Action Plans
- Opportunities for staff at all levels to make direct contributions to the evaluation through supported small-scale action research projects focused on ICT Test Bed activities.
This team is led by Prof Bridget Somekh at Manchester Metropolitan University.
The quantitative strand is using three measures:
- Comparisons against baseline questionnaires collected during 2002-03 of the progress made by schools and colleges over time. These questionnaires are given to staff, learners and parents.
- Annual comparisons of national test and examination results with those of benchmark schools, colleges and Local Authorities.
- A maturity model which will track the increasing maturity of schools/colleges against the five ICT Test Bed themes as well as Technical Maturity. Schools and colleges are asked to assist with the collection of these data, which are designed to be user-friendly and time-efficient.
This team is led by Prof Jean Underwood at Nottingham Trent University.




