Defining and measuring the quality of education

Is there an emerging consensus?
What is the quality of education? What are the most important aspects of quality and how can they be measured?
These questions have been raised for a long time and are still widely debated. The current understanding of education quality has considerably benefitted from the conceptual work undertaken through national and international initiatives to assess learning achievement. These provide valuable feedback to policy-makers on the competencies mastered by pupils and youths, and the factors which explain these. But there is also a growing awareness of the importance of values and behaviours, although these are more difficult to measure.  
To address these concerns, IIEP organized (on 15 December 2011) a Strategic Debate on “Defining and measuring the quality of education: Is there an emerging consensus?” The topic was approached from the point of view of two cross-national surveys: the OECD Programme for International Student Assessment (PISA) and the Southern and Eastern Africa Consortium for Monitoring Educational Quality (SACMEQ)*.
Assessing the creativity of students
“Students’ capacity to extrapolate from what they know and apply this creatively in novel situations is more important than what the students know”, said Andreas Schleicher, Head of the Indicators and Analysis Division at the Directorate for Education, OECD, and in charge of PISA. This concept is reflected in current developments taking place in workplaces in many countries, which increasingly require non-routine interactive skills. When comparing the results obtained in different countries, PISA’s experience has shown that “education systems can creatively combine the equity and quality agenda in education”, Schleicher said. Contrary to conventional wisdom, countries can be both high-average performers in PISA while demonstrating low individual and institutional variance in students’ achievement. Finally, Schleicher emphasized that investment in education is not the only determining factor for quality, since good and consistent implementation of educational policy is also very important.
The importance of cross-national cooperation
When reviewing the experience of SACMEQ, Mioko Saito, Head a.i of the IIEP Equity, Access and Quality Unit (technically supporting the SACMEQ implementation in collaboration with SACMEQ Coordinating Centre), explained how the notion of educational quality has significantly evolved in the southern and eastern African region and became a priority over the past decades. Since 1995, SACMEQ has, on a regular basis, initiated cross-national assessments on the quality of education, and each member country has benefited considerably from this cooperation. It helped them embracing new assessment areas (such as HIV and AIDS knowledge) and units of analysis (teachers, as well as pupils) to produce evidence on what pupils and teachers know and master, said Saito. She concluded by stressing that SACMEQ also has a major capacity development mission and is concerned with having research results bear on policy decisions.  
The debate following the presentations focused on the crucial role of the media in stimulating public debate on the results of cross-national tests such as PISA and SACMEQ. It was also emphasized that more collaboration among the different cross-national mechanisms for the assessment of learner achievement would be beneficial. If more items were shared among the networks, more light could be shed on the international comparability of educational outcomes.
View or review the presentations and the debate. Click here to launch the video.
Download the presentations: Andreas Schleicher, Mioko Saito.
* PISA assesses the acquisition of key competencies for adult life of 15-year-olds in mathematics, reading, and science in OECD countries. SACMEQ focuses on achievements of Grade 6 pupils. Created in 1995, SACMEQ is a network of 15 southern and eastern African ministries of education: Botswana, Kenya, Lesotho, Malawi, Mauritius, Mozambique, Namibia, Seychelles, South Africa, Swaziland, Tanzania (Mainland), Tanzania (Zanzibar), Uganda, Zambia, and Zimbabwe
Links: IIEP activities of quality of education, PISA website, SACMEQ website.