The aim of this paper is not to add any additional criticism regarding PISA data to the already existing mass of technical comments by journalists, policy-makers and, often in a very relevant manner, by researchers (e.g. see Goldstein, 2004, and the contributors of this book). Rather, we will discuss the important issue of what role PISA data can and cannot play in the more global objective of assessing the quality of education systems.