The Library
‘Phantom’ compositional effects in English school value-added measures : the consequences of random baseline measurement error
Tools
Tools
Tools
Perry, Thomas (2019) ‘Phantom’ compositional effects in English school value-added measures : the consequences of random baseline measurement error. Research Papers in Education, 34 (2). pp. 239-262. doi:10.1080/02671522.2018.1424926 ISSN 0267-1522.
Research output not available from this repository.
Request-a-Copy directly from author or use local Library Get it For Me service.
Official URL: http://dx.doi.org/10.1080/02671522.2018.1424926
Abstract
A compositional effect is when pupil attainment is associated with the characteristics of their peers, over and above their own individual characteristics. Pupils at academically selective schools, for example, tend to out-perform similar-ability pupils who are educated with mixed-ability peers. Previous methodological studies however have shown that ‘phantom’ compositional effects can arise purely from measurement error. Through simulations using English National Pupil Database data, this paper demonstrates that moderate rates of measurement error in baseline scores can produce a systemic bias in value-added (‘Progress’) scores that favours higher ability pupils. This bias is large enough to explain the ostensibly superior performance of selective ‘grammar’ schools that is seen in the English data and create an appreciable bias across the school performance distribution. This paper describes how such biases can arise from ‘regression attenuation’ and discusses the more general methodological implications of the results. The paper concludes that the consequences of baseline measurement error on school value-added scores is greatly mitigated by controls for school-level prior attainment, but that the English ‘Progress’ value-added measures, as they do not control for prior attainment at school-level, are seriously biased and that the observed ‘grammar school effect’ is likely to be largely or wholly spurious.
| Item Type: | Journal Article | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Divisions: | Faculty of Social Sciences > Centre for Education Studies (2013- ) | ||||||||
| Journal or Publication Title: | Research Papers in Education | ||||||||
| Publisher: | Routledge | ||||||||
| ISSN: | 0267-1522 | ||||||||
| Official Date: | 2019 | ||||||||
| Dates: |
|
||||||||
| Volume: | 34 | ||||||||
| Number: | 2 | ||||||||
| Page Range: | pp. 239-262 | ||||||||
| DOI: | 10.1080/02671522.2018.1424926 | ||||||||
| Status: | Peer Reviewed | ||||||||
| Publication Status: | Published | ||||||||
| Access rights to Published version: | Restricted or Subscription Access |
Request changes or add full text files to a record
Repository staff actions (login required)
 |
View Item |
