School exam grades in England can't be trusted
In England, every year, more than a million high school students take GCSE (age 16), AS (age 17) and A level (age 18) exams. The grades those students are awarded are important. Good grades open doors. Poor grades slam them shut. So it's vital that those grades are reliable, and can be trusted.
The truth, however, is that about 1 grade in every 4 is wrong. Without any right of appeal.
That means that of the approximately 6 million grades awarded each summer, about 1.5 million are wrong. The number of wrong grades is greater than the number of students, so, on average, every student in England is awarded at least one wrong grade. But no one knows which grades are wrong in which subjects. Nor can anyone ever find out - these wrong grades cannot be discovered, or corrected, by the appeals process (which is distinctly odd, but true, as explained here).
So those 1.5 million wrong grades last for ever. As does the damage they do.
Unsurprisingly, this is denied by the authorities - the exam regulator, Ofqual; the schools regulator, Ofsted; the government's Department for Education; and the exam boards AQA, Pearson/Edexcel and OCR, who set, administer and mark the exams.
For some years, I have been throwing a bright light into this most murky corner. I've written a book - Missing the Mark: Why so many school exam grades are wrong, and how to get results we can trust - published by Canbury Press in August 2022; I've written many blogs and similar pieces for national newspapers, and on platforms such as the Higher Education Policy Institute, TES (formerly, the Times Educational Supplement), Schools Week and FE News; I've presented at many conferences; there are these videos and podcasts too.
Here are the blogs:
GCSE grades are unreliable (Daily Telegraph, 21 August 2017)
1 school exam grade in 4 is wrong. Does this matter? (HEPI, 15 January 2019)
1 school exam grade in 4 is wrong. That’s the good news… (HEPI, 25 February 2019)
Yes, the grade reliability problem can be solved (HEPI, 4 March 2019)
Contextual admissions – a fuller story (HEPI, 1 May 2019)
Students will be given more than 1.5 million wrong GCSE, AS and A level grades this summer. Here are some potential solutions. Which do you prefer? (HEPI, 16 July 2019)
Dear Ofqual… (HEPI, 15 August 2019)
Something important is missing from Ofqual’s 2020/21 Corporate Plan (HEPI, 8 August 2020)
Why ‘exams as usual’ are a bad idea (HEPI, 15 September 2020)
The broken school exam system needs an upgrade (HEPI, 10 October 2020)
Just how reliable are exam grades? (Rethinking Assessment,15 October 2020)
Why are exam grades unreliable? (Half-baked Education, 27 October 2020)
Exam grades MUST be reliable and trustworthy (Sixth Form Colleges Association Blog 6, 1 November 2020)
School exams don’t have to be fair – that’s official (HEPI, 19 November 2020)
The Great Grading Scandal Engineering Challenge (Engineering Professors Council, 20 November 2020)
No, Minister. England’s school exams are not ‘the fairest way’ (LSE, 30 November 2020)
PQA’s underlying – and false – assumption (WONKHE, 7 December 2020)
Exam grades can never be ‘accurate’. But they can be ‘reliable’. (Sixth Form Colleges Association Blog 6, 7 December 2020)
On assessment, teachers are wrong by design (Schools Week, 17 December 2020)
How to be ‘innovative’ in school exam assessment – fewer grades (HEPI, 16 January 2021)
Exam appeals – a contradiction that must be resolved (HEPI, 27 January 2021)
Those who want to fight for educational change after Covid will have to be well-organised and collaborate (School Management Plus, 28 January 2021)
How to deliver reliable school exam grades (Inside OR, April 2021, page 11)
Let’s consign grades to the educational graveyard (Schools Week, 14 April 2021)
Can exam grades be accurate? (Chartered College of Teaching, 14 May 2021)
The price of grade unreliability, and an idea for the new Chief Regulator’s in-tray (HEPI, 13 July 2021)
Higher education to the rescue: only universities can put sufficient pressure on Ofqual to deliver reliable grades (HEPI, 7 August 2021)
The future of exams: two fundamental principles that must be honoured (HEPI, 24 August 2021)
To whom is Ofqual accountable? (HEPI, 16 September 2021)
Exams 2022 - a call to action (Sixth Form Colleges Association Blog 6, 20 September 2021)
The Perfect Crime: Why Your Grades Could Be Wrong (by Lucy Heywood and Charlotte Gleed, The Oxford Blue, 3 June 2022)
Exams: ‘One wrong grade can be a tragedy for university applicants’ (School Management Plus, 6 July 2022)
Ofqual under the microscope: four things you need to know about 2022's exam results (EdCentral, 19 August 2022)
Congratulations to GSCE students (shame about the wrong grades) (Canbury Press, 25 August 2022)
Are the right freshers in the right places? (HEPI, 7 September 2022)
The Perfect Crime (Canbury Press, 9 November 2022)
HEPI Christmas Quiz: If only 0.9% of school exam grades are wrong, how many are right? (HEPI, 16 December 2022)
Unreliable grades do great damage. This must be fixed. (Rethinking Assessment, 29 January 2023)
GCSE re-sits: ‘Wrong’ grades drain students and resources (FE Week, 31 January 2023)
Are GCSE, AS and A level exam grades “reliable to one grade either way” reliable enough? (FE News, 28 March 2023)
A matter of significance to all involved with admissions… (HEPI, 15 April 2023)
Written evidence to the House of Lords Education for 11-16 Year Olds Committee (submitted 6 April 2023; made public, 28 April 2023)
Beyond Ofsted? And what about ‘Beyond Ofqual’? (Schools Week, 29 April 2023)
Exam assessments can be reliable. And this is how to do it (FE News, 12 May 2023)
Exams 2023: The ‘mistaken’ grades that will not be found (SecEd, 15 May 2023)
Dear Ofqual… (FE News, 20 July 2023)
Saved by the bell – but exam reliability questions won’t go away (Schools Week, 7 August 2023)
Is it time for a re-mark of the exam appeals system? (School Management Plus, 16 August 2023)
Exam results aren’t accurate enough to guarantee fair HE admissions (Times Higher Education, 17 August 2023)
How GCSE and A-level exams are marked – some consequences (FE News, 24 August 2023)
Wrong grades with no right of appeal (Educate, NEU, September/October 2023, page 50)
The Advanced British Standard – A huge missed opportunity (FE News, 6 October 2023)
Can GCSE and A level exam grades be trusted? (SecEd, 6 October 2023)
The Damaging Flaw In England’s Exam Grading System (Teaching Times, School Leadership Today, 21 November 2023)
Why haven’t Ofqual published metrics of grade reliability? (FE News, 12 January 2024)
GCSEs & A levels: Reliable to one grade either way? (Sec Ed, 30 April 2024)
Exams – And Their Results – Are All About Trust (Teaching Times, 8 May 2024)
An immediate priority - to deliver reliable school exam grades (Education for Tomorrow, Spring 2024)
Exam Results 2024 – ‘Reliable To One Grade Either Way’ (Teaching Times, 5 August 2024)
How transparent is the GCSE, AS and A level exam appeals process in England? (FE News, 5 September 2024)
(FE News, 11 September 2024)
What grade would you give to OCR’s recent report on the curriculum and assessment? (EdCentral, 27 September 2024)
Exam marking errors are just the tip of the iceberg (TES, 3 October 2024)
OCR’s Curriculum and Assessment Report – Two Errors Of Omission (Teaching Times, 10 October 2024)
And this letter to the Times, published on 26 August 2023:
My inference that "on average across all subjects, about 1 grade in 4 is wrong" is much disputed, not least by Ofqual's then Chief Regulator, Dr Jo Saxton, in her August 2022 video (at about 7:43), and by Mary Curnock Cook, Chair of Pearson Education, in this HEPI blog of 14 August 2023.
The key facts concerning the unreliability of grades, however, have been cited by several influential lobby groups such as Rethinking Assessment, The Times Education Commission (page 36) and New Era Assessment (page 19), and discussed by, for example, Melvyn Roffe and Rob Cuthbert.
Comments