Best Practice

Teacher-assessed exam grades: Why ranking may be the most vital element

Examinations & Qualifications GCSEs and A Levels Coronavirus
In order to award this summer’s GCSE and A level qualifications, schools and teachers are being asked both to grade and rank their students in each subject. Tom Middlehurst looks at why the ranking element of this process might be more important than the grading itself

Throughout May, school leaders, heads of department and teachers will be preparing to submit their teacher assessments for GCSE, AS and A level candidates due to take exams this summer.

While there are still uncertainties over the process, including the final methodology for the national standardisation exercise, we do know that all centres will need to submit a prediction for what each of their students would have achieved had they sat the exams as normal. When the new-style exams themselves are still in their infancy, this is not a task that will come easily to many.

All teachers are used to providing “working at” grades, target grades and feedback as part of formative assessment. In its guidance for schools, Ofqual points out that a predicted final grade is not the same as any of these (Ofqual, 2020).

“Working at” does not take into account the extra support and revision students may have done in the coming months. Target grades should always include an aspirational stretch for students. Formative assessment is focused on moving a students’ learning forward – not providing a summative grading. Making a prediction on what a student was most likely to achieve in the summer requires professional judgement, integrity and transparency between colleagues.

But perhaps more importantly, exam centres will need to rank every student within a predicted grade, for each subject – from the most secure to the least secure. This, in turn, will create a rank of the entire cohort entered for that subject.

This exercise is likely to be far more complex, and unknown, than the grade prediction itself. How do you differentiate between two seemingly identical Grade 5 students? How can large departments like English and maths rank students, many of whom may be unknown to a majority of the department’s teachers? Even schools that have engaged in comparative marking between individual pieces of work will have rarely had the experience of ranking each child individually.

Yet, arguably, it is the ranking – not the grade – that is more important for schools to get right. One of the things that has been overlooked in discussion about teacher assessment is that, although the national standardisation may move teachers’ grade predictions up or down, the school’s internal ranking will not be changed – unless the ranking shows obvious bias to a particular group of students, something Ofqual is still consulting on (Ofqual, 2020).

As such, teachers and curriculum leaders can make best judgements about what a student would have got this summer, but the final decision is ultimately out of schools’ hands. The ranking, however, is entirely within their control.

This is not to say that the grade prediction is not important. It is. But what should a head of department do if she is given 40 Grade 5 predictions from eight different teachers? This is why the ranking exercise must go alongside teacher assessments and not be left as an afterthought at the end of May.

How can schools navigate this process in the coming month or so, particularly when many staff will be working remotely?

Evidence: At a classroom teacher level, teachers should of course be using as much evidence as possible to offer a professional, honest judgement about what each of their students was likely to achieve this summer. Ofqual is not requiring schools to send evidence initially, but in the case of appeals evidence may be asked for. Teachers should therefore be able to justify the grades they submit. Most schools will use some sort of moderation exercise during this process, especially to support less experienced staff.

An initial ranking: At the same time, heads of department may want to draw up an initial ranking of all candidates in their subject. How this is done will depend on each school’s internal data collection: it may be the raw scores of the last moderated test, pre-public mock exams or marks collected over the course of study.

Share your ranking: Some weeks before the deadline for submission, heads of department will need to share their initial list with all staff. Chis Baker, a physics teacher and football scout, suggests in a recent blog entry that the head of department go through every name of the list. No skipping. No jumping ahead. If anyone thinks a student should move up or down, they can have their say (Baker, 2020).

Compare rankings and grades: Once these exercises are complete, and classroom teachers have submitted their assessments, heads of department should look at how the submitted grades sit alongside the draft ranking. Does it seem to make sense? Where individual students are out of place in the rank, a discussion needs to be had as to whether the assessment or the ranking is at fault.

Repeat the process: In his blog, Mr Baker suggests the same process is repeated to agree the final list, after the adjustments have been made for grade assessments. The head of department reads out every name, and the submitted grade – without exception. Departments should pay particular attention to the candidates on the edge of grades – as these are the students most vulnerable to having their grades moved up or down during national standardisation. For submitting to awarding organisations, the ranking will need to be rewritten so that candidates within each grade are ranked.

Compare to recent results: We know that one of the factors being taken into consideration when standardisation is done, is a school’s most recent results. This is controversial, as it could be seen to disadvantage students at schools who have made rapid improvement in the last 12 months. However, with this in mind, as a final sense-check, heads of department and senior leaders may want to compare their final teacher-assessment submissions with the spread of grades in recent years. Does the story you are telling ring true? Of course, each cohort is different – especially for smaller option subjects – and so schools must not feel pressured into inflating or deflating grades purely based on previous performance measures – but a quick glance may be useful and help manage expectations. Likewise, it may be useful to look at where students with protected characteristics, including disadvantage, sit in the rank – as this is something Ofqual has expressed concern about.

This process will be new for many teachers, particularly in a system that has become so directed by external assessment. It will require teachers and leaders to have honest, open and professional dialogue, using a range of pedagogical disciplines, and continuing to show the integrity and dedication that has characterised the profession throughout this crisis.

Tom Middlehurst is head of policy and public affairs of the SSAT. Visit www.ssatuk.co.uk

References