The Association of Colleges has called for an “urgent technical review” of the A-level results standardisation process for larger centres, citing some “worrying data” reported by members.
In a letter to education secretary Gavin Williamson and Ofqual chief regulator Sally Collier, AoC chief executive David Hughes writes: “Some of our members with larger numbers of A-level students, and often with students disproportionately from disadvantaged backgrounds, are reporting to us some very worrying data."
Background: A levels and GCSEs will need appeals for mocks to count
A-level results: Will learners get the 'right' grades?
More: Grades lower in nine out of 10 sixth-form colleges
Mr Hughes adds: "It would appear that the standardisation process may have been biased against larger centres and those with high value-added scores.”
Mr Hughes says some colleges were reporting that their higher grade passes (A to C) were much lower than their results over the past three years, while in other colleges the A to C pass rate had increased. “That inconsistency is worrying. The overall pass rates are in line and do not seem to be such an issue. So this is not about over-optimistic assessed grades, it is about actual performance,” he adds.
A-level results: Fears of bias against larger centres
Mr Hughes says the algorithm used to calculate grades has also “potentially missed strong increases in performance in the last one or two years by a number of colleges”. “That is clearly something which would have been difficult to pick up in a process across thousands of centres. However, it would be very helpful for you to make clear the appeal process for colleges in that position and promise prompt consideration,” he writes.
“Our hypothesis is that the worrying results might be a quirk of the process, in which smaller centres with lower student numbers systematically had their centre-assessed grades confirmed, resulting in a hit for the larger centres in order to minimise overall grade inflation. We also believe that the algorithm may not have taken value-added data into account adequately.”
The AoC chief executive says a technical review now could examine that and would avert hundreds of colleges from having to make individual appeals. “It would show that you are being transparent and taking the concerns seriously," he writes. "It would allow the majority of students to focus on their next steps and move forward in confirming their HE places, apprenticeships or jobs, but also offer a robust backstop. It would calm the mood and we would warmly welcome it and support you in carrying it out.”
The association will continue to encourage colleges and students to focus on progression and to be positive about their prospects, Mr Hughes said, “but we cannot stand by when the evidence suggests that many thousands of students may have missed out on their grades because of a systemic bias”.
An Ofqual spokesperson said: “The approach we developed with exam boards and assessment experts for awarding GCSEs, AS and A levels is the fairest way of giving students an opportunity to move on in the unprecedented circumstances this year.
“In designing the standardisation model, we took a number of decisions in the interests of students’ interests, while making sure there is not any significant grade inflation and that grades retain currency. Our standardisation model, for which we have published full details today, does not distinguish between different types of centres, and is not biased towards any particular centre type.
“Throughout the process of designing and developing our standardisation model, we have had an expert advisory group in place, first meeting with them in early April. The group includes independent members drawn from the statistical and assessment communities. The advisory group has provided advice, guidance, insight and expertise as we developed the detail of our standardisation approach."
