Discussion about this post

User's avatar
Luke Jones's avatar

1) Speaking from my own discipline — Architecture — the expansion has been most damaging for the notionally 'elite' universities. When I started teaching in London, the sector had some small, highly prestigious institutions (UCL Bartlett, RCA etc) and a lot of large ex-poly courses. The former were very hard to get into, had low SSR and were intense. A decent degree from one was a strong signal of quality, and everyone on the courses was very ambitious and driven.

The latter were large, and had a bit of sink or swim ethic, at least in first year. Lots of people would fail or drop out. But the teaching was still good if you engaged with it, and graduates were generally very employable and often did well.

I've taught at a bunch of places across both groups. Since the cap on numbers was removed, all the prestigious places have got massive (2-4x larger cohorts). The academic culture and rigour has been diluted, and the quality is no longer in any way dependable. At the same time, most of the ex polys have shrunk away — in size, they're half as big or less. In neither case are you allowed to fail anyone any more because of league tables (and now B3 — thanks for that!) so you're nursing students through these courses who should have dropped out and done something else. Every metric creates its own monsters -- graduate unemployability reflects the fact that a lot of people who make it through should not have done.

2) TEF is a waste of time because the metrics are all the same ones the League tables use. So institutions are all already massively overfitted for producing these, regardless of the quality of the courses. They know how to game them. Everyone has their NSS maximisation strategy. Most of what you're measuring is how good they are at gaming.

The deficiencies of NSS as a measurement of teaching quality are obvious — to use an analogy, it's like a restaurant review by a person who's only ever been to one restaurant. No baseline. GOS mostly measures how good the university is at phone banking. It's all miles away from actual 'quality.' I've seen very poor courses with great NSS, and vice versa.

3) My suggestion for a quality measurement would be for the OfS to just sometimes show up and sit in at External Examination. Universities are meant to manage their own quality assurance. But the temptation is always for this to become friends doing favours for each other. No one is very incentivised to rock the boat. You wouldn't have to do this for very many courses — say one per institution per year, without prior notification. It would have a big effect.

Stuart Weeks's avatar

I was a QAA reviewer back in the day, and it was an awful process that ate up huge amounts of money, time and effort for very little return, with unis rapidly learning to game the system. I can't imagine that a uni OFSTED would be any better. It's prescriptions also contributed, I think, to the rise in grades, but not by improving teaching.

10 more comments...

No posts

Ready for more?