Academic estimates ‘real’ cost of REF exceeds £1bn

I’ll make a few comments in addition the article. 1. I put the spreadsheet together over the equivalent of a couple of coffee breaks. No doubt it could be refined and improved upon. Indeed, it is mildly diverting, as a physicist, to play around with the %’s and see which elements rise and fall. To my mind, as calculated, impact statements seem like VFM given their power in convincing BIS/Treasury of the utility of the UK research effort. 2. I was trying to get a feel for the opportunity cost of the whole REF exercise. Many people I have spoken to shake their heads at citing of the previous PA report figure for RAE2008. 3. As quoted I believe REF serves a purpose but would hope the sector collectively can inform the costing from the bottom up. REF will award circa £1.75B p.a. for the next 5-6 years… £8B+ is the cost <£0.1B, £0.5B or more? 4. The impact studies are good illustration of my order of magnitude methodology used in spreadsheet… if you contend that they might be a 1/10th of current figure used in my spreadsheet estimate then they would cost ~£10M of the propertied £80-120M cost of REF. But was each impact statement and all each entailed delivered in just 16 hours of effort! Really? OK, so maybe a weeks work…. Or more? Over a couple years, 160 hours doesn't seem outrageous and that’s before we recognise I omitted the cost of the impact statements that never saw light of day as UoAs optimised staff numbers around their best impact statements. 5. Everyone has a view. From the single academic (just how much time did you have to expend at various stages thinking, selecting, justifying, checking your outputs, income etc. etc.) to the whole effort doing impact statements (paid writers, engaging external readers, purportedly). Likewise, for all the preparation and validation of the UoA submission in its entirety by someone like a ‘champion’ and/or UoA team? And then the harder to estimate institutional cost (from a small % of time of a VC & PVCs right down through Research Support Offices to the back-office computer support to ensure databases and documents all load into REF submission software. 6. All these figures will vary across institutions large and small and Main Panel by Main Panel but to counter the comment from Graeme Rosenberg in the article my guesses are not based solely on a) my own experience or even b) that of my own institution. But by some common sense guesstimates (not just my own) and comment and chatter we all pick up in the community of how all institutions do things differently. From the relatively hands-off, those with UOA reading teams, to those where people tell me they were individually interviewed on their outputs choices. There is a wide diversity of experience out in the community and it would be good if this might start to capture and enumerate the cost. Happy calculating! p.s. there are lost of arguments for/against using TRAC, choosing salary levels, proportions of professorial staff, equating admin grades to academic salary (single pay spine) etc etc. - all variable for people to play with.

I am not persuaded the entire cost of impact statements should be assigned to REF. If they are good, they reused for many other purposes.

Audit

An interesting analysis which challenges the assumption that its a near zero sum activity. Even if the costs are at the lower end, which I doubt, there is surely a powerful case for re-examining the value of the REF as we can now see that pretty well all the objectives set out in the Roberts Review have been missed as the UK Universities outside of the Golden Triangle continue to drop down international rankings. The latest THES ranking did not have an English University outside Oxbridge and London in the top 50. Equally importantly the UK's share of international research funding from the private and public sector continues to drop. We are seeing a serious US style division emerge in Higher Education where a tiny elite of "Ivy League" type institutions suck in endowments, research funding while pressing for the power to charge premium fee levels to reinforce their advantages - and the devil take the hindmost