REF 2029: metrics for research culture pilot unveiled

Organisers of the UK’s Research Excellence Framework (REF) have unveiled the metrics that will be used to assess research culture for its much-anticipated people, culture and environment (PCE) pilot study.

New guidance published on 14 January has set out the indicators which will be used to measure excellence in PCE for a pilot that will inform how the REF 2029 evaluates this area, which will make up 25 per cent of an institution’s score.

The project led by Technopolis and CRAC-Vitae will see 40 institutions prepare PCE submissions in a sample of REF units of assessment and at institutions, with the pilot set to make its recommendations by September 2025.

The final criteria for PCE assessment in REF 2029 will be published in the winter of 2025-26.

Previously, research environment has been assessed based on lengthy institution-level and unit-level submissions but REF organisers are seeking to streamline these submissions following concerns that they are unwieldy, expensive to produce and difficult to evaluate. Greater emphasis will be put on metrics, though there is little agreement on what type of indicators would work across institutions and departments.

According to the new guidance, institutions will gather information in metrics covering five areas – strategy, responsibility, connectivity, inclusivity and development. Institutions will also submit qualitative evidence and contextual data in these areas.

On responsibility, institutions will be asked to show how “staff and research students pursue research, assessment and engagement activities responsibly, with integrity and to the highest standards” by submitting data on “the impact of participation in cross-sector initiatives linked to responsible research” and on “carbon emissions data”.

On connectivity, universities will be asked to demonstrate how “research and research enabling staff and research students share research, knowledge and expertise widely both internally and externally, including through open research practices” and whether their work “promotes and sustains high-quality collaborative research both internally and externally, promoting mobility across careers and sectors and fostering a diversity of ideas, practices and approaches”.

Metrics on this measure could include the “number of times shared datasets are accessed or downloaded on openly accessible platforms”, the “number of cross-disciplinary grant applications as a proportion of eligible staff” and the “number and disciplinary spread of co-authored or co-produced research outputs and activities”.

Data on inclusivity will include “longitudinal data on percentage of eligible full-time equivalent staff as white, Black, Asian, other/mixed or unknown at institution level”, data on the percentage of eligible staff who are women, have a disability or who come from under-represented groups and data on how many fixed-term staff had been successfully deployed within an institution.

Assessment on development excellence would include the proportion of staff who have completed training activities or well-being data taken from internal staff and research student surveys.

Institutions will be able to submit qualitative evidence but word limits for each section will be limited to 1,000 words to ensure the burden of producing and assessing submissions manageable. Institutions will, however, be given space in the templates for institutions to provide sufficient contextual information supporting their submissions, this may include charts or diagrams where appropriate.

The new guidance also sets out how assessment will work, with eight subject-level panels and an institution-level panel awarding scores on the basis of vitality, sustainability and rigour, with scores ranging from four stars to unclassified.

jack.grove@timeshighereducation.com