World Reputation Rankings 2014 methodology

Census sensibility reveals the global academy’s greatest names

Which universities do scholars think are the best on the planet? This is no idle question, as our annual Academic Reputation Survey demonstrates

The Times Higher Education World Reputation Rankings are created using the world’s largest invitation-only academic opinion survey – a unique piece of research.

The Academic Reputation Survey, available in 10 languages, uses United Nations data to ensure that it is properly distributed to reflect the demographics of world scholarship. It is also evenly spread across academic disciplines.

Those invited to take part are statistically representative of both their country and their discipline.

The questionnaire, administered by polling company Ipsos MediaCT for THE’s rankings data supplier Thomson Reuters, targets only experienced, published scholars, who offer their views on excellence in research and teaching within their disciplines and at institutions with which they are familiar.

The 2014 rankings are based on a survey carried out between March and May 2013, which received 10,536 responses from 133 countries.

When polled, the respondents on average had been working in the academy for 18 years.

With 13,388 answers to the first Academic Reputation Survey in 2010, 17,554 in 2011 and 16,639 in 2012, more than 58,000 detailed expert responses from more than 150 countries have now been collected in just four annual rounds.

There is a balanced spread of responses across disciplines. In 2014, the most have come from the social sciences and from engineering and technology (22 per cent each), followed by the physical sciences (18 per cent), clinical subjects (16 per cent), the life sciences (13 per cent), then the arts and humanities (9 per cent).

The spread across the regions is also well balanced: 25 per cent of responses hail from North America, 19 per cent from Western Europe, 13 per cent from East Asia, 10 per cent from Oceania, 10 per cent from Eastern Europe, 5 per cent from the Middle East and 4 per cent from South America.

In the survey, scholars are questioned at the level of their specific subject discipline. They are not asked to create a ranking or to list a large range of institutions, but to name no more than 15 of those they believe to be the best, based on their own experience.

The survey data were used alongside 11 objective indicators to help create the World University Rankings 2013-2014, which were unveiled in October last year. The reputation data are published alone each year to create the World Reputation Rankings.

Calculating the scores

The reputation table ranks institutions according to an overall measure of their esteem that combines data on their reputation for research and for teaching.

The two scores are combined at a ratio of 2:1, giving more weight to research because feedback from our expert advisers suggests that there is greater confidence in respondents’ ability to make accurate judgements about research quality.

The scores are based on the number of times an institution is cited by respondents as being the best in their field. The number one institution, Harvard University, was selected most often. The scores for all other institutions in the table are expressed as a percentage of Harvard’s, set at 100. For example, the University of Oxford received 67.8 per cent of the number of nominations that Harvard received, giving it a score of 67.8 against Harvard’s 100. This scoring system, which is different from the one used in the World University Rankings, is intended to provide a clearer and more meaningful perspective on the reputation data in isolation.

The top 100 universities by reputation are listed, but Times Higher Education has agreed with data supplier Thomson Reuters to rank only the top 50 because the differentials between institutions after that point become very narrow. The institutions that make up the second half of the table are listed in groups of 10, in alphabetical order. Scores are given to one decimal place, but were calculated to greater precision.

Survey invite: RSVP

The Academic Reputation Survey that will inform the 2014-15 World University Rankings and the 2015 World Reputation Rankings will be distributed soon. If selected to take part, you will represent your country and discipline in an important piece of research. Please put aside 20 minutes to fill in the form.