It’s time to retire the ABS guide to journal quality

This flawed publication is symptomatic of a deeper malaise in business and management studies, says Dennis Tourish

三月 19, 2015

Source: David Humphries

The latest iteration of the so-called International Guide to Academic Journal Quality, published last month by the Association of Business Schools, has provoked deep unease on the part of many academics. It has even been formally criticised in a British Academy of Management press release, suggesting that whatever residual confidence remained in journal rankings is fast being eroded.

But to my mind, the ABS guide is only one symptom of a deeper malaise in business and management scholarship.

The guide purports to identify those journals in which the “best” work is likely to be clustered, thus helping new scholars to decide where to publish. At the same time, its editors acknowledge that top-quality work is often found outside the “top” journals. Although they do not say so, it is likewise widely recognised that such journals often publish work that is uninteresting, mistaken and irrelevant.

The 2014 research excellence framework illustrates the point. Data compiled by members of the business and management studies subpanel are currently circulating, comparing the scores awarded to 1,000 submitted outputs with the ABS rankings of the journals they were published in. They show that a paper in a top-ranked ABS journal had a 39 per cent chance of being graded 4* by the REF panel, roughly similar odds of being graded 3* and a 20 per cent chance of being deemed 2*.

As the British Academy of Management points out, the guide is also hopelessly biased in favour of US journals: of the 33 publications it currently identifies as “world elite”, 31 are American. It strikes me that these journals are no less drawn than their “lesser” cousins to the triviality that pervades much of the scholarship in our field. They are dominated by functionalist and positivist perspectives that take the status quo for granted, ask few critical questions of business practice, and largely ignore the most important issues facing business and society.

For example, four of the ABS’ world elite, Academy of Management Review, Academy of Management Journal, Administrative Science Quarterly and Organization Science, have yet to publish a substantive paper dealing with the 2008 banking meltdown. What use are “world elite” journals that can ignore the biggest economic crisis since the 1930s, one that has impoverished millions, threatened the eurozone and revived the supposedly dormant prospect of sovereign debt default? And what use are journal ranking systems that fail to take such disgraceful neglect into account?

So, if the near collapse of the world economy isn’t important, what is? Well, the December 2014 issue of Administrative Science Quarterly includes a paper whose “core hypothesis”, according to its abstract, “is that the more similar the initially experienced level of organisational munificence is to the level of munificence in a subsequent period, the higher an individual’s job performance”. That is to say: “The relationship between what I call ‘imprint-environment fit’ and performance is contingent on the individual’s career stage when entering the organization and the influence of secondhand imprinting resulting from the social transmission of others’ imprints.”

What I think this means is that successful organisations can afford to treat their employees well, and that when they do so consistently, job performance improves. It also helps that, since new employees meet others who are already happy, their mood proves contagious. Who would have thought it? Truly, an empty tin often makes the loudest noise.

It is not irrelevant that much of the writing in business and management scholarship is appalling, like a concert performed by musicians with tin ears whose instruments are permanently out of tune. It seems that when we have nothing much to say, we attempt to distract attention from that sad fact by making our points as pretentiously and lengthily as possible. Top journals only encourage this approach by prioritising “theory development” above all else.

Obsession with theory also encourages authors to dress up old ideas in new clothes, sidestep controversial issues that challenge current business practice, and focus on the small questions that are more likely to be quickly turned into another publication.

But publication, surely, should mainly be about having interesting ideas, writing well, addressing real-world problems and making a difference. And if the ABS guide stands in the way of that, it should be retired. Failing that, perhaps the rest of us should agree to treat it with the disrespect that it has worked so hard to deserve.

Times Higher Education free 30-day trial

请先注册再继续

为何要注册?

  • 注册是免费的,而且十分便捷
  • 注册成功后,您每月可免费阅读3篇文章
  • 订阅我们的邮件
注册
Please 登录 or 注册 to read this article.

Reader's comments (3)

For anyone interested, here is a link to a further paper on the Guide that I published recently, in conjunction with Hugh Willmott. It develops at least some of these points in more detail: https://pure.royalholloway.ac.uk/portal/en/publications/in-defiance-of-folly-journal-rankings-mindless-measures-and-the-abs-guide(b71da3e5-16c9-4677-a47d-b851ca35379a).html
One can get into a long debate about this but it seems quite odd to complain about a list (a) that is one of many such lists (look at Anne Wil-Harzing's site to see this), (b) is forced to justify its analysis of journal seeding, (c) whose relevance is restricted to the UK, and (d) is, i anything, overly generous as to the quality of those non-North American journals. It also seems very odd and quite unfair to cherry pick a single article from ASQ for being irrelevant when so many other articles would fit this bill including those in the journal Leadership. Indeed, what is the value of an article such as "Reading leadership through Hegel’s master/slave dialectic: Towards a theory of the powerlessness of the powerful" whose abstract does some serious damage to the English grammar as seen below: Abstract: This paper develops a theory of the subjectivity of the leader through the philosophical lens of Hegel’s master/slave dialectic and its recent interpretation by the philosopher Judith Butler. This is used to analyse the working life history of a man who rose from poverty to a leadership position in a large company and eventually to running his own successful business. Hegel’s dialectic is foundational to much Western thought, but in this paper, I rashly update it by inserting a leader in between the master, whose approval the leader needs if s/he is to sustain self-hood, and the follower, who becomes a tool that the leader uses when trying to gain that elusive approval. The analysis follows the structure of Butler’s reading of the Dialectic and develops understanding of the norms that govern how leaders should act and the persons they should be. Hard work has become for leaders an ethical endeavour, but they grieve the sacrifice of leisure. They enjoy a frisson of erotic pleasure at their power over others but feel guilt as a result. They must prove their leadership skills by ensuring their followers are perfect employees but at the same time must prove their followers are poor workers who need their continued leadership. This leads to the conclusion that the leader is someone who is both powerful and powerless. This analysis is intended not to demonize leaders, but to show the harm that follows the emphasis on leadership as a desirable and necessary organizational function.
Of course the same can be said of this 'cherry picking'. It also misses the point. The original comments and analysis remains and confirms what many academics already know. One other interesting bias in the ABS is the wide difference between subjects in terms of numbers of journals and their rankings.
ADVERTISEMENT