CC-0

Has quality suffered in the rush to publish COVID-19 research?

Embargoed until: Publicly released:
Peer-reviewed: This work was reviewed and scrutinised by relevant independent experts.

Observational study: A study in which the subject is observed to see if there is a relationship between two or more things (eg: the consumption of diet drinks and obesity). Observational studies cannot prove that one thing causes another, only that they are linked.

An Australian analysis of research papers on COVID-19 published in five of the world's leading medical journals has found many differed from papers published in the same journals that were not about COVID-19. The researchers say three times as many COVID-19 studies required corrections to be made post-publication, compared with non-COVID-19 studies. And far fewer COVID-19 papers covered the 'gold standard' randomised controlled clinical trials, with more focused on smaller case studies, and more opinion pieces and editorials. They also found less than half the COVID-19 papers stated that consent had been obtained from trial subjects, while some COVID-19 studies failed to mention ethical oversight, and some stated that the requirement for ethical approvals had been waived because of the pandemic. Rapid publication of information should not come at the expense of quality, ethical standards or oversight, the authors warn.

Journal/conference: MJA

Link to research (DOI): 10.5694/mja2.50855

Organisation/s: The University of Queensland, Queensland University of Technology (QUT)

Funder: No information provided.

Media release

From: Wiley-Blackwell

MEDICAL JOURNALS RISK QUALITY WITH COVID-19 RAPID RESPONSE

RAPID dissemination of information should not come at the expense of quality, ethical standards or oversight, according to the authors of a Perspective published online today by the Medical Journal of Australia.

“Medical publishing uses peer review to provide independent and critical assessment to verify data integrity, validity of interpretations, and confidence in conclusions,” wrote the authors, led by Professor Michael Reade, Defence Professor of Military Medicine and Surgery at the University of Queensland.

“This process can take many weeks; however, in a rapidly spreading pandemic, speed is a competing priority.”

Reade and colleagues hypothesised that “these considerations may have altered the nature of medical publication”.

They characterised various aspects of COVID-19-related articles published in the five leading general medical journals with the highest impact factors -- New England Journal of Medicine, The Lancet, JAMA, The BMJ and Annals of Internal Medicine -- between 1 January and 31 May (inclusive) in 2019 and 2020.

“In the first 5 months of the COVID-19 pandemic, the five leading medical journals published a substantial number of articles that differed in many respects from their usual material,” the authors found.

“The journals examined were the clinically focused general medical journals with the top five Web of Science 2019 impact factors, ranging from 21.3 to 74.6, representing the medical literature with the greatest international influence on health policy and clinical practice.

“As reasonably expected, there was a seven-fold reduction in the proportion of articles reporting randomised controlled trials, and a compensatory increase in small case series, opinions and editorials.

“In circumstances which usually require consent, just under half of the COVID-19 studies did not explicitly state consent was obtained, despite clear recommendations by the International Committee of Medical Journal Editors. The proportion of articles that referenced appropriate ethics committee or institutional review oversight was statistically unchanged; however, it is still a concern that 11 (16.7%) observational COVID-19 studies lacked any statement to this effect. In addition, several other articles stated that they had been exempted from the requirement for ethical review due to the nature of the pandemic.

“There was a near three-fold increase in the proportion of studies that published corrections, perhaps reflecting the observed reduction in time from submission to publication observed in the one journal for which these data were available.

“It is likely this figure is an underestimation, given that corrections and retractions would be expected to continue over time. Three COVID-19 studies were retracted. The publication of one of these articles had important implications, resulting in the temporary cessation of the World Health Organization’s trial of hydroxychloroquine.”

Reade and colleagues concluded that there was a significant change in the characteristics of articles published by leading medical journals, with some evidence of a tendency towards publishing articles prematurely and those with lower internal validity.

“While these unique circumstances no doubt warranted such a change, rapid dissemination of information should not need to come at the expense of quality, ethical standards or oversight.

“Others have suggested several solutions to this challenge, including a two-track review process for pandemic and non-pandemic research, rapid preliminary assessment of research methodology by skilled in-house reviewers before deciding whether to send for peer review, sharing of peer-reviews between reviewers and journals, and mentored peer reviewing by research trainees.

“As part of pandemic preparedness, planning to facilitate augmentation of resources available to medical publishers, allowing maintenance of standards of review, should occur,” they concluded.

Attachments:

News for:

Australia
QLD
ACT

Media contact details for this story are only visible to registered journalists.