Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Observational Study
. 2022 Jan 20;22(1):23.
doi: 10.1186/s12874-021-01501-9.

Poor reporting quality of observational clinical studies comparing treatments of COVID-19 - a retrospective cross-sectional study

Sebastian Ziemann  1 , Irina Paetzolt  2 , Linda Grüßer  2 , Mark Coburn  3 , Rolf Rossaint  2 , Ana Kowark  2
Affiliations
Observational Study

Poor reporting quality of observational clinical studies comparing treatments of COVID-19 - a retrospective cross-sectional study

Sebastian Ziemann et al. BMC Med Res Methodol. .

Abstract

Background: During the COVID-19 pandemic, the scientific world is in urgent need for new evidence on the treatment of COVID patients. The reporting quality is crucial for transparent scientific publication. Concerns of data integrity, methodology and transparency were raised. Here, we assessed the adherence of observational studies comparing treatments of COVID 19 to the STROBE checklist in 2020.

Methods: Design: We performed a retrospective, cross-sectional study.

Setting: We conducted a systematic literature search in the Medline database. This study was performed at the RWTH Aachen University Hospital, Department of Anaesthesiology Participants: We extracted all observational studies on the treatment of COVID-19 patients from the year 2020.

Main outcome measures: The adherence of each publication to the STROBE checklist items was analysed. The journals' impact factor (IF), the country of origin, the kind of investigated treatment and the month of publication were assessed.

Results: We analysed 147 observational studies and found a mean adherence of 45.6% to the STROBE checklist items. The percentage adherence per publication correlated significantly with the journals' IF (point estimate for the difference between 1st and 4th quartile 11.07%, 95% CI 5.12 to 17.02, p < 0.001). U.S. American authors gained significantly higher adherence to the checklist than Chinese authors, mean difference 9.10% (SD 2.85%, p = 0.023).

Conclusions: We conclude a poor reporting quality of observational studies on the treatment of COVID-19 throughout the year 2020. A considerable improvement is mandatory.

Keywords: COVID-19; Observational studies; Reporting quality; STROBE statement.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Flowchart. Process of screening and inclusion of observational studies for the current study
Fig. 2
Fig. 2
Frequency of percentage adherence. Frequency of the percentage adherence to the STROBE checklist items within the sample of 147 publications analysed
Fig. 3
Fig. 3
Percentage adherence by country. Mean percentage adherence to the STROBE checklist stratified by country of origin for the top-6 countries. USA: mean 50.2%, n = 42; China: mean = 41.1%, n = 40; Italy: mean = 45.5%, n = 21; Spain: mean = 51.5%, n = 14; France: mean = 46.8%, n = 6; UK: mean = 49.5%, n = 5
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Moher D. CONSORT: an evolving tool to help improve the quality of reports of randomized controlled trials Consolidated Standards of Reporting Trials. JAMA. 1998;279(18):1489–1491. doi: 10.1001/jama.279.18.1489. - DOI - PubMed
    1. Bauchner H, Fontanarosa PB, Golub RM. Editorial evaluation and peer review during a pandemic: how journals maintain standards. JAMA. 2020;324(5):453–454. doi: 10.1001/jama.2020.11764. - DOI - PubMed
    1. Peyrin-Biroulet L. Will the quality of research remain the same during the COVID-19 pandemic? Clin Gastroenterol Hepatol. 2020;18(9):2142. doi: 10.1016/j.cgh.2020.03.054. - DOI - PMC - PubMed
    1. Bramstedt KA. The carnage of substandard research during the COVID-19 pandemic: a call for quality. J Med Ethics. 2020;46(12):803–807. doi: 10.1136/medethics-2020-106494. - DOI - PubMed
    1. von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP, Initiative S. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Epidemiology. 2007;18(6):800–804. doi: 10.1097/EDE.0b013e3181577654. - DOI - PubMed

Publication types