Reporting of Negative Randomized Trials in Three Major Medical Journals

Gabriel A. Brooks, Daniel W. Bowles, Daniel B. Jamieson, Janice V. Huang, Alexandra Smart, Kathleen A. Heist, Traci E. Yamashita, Allan V. Prochazka, Ravi K. Gopal

Department of Medicine, University of Colorado School of Medicine, Aurora, USA.
Department of Medicine, University of Colorado School of Medicine, Aurora, USA; Denver VA Medical Center, Eastern Colorado Healthcare System, Denver, USA.
Department of Medicine, University of Colorado School of Medicine, Aurora, USA；Denver VA Medical Center, Eastern Colorado Healthcare System, Denver, USA.

DOI: 10.4236/ijcm.2013.42021                

Abstract

Context: In recent years there has been increasing interest on publication bias and on initiatives to decrease bias, in- cluding trial registration. Objective: To test whether there has been an increase in reports of randomized control trials (RCT’s) with negative outcomes in major journals and to identify factors associated with these reports. Design: Retrospective review of reports of RCT’s published in the Journal of the American Medical Association, The Lancet and the New England Journal of Medicine before (2002-’03, pre-registration era) and after (2007-’08, registration era) the institution of mandatory trial registration. Main Outcome Measure: The primary outcome was the proportion of RCT reports with negative outcomes compared across the two eras. Secondary outcome includes other factors affecting pub-lication. Results: We identified 917 reports of RCT’s published in the two study eras. No publications in the pre-registration era reported trial registration compared with 94.4% in the registration era (p < 0.001). There was a non-significant increase in negative trials from the pre-registration to the registration era (29.1% vs. 34.1%, p = 0.10, OR 1.26, 95% CI 0.96 - 1.67). Study characteristics associated with negative outcomes include trials of drugs (OR 1.62, 95% CI 1.08 - 2.43), procedures or devices (OR 2.08, 95% CI 1.29 - 3.35), explicit identification of a single primary endpoint (OR 1.70, 95% CI 1.40 - 2.47), and increasing sample size (OR 3.08, 95% CI 1.78 - 5.34). Non-inferiority study design was associated with a decreased likelihood of a negative outcome (OR 0.13, 95% CI 0.05 - 0.31). Conclusions: The proportion of published RCT reports with negative outcomes in three major medical journals has not significantly increased since the mandatory clinical trial registration policy. The observed prevalence of negative trials is associated with increases in sample size and greater specificity in trial endpoints.

Keywords

Clinical Trial Registration; Publication Bias; Randomized Trials; Clinical Trials; Non-Inferiority Trials

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	R. J. Simes, “Publication Bias: The Case for an International Registry of Clinical Trials,” Journal of Clinical Oncology, Vol. 4, No. 10, 1986, pp. 1529 1541.
[2]	K. Dwan., D. G. Altman, J. A. Arnaiz, et al., “Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias,” PLoS One, Vol. 3, No. 8, 2008, e3081. doi:10.1371/journal.pone.0003081
[3]	S. Hopewell, K. Loudon, M. J. Clarke, A. D. Oxman and K. Dickersin, “Publication Bias in Clinical Trials Due to Statistical Significance or Direction of Trial Results,” Cochrane Database of Systematic Reviews, Vol. 1, 2009, MR000006.
[4]	K. Rising, P. Bachetti and L. Bero, “Reporting Bias in Drug Trials Submitted to the Food and Drug Administra tion: Review of Publication and Presentation,” PLoS Medicine, Vol. 5, No. 11, 2008, e217. doi:10.1371/journal.pmed.0050217
[5]	K. Lee, P. Bachetti and I. Sim, “Publication of Clinical Trials Supporting Successful New Drug Applications: A Literature Analysis,” PLoS Medicine, Vol. 5, No. 9, 2008, e191. doi:10.1371/journal.pmed.0050191
[6]	C. D. Deangelis, J. M. Drazen, F. A. Frizelle, C. Haug, J. Hoey, R. Horton, S. Kotzin, C. Laine, A. Marusic, A. J. Overbeke, T. V. Schroeder, H. C. Sox and M. B. Van Der Weyden, “Clinical Trial Registration: A Statement from the International Committee of Medical Journal Editors,” Journal of the American Medical Association, Vol. 292, No. 11, 2004, pp. 1363 1364. doi:10.1001/jama.292.11.1363
[7]	D. A. Zarin, T. Tse and N. C. Ide, “Trial Registration at ClinicalTrials.gov between May and October 2005,” New England Journal of Medicine, Vol. 353, No. 26, 2005, pp. 2779 2787. doi:10.1056/NEJMsa053234
[8]	Clinicaltrials.gov, “A Service of the US National Insti tutes of Health,” 2010. http://www.clinicaltrials.gov
[9]	ISI Web of Knowledge, “Journal Citation Reports,” 2010. http://0 admin apps.isiknowledge.com.impulse.ucdenver.edu/JCR
[10]	S. S. Vedula, L. Bero, R. W. Scherer and K. Dickersin, “Outcome Reporting in Industry Sponsored Trials of Ga bapentin for Off Label Use,” New England Journal of Medicine, Vol. 361, No. 20, 2009, pp. 1963 1971. doi:10.1056/NEJMsa0906126
[11]	S. Mathieu, I. Boutron, D. Moher, D. Altman and P. Ravaud, “Comparison of Registered and Published Pri mary Outcomes in Randomized Controlled Trials,” Jour nal of the American Medical Association, Vol. 302, No. 9, 2009, pp. 977 984. doi:10.1001/jama.2009.1242
[12]	C. D. Deangelis, J. M. Drazen, F. A. Frizelle, C. Haug, J. Hoey, R. Horton, S. Kotzin, C. Laine, A. Marusic, A. J. Overbeke, T. V. Schroeder, H. C. Sox and M. B. Van Der Weyden, “Is This Clinical Trial Fully Registered? A Statement from the International Committee of Medical Journal Editors,” New England Journal of Medicine, Vol. 352, No. 23, 2005, pp. 2436 2438. doi:10.1056/NEJMe058127
[13]	J. S. Ross, G. K. Mulvey, E. M. Hines, S. E. Nissen and H. M. Krumholz, “Trial Publication after Registration in ClinicalTrials.gov: A Cross Sectional Analysis,” PLoS Medicine, Vol. 6, No. 9, 2009, e1000144. doi:10.1371/journal.pmed.1000144
[14]	S. Garatini and V. Bertele, “Non Inferiority Trials Are Unethical Because They Disregard Patients’ Interests,” Lancet, Vol. 370, No. 9602, 2007, pp. 1875 1877. doi:10.1016/S0140 6736(07)61604 3