Skip to main content

Making smart investment decisions in clinical research

Abstract

A recent trial in rheumatoid arthritis found an inexpensive, but infrequently used, combination of therapies is neither inferior nor less safe than an expensive biologic drug. If the trial had been conducted over 10 years ago, arguably 100’s of millions of dollars since spent on biologics could have been released to other, more effective treatments. Given the ever increasing number of trials proposed, this commentary uses the trial as an example to challenge payers and research funders to make smarter investments in clinical research to save potential future costs.

Trial registration: NCT00405275, registered 29 November 2006

Peer Review reports

Background

A recent randomized controlled trial in rheumatoid arthritis (RA) patients determined that a strategy of first adding two Disease-modifying Antirheumatic Drugs (DMARDs) to methotrexate (a combination known as Triple Therapy) is neither inferior nor less safe than first adding the biologic anti-TNF drug etanercept to methotrexate in patients with active disease despite the methotrexate [1]. The Rheumatoid Arthritis Comparison of Active Therapies (RACAT) trial, for which ethical approval was obtained from the institutional review boards for each of the sites in the United States and Canada, strengthens findings of earlier strategy trials that have found triple therapy to be noninferior to biologic agents, [2, 3] and a metaanalysis suggesting no difference in their ability to prevent disease progression [4, 5].

The implication of the study, for which all 353 participants provided written informed consent, is that inexpensive triple therapy - a combination promoted for over a decade but infrequently used - should be initiated prior to commencing expensive biologic therapy in patients whose disease is not completely controlled by methotrexate alone. Furthermore, when patients fail a regimen containing a biologic, they should switch to Triple Therapy if it has not previously been tried instead of presuming that a different biologic regimen is needed. The results are particularly significant from a healthcare cost and sustainability perspective since spending on biologic therapies (which all appear to have near equal efficacy [6]) for patients with RA ranks among the top expenditure category in the formulary budgets of most Western healthcare systems [7]. If implemented in practice, Triple Therapy would delay the use of biologic treatment by at least 6 months without impairing a patient’s disease progression, thereby saving $100’s of millions each year.

It will, however, be a major challenge to change rheumatologists prescribing patterns given their familiarity with biologics and guidelines advocating biologic use [8]. Arguably, the multimillion-dollar question raised by the RACAT trial is why was it not conducted earlier? Both biologics and Triple Therapy were independently shown to be effective in comparison to methotrexate more than 15 years ago, [9, 10] but only recently have been compared (Table 1).

Clinical trials are expensive to conduct, and more trials are proposed than can be funded. Despite this, it seems that priority is rarely given to trials where the ultimate objective is to reduce future costs. While “present and future resource implications” [11] are often considerations in funding research, it is rarely recognized that there exists an opportunity cost associated with each funding decision and that reducing costs has a potential to significantly improve health, by releasing money to be spent on alternative healthcare services that provide greater health benefits. It seems the potential opportunity for a blockbuster that industry recognizes can make enormous profits is not reciprocated by payers and research funders with the opportunity to save an enormous amount of money.

With the benefit of hindsight, the $13 million spent on the RACAT trial would have been recouped many times over if conducted in the early 2000s. By looking back, we consider the evidence and the uncertainties relating to this trial in the early 2000s and reflect if we had the foresight then to fund this trial. Most importantly, we consider the lessons to determine which smart investments should be made in research today to save potential future costs.

Main text

Identification

Timing is crucial in investing. By the time an investment is obvious, much of the potential benefit is lost. In the case of trials, they can only be funded if they have been conceived with a plausible hypothesis and clear justification. However, the plausibility of Triple Therapy being equivalent to biologics was established by the early 2000s. A trial published in 1996 demonstrated that Triple Therapy was superior in comparison to MTX alone [7], and this was corroborated in 2002 [12]. While numerous RCTs have been conducted on biologics in RA over the past 15 years [6], regulatory approval has meant nearly all have compared a biologic to placebo or MTX in combination with placebo, with the vast majority in patients showing an inadequate response only to MTX, not Triple Therapy. Table 1 describes how more than 50 trials compared a biologic to MTX before a comparison with Triple Therapy was made.

Estimated future market size

If biologics had not gone on to become expensive blockbuster drugs, the question of why the RACAT trial was not conducted earlier would be moot. Nevertheless, this could have been predicted; the prevalence of RA is approximately 1 % of the population, of whom it could be predicted at least 10 % would be severe enough to be marketable for biologic therapy. The price of biologics was established with the first drugs of their kind - etanercept and infliximab - and experience tells us that these prices remain stable or indeed increase even when new drugs enter the market. While the actual diffusion of biologics into the market can be difficult to predict, if the pharmaceutical industry could anticipate the potential market for biologics in the early 2000s (numerous pre-clinical trials of other biologics were in existence by 2002 [13]), then there is no reason research funders could not also make these predictions.

Consideration of risk and reward

It is impossible to fund all trials with all plausible comparators, so the risk a trial will not meet its primary endpoint has to be considered when deciding which research to fund. Even in trials that meet their primary endpoint, limitations exist in all studies, and these limitations can impact whether the results influence clinical practice. It is not clear how funders evaluate these risks, or value what is an acceptable risk. However, simple decision analysis can help discern the expected value of information a trial would provide which can be compared against the potential impact of the trial [14]. In the case of RACAT, the trial would have effectively paid for itself in the first year in Canada alone, so it would have been prudent to fund even if the risk of failure was very high.

Many payers have restricted access to biologics for RA patients that have trialed specified conventional DMARDs. For example, in Canada, reimbursement for biologics by a government payer is only available through a special authority where rheumatologists usually must demonstrate that a number of DMARD combinations have been previously tried. Including Triple Therapy in this list would have been simple and would have increased utilization substantially on the basis of the evidence from a trial like RACAT to provide evidence.

Conclusions

Whether the RACAT trial will lead to reductions in the use of biologics in patients with RA, and therefore paying for the investment remains to be seen. It is clear that over 10 years ago, the RACAT trial would have been a smart investment – we demonstrate that the anticipated rewards would have indicated the risk was worth taking many times over (Table 2). The result of the trial would have had an influence on jurisdictions beyond the funding agency; however, the case for multinational studies such as RACAT, where the costs are shared and the external validity is strengthened, are even more compelling. With many new expensive treatments are emerging for diseases such as asthma, hepatitis and cancer, among others, a change in thinking about research investments has the potential to save billions of dollars in the next 10 years.

Table 1 Clinical trials comparing biologics, Triple Therapy and methotrexate
Table 2 Proposed approach for making smarter investments

An important issue to consider is who should pay for these clinical trials? Regulatory bodies typically require efficacy studies instead of the comparative effectiveness studies like RACAT, and there is little incentive for pharmaceutical manufacturers to bear the cost. There is a strong argument for regulatory studies to require comparative effectiveness studies, but they tend to be funded through national health research budgets [15]. However, it would have been the payers that would have ultimately saved their budget through this trial. We believe payers need to have a stronger voice in terms of both what regulators require in terms of comparators from phase III studies, and in terms of the way research funders invest in evidence. If the healthcare system is serious about providing quality, cost-effective care, tremendous opportunities remain through smart investments in clinical research.

Abbreviations

Anti-TNF:

anti-tumor necrosis factor

DMARDs:

disease-modifying antirheumatic drugs

MTX:

methotrexate

RA:

rheumatoid arthritis

RACAT:

rheumatoid arthritis comparison of active therapies

References

  1. O'Dell JR, Mikuls TR, Taylor TH, Ahluwalia V, Brophy M, Warren SR, et al. Therapies for Active Rheumatoid Arthritis after Methotrexate Failure. N Engl J Med. 2013;369:307–18.

    Article  PubMed  Google Scholar 

  2. van Vollenhoven RF, Geborek P, Forslind K, Albertsson K, Ernestam S, Petersson IF, et al. Conventional combination treatment versus biological treatment in methotrexate-refractory early rheumatoid arthritis: 2 year follow-up of the randomised, non-blinded, parallel-group Swefot trial. The Lancet. 2012;379(9827):1712–20.

    Article  Google Scholar 

  3. Moreland LW, O'Dell JR, Paulus HE, Curtis JR, Bathon JM, St Clair EW, et al. A randomized comparative effectiveness study of oral triple therapy versus etanercept plus methotrexate in early aggressive rheumatoid arthritis: the Treatment of Early Aggressive Rheumatoid Arthritis Trial. Arthritis Rheum. 2012;64:2824–35.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Graudal N, Hubeck-Graudal T, Tarp S, Christensen R, Jürgens G. Effect of combination therapy on joint destruction in rheumatoid arthritis: a network meta-analysis of randomized controlled trials. PLoS One. 2014;9:e106408.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Graudal N, Jürgens G. Similar effects of disease-modifying antirheumatic drugs, glucocorticoids, and biologic agents on radiographic progression in rheumatoid arthritis: meta-analysis of 70 randomized placebo-controlled or drug-controlled studies, including 112 comparisons. Arthritis Rheum. 2010;62:2852–63.

    Article  CAS  PubMed  Google Scholar 

  6. Singh JA, Christensen R, Wells GA, Suarez-Almazor ME, Buchbinder R, Lopez-Olivo MA, Tugwell P. Biologics for rheumatoid arthritis: an overview of Cochrane reviews. Cochrane Database Syst Rev. 2009;4:CD007848.

    PubMed  Google Scholar 

  7. Drugs information online. U. S. Pharmaceutical Sales—2013. Top 100 Drugs for 2013 by Sales. 2013. [Available at http://www.drugs.com/stats/top100/2013/sales] Access date 1 December 2015.

  8. Singh JA, Furst DE, Bharat A, Curtis JR, Kavanaugh AF, Kremer JM, et al. 2012 Update of the 2008 American College of Rheumatology recommendations for the use of disease‐modifying antirheumatic drugs and biologic agents in the treatment of rheumatoid arthritis. Arthritis Care Res. 2012;64:625–39.

    Article  CAS  Google Scholar 

  9. O'Dell JR, Haire CE, Erikson N, Drymalski W, Palmer W, Eckhoff PJ, et al. Treatment of rheumatoid arthritis with methotrexate alone, sulfasalazine and hydroxychloroquine, or a combination of all three medications. N Engl J Med. 1996;334:1287–91.

    Article  PubMed  Google Scholar 

  10. Weinblatt ME, Kremer JM, Bankhurst AD, Bulpitt KJ, Fleischmann RM, Fox RI, et al. A trial of etanercept, a recombinant tumor necrosis factor receptor: Fc fusion protein, in patients with rheumatoid arthritis receiving methotrexate. N Engl J Med. 1999;340:253–9.

    Article  CAS  PubMed  Google Scholar 

  11. Canadian Institute for Health Research: RCT Evaluation Criteria and Headings. [Available at http://www.cihr-irsc.gc.ca/e/39187.html] Access date 1 December 2015

  12. O'Dell JR, Leff R, Paulsen G, Haire C, Mallek J, Eckhoff PJ, et al. Treatment of rheumatoid arthritis with methotrexate and hydroxychloroquine, methotrexate and sulfasalazine, or a combination of the three medications: results of a two‐year, randomized, double‐blind, placebo‐controlled trial. Arthritis Rheuma. 2002;46:1164–70.

    Article  Google Scholar 

  13. Moreland LW. Potential biologic agents for treating rheumatoid arthritis. Rheum Dis Clin N Am. 2001;27:445–91.

    Article  CAS  Google Scholar 

  14. Myers E, McBroom AJ, Shen L, Posey RE, Gray MR, Sanders GD. Value-of-information analysis for patient-centered outcomes research prioritization. Washington (DC): Patient-Centered Outcomes Research Institute (PCORI); 2012 [Available at http://www.pcori.org/assets/Value-of-Information-Analysis-for-Patient-Centered-Outcomes-Research-Prioritization2.pdf] Access date 1 December 2015

    Google Scholar 

  15. Sox HC, Greenfield S. Comparative effectiveness research: a report from the Institute of Medicine. Ann Intern Med. 2009;151:203–20.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The RACAT study was supported by the Cooperative Studies Program, Department of Veterans Affairs Office of Research and Development, and the Canadian Institutes for Health Research and by an interagency agreement with the National Institutes of Health–American Recovery and Reinvestment Act. The views expressed do not necessarily represent the views of the Department of Veterans Affairs or the U.S. government.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nick Bansback.

Additional information

Competing interests

Dr. Anis reports receiving consulting fees from Pfizer, AbbVie and Schering Plough and lecture fees and payment for the development of educational presentations from Pfizer. Dr. Keystone reports receiving consulting fees and reimbursement for travel expenses from Amgen, Pfizer, UCB, Hoffmann–La Roche, AbbVie, Bristol-Myers Squibb, and Merck and grant support from Abbott, Amgen, AstraZeneca, Bristol-Myers Squibb, Hoffmann–La Roche, Janssen, Lilly, Novartis, Pfizer, and UCB.

Authors’ contributions

All authors were part of the RACAT trial. NB conceived this commentary. NB, EK, JO’D, CSP, KH, MB, and AA all contributed to the writing of the manuscript. All authors read and approved the final manuscript.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bansback, N., Keystone, E., O’Dell, J. et al. Making smart investment decisions in clinical research. Trials 16, 590 (2015). https://doi.org/10.1186/s13063-015-1123-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-015-1123-1

Keywords