Skip to main content
Download PDF

Assessment of the consistency and robustness of results from a multicenter trial of remission maintenance therapy for acute myeloid leukemia

Trials volume 12, Article number: 86 (2011) Cite this article

Abstract

Background

Data from a randomized multinational phase 3 trial of 320 adults with acute myeloid leukemia (AML) demonstrated that maintenance therapy with 3-week cycles of histamine dihydrochloride plus low-dose interleukin-2 (HDC/IL-2) for up to 18 months significantly improved leukemia-free survival (LFS) but lacked power to detect an overall survival (OS) difference.

Purpose

To assess the consistency of treatment benefit across patient subsets and the robustness of data with respect to trial centers and endpoints.

Methods

Forest plots were constructed with hazard ratios (HRs) of HDC/IL-2 treatment effects versus no treatment (control) for prospectively defined patient subsets. Inconsistency coefficients (I2) and interaction tests (X2) were used to detect any differences in benefit among subsets. Robustness of results to the elimination of individual study centers was performed using "leave-one-center-out" analyses. Associations between treatment effects on the endpoints were evaluated using weighted linear regression between HRs for LFS and OS estimated within countries.

Results

The benefit of HDC/IL-2 over controls was statistically consistent across all subsets defined by baseline prognostic variables. I2 and P-values of X2 ranged from 0.00 to 0.51 and 0.14 to 0.91, respectively. Treatment effects were statistically significant in 14 of 28 subsets analyzed. The "leave-one-center-out" analysis confirmed that no single center dominated (P-values ranged from 0.004 to 0.020 [mean 0.009]). The HRs representing the HDC/IL-2 effects on LFS and OS were strongly correlated at the country level (R2 = 0.84).

Limitations

Small sample sizes in some of the subsets analyzed.

Conclusions

These analyses confirm the consistency and robustness of the HDC/IL-2 effect as compared with no treatment. LFS may be an acceptable surrogate for OS in future AML trials. Analyses of consistency and robustness may aid interpretation of data from multicenter trials, especially in populations with rare diseases, when the size of randomized clinical trials is limited.

Trial Registration

ClinicalTrials.gov: NCT00003991

Peer Review reports

Introduction

The results of a clinical trial should not be assessed solely in terms of statistical significance. In their Statistical Principles for Clinical Trials (ICH E9), the International Conference on Harmonization recommends evaluating "the robustness of the results and primary conclusions of the trial. Robustness is a concept that refers to the sensitivity of the overall conclusions to various limitations of the data, assumptions, and analytic approaches to data analysis" [1]. Hence a trial that reached the standard criterion of significance (P < 0.05) could still be questioned if its results lacked robustness. In contrast, when studying diseases of low incidence, achieving P < 0.05 may require sample sizes that are too large to be achievable in a reasonable timeframe. Estey argues that if a disease is relatively uncommon and active therapies are lacking, protection against false positive results with >95% confidence may be too stringent [2]. This point is clearly illustrated by acute myeloid leukemia (AML), a disease with incidence ranging from 2 to 4 per 100,000 persons in Europe and the United States [3]. Trials that aim to demonstrate statistically significant benefits on overall survival (OS) in AML are especially challenging since they require large numbers of patients and long durations of follow-up. With typical costs and time to conduct oncology trials in excess of $500 million and 10 years, respectively [4], new approaches to study design and interpretation that help reduce these burdens are obviously necessary. Intensive efforts are therefore underway to evaluate other approaches to bring promising new drugs that fulfill urgent medical needs to patients more efficiently [4–9].

First and foremost, when evaluating new cancer treatments, a number of efficacy endpoints are usually considered. In both early and advanced disease, commonly used endpoints are OS and disease or progression-free survival (DFS or PFS) [6–8]. In the case of acute leukemia, if a trial reaches statistical significance on DFS (more commonly called leukemia-free survival, LFS) but not on OS, is it because the treatment actually has an effect on one endpoint but not on the other, or merely because the effect seen on LFS is attenuated in the analysis of OS? In fact, attenuation of the treatment effect on OS is expected because of three independent factors: (a) the time lag between leukemia recurrence and death, which results in a lower hazard ratio for OS than for LFS for the same absolute number of events; (b) variations in post-relapse therapies that may have effects on OS completely unrelated to the treatment being evaluated [10], and (c) competing risks of death that may be substantial in a disease such a AML, for which the median age at diagnosis is approaching 70 years [11, 12]. Hence in AML, both LFS and OS are important, the former because it is statistically sensitive to real treatment effects, and the latter because it is the ultimate endpoint that cancer treatment should affect. Therefore, an investigation of the relationship between LFS and OS can be informative, in addition to analyses of each endpoint considered separately.

Second, if an overall treatment effect of a novel therapy is detected, it is of interest to understand whether the benefit applies to all patients, or if the benefit is confined to particular patient subsets. This is especially relevant in a heterogeneous disease such as AML, which is comprised of small groups of patients with distinctly different prognoses determined by age, karyotype, cytogenetics, and level of minimal residual disease, among others [2, 5]. Such prognostic information is already being used to direct therapeutic decision-making, and this trend will undoubtedly increase as more cytogenetic information about AML becomes available [2]. In this respect, a study of the consistency of the treatment effects across subsets of patients based on prognostic variables can provide useful information to clinicians.

Third, if an overall treatment effect is detected in a multicenter trial, what assurance can be made that the effect is not heavily influenced by a single center or very few centers? In a multinational trial, are the efficacy outcomes and the treatment effects on these outcomes broadly comparable between countries? A study of the robustness of the treatment effects with respect to centers, and of the consistency of these effects with respect to countries, can provide assurance that the trial results are broadly representative and, as such, more likely to be generalizable.

This paper addresses these issues in the context of a randomized multinational phase 3 trial of histamine dihydrochloride, used in conjunction with low-dose interleukin-2 (HDC/IL-2) as remission maintenance therapy in AML patients [13]. This trial achieved statistical significance on LFS (the pre-specified primary endpoint) and showed that treatment with HDC/IL-2 prolonged LFS compared to controls (standard-of-care; no treatment). Although the sample size was substantial for a trial in AML (320 patients, 236 AML relapses, 196 deaths), the trial was insufficiently powered to detect an effect on OS and did not reach statistical significance on the OS endpoint. In this paper, we show that analyses of consistency and robustness can help interpret these results.

Methods

Phase 3 clinical trial of HDC/IL-2 as maintenance therapy for AML patients in complete remission

This was a randomized open-label trial of 320 AML patients in complete remission (CR), post-induction and consolidation treatment. The trial was conducted according to ethical principles stated in the Declaration of Helsinki (October, 1996). The protocol, amendments, and sample informed consent forms were reviewed and approved at each of 92 distinct clinical centers by a duly constituted Institutional Review Board or Independent Ethics Committee [13]. Each patient was required to read, understand, sign and date a copy of the informed consent form in the presence of the investigator (or designee) before any protocol-specified procedures were undertaken.

A large proportion of patients were in first complete remission (CR1; n = 261). Patients who received an allogeneic transplant during first remission were ineligible. Immunotherapy with HDC (Ceplene®, EpiCept Corporation, Tarrytown, NY) was given subcutaneously (sc) at a dose of 0.5 mg BID in conjunction with IL-2 (Proleukin®, Chiron, Emeryville, CA [now Novartis]) 16,400 IU/kg sc BID. Following initial supervision and training to perform sc injections, treatments were self-administered by patients for up to 10 × 3-week cycles over a maximum period of 18 months. Control patients received no treatment during this period.

The primary objective of this trial was to determine if HDC/IL-2 could prolong LFS compared with no treatment. LFS was defined as the number of days from the date of randomization to the date of relapse of AML or death from any cause, whichever came first. Relapse was determined by examination of the bone marrow using an identical schedule of clinical and laboratory assessments in both treatment arms. The effect of HDC/IL-2 on OS was a secondary endpoint. Hazard ratios (HRs) for LFS and OS were estimated with a Cox regression model with treatment as the covariate of interest (coded 1 = treatment, 0 = control, so that HR>1 indicates treatment benefit), and stratification for country and complete remission (CR1 vs CR>1).

In this trial, HDC/IL-2-treated and untreated groups were well balanced across all demographic and disease prognostic variables [13]. A significant benefit of HDC/IL-2 was demonstrated for the primary LFS endpoint (HR = 1.43, P = 0.008), but not for OS (HR = 1.23, P = 0.16). Treatment with HDC/IL-2 was well-tolerated, with no treatment-related mortality, significant morbidity, or detrimental impact on quality-of-life [14]. Details about the trial and its major results have been previously reported [13, 14]. Treatment with HDC/IL-2 was approved in Europe in October 2008 for AML patients in CR1. The analyses presented herein are by intention-to-treat (ITT) on all randomized patients. A level of 0.05 was used throughout as the nominal threshold of statistical significance, keeping in mind that P-values of individual tests must be interpreted with due allowance for multiplicity.

Consistency of treatment effects

Forest plots of LFS HRs were constructed for all prognostic subsets thought to be relevant at the time the study was conducted. Forest plots were also constructed for the countries in which patients were treated; the United Kingdom, Finland, and Estonia had included only 7 patients in total and were not shown on the plots.

Tests of heterogeneity (X2) and inconsistency coefficients (I2) were used to assess the observed differences in LFS HRs among the various subsets [15, 16]. The test statistic for heterogeneity between S subsets, X2, is defined as X2 = Σ (τi - τ)2/si 2, where τi is the treatment effect in the ith subset, si is the standard error of τi, and τ is the overall treatment effect. X2 has a χ2 distribution with (S - 1) degrees of freedom [15]. The inconsistency index between S subsets, I2, is calculated as I2 = (X2 - S + 1)/X2 if X2 > S - 1, and I2 = 0 otherwise [16]. I2 values indicate little inconsistency if they are under 0.33, moderate inconsistency if they range from 0.33 to 0.67, and substantial inconsistency if they are above 0.67 [16].

When a subset showed a negative treatment effect (i.e. patients in the control group fared better than patients in the treatment group), we calculated the probability that such a reversal of effect could be observed just by the play of chance [17]. To calculate an approximate probability, we observe that if the N patients of the trial are subdivided in S subsets of equal size, the standard error of the subset-specific test statistic is equal to √ S times the standard error of the overall test statistic. The probability of a reversal of effect is given by the area under the normal distribution of the subset-specific test statistic to the left of zero. Note that for a time to event endpoint such as LFS or OS, the "size" of a subset is its number of events. Reference [17] provides further details in the general case.

Robustness of treatment effects

The trial was conducted in 92 distinct clinical centers with the number of patients treated within these centers ranging from 1 to 17. The majority of centers had too few patients to yield informative estimates of treatment effects. Therefore, a "leave-one-center-out" cross-validation was performed to assess the robustness of HDC/IL-2 effects with respect to site. P-values for treatment effect were re-calculated after sequential elimination of individual study centers and summarized as a frequency distribution. In addition, P-values for treatment effect were re-calculated after successive elimination of the largest and the smallest centers from the analysis in order to estimate the number of such eliminations required in order to lose statistical significance.

Association between treatment effects on different endpoints

In order to investigate the consistency of outcomes and of treatment effects, we used the approach developed for the validation of surrogate endpoints [18, 19]. This approach consists of quantifying the associations between the two endpoints (LFS, the potential surrogate, and OS) and between the treatment effects on the two endpoints [9]. These analyses are described in detail in a separate manuscript. Here, we focused on the association between treatment effects and fitted a weighted linear regression between the HRs for LFS and OS estimated within countries. Coefficients of determination (R2) were calculated to quantify the proportion of variance explained by the regressions.

Results

Consistency of treatment effects across patient characteristics and countries

Compared with no treatment, HDC/IL-2 had a statistically significant benefit on LFS (HR = 1.43, 95% CI = 1.10, 1.87, log-rank test stratified for country and CR status P = 0.008) [13]. Figure 1 shows forest plots of LFS HRs in all randomized patients and in subsets based on baseline patient characteristics: age (> or ≤60 years), CR status (first [CR1] or subsequent remission [CR >1]), gender, months from CR to randomization (> or ≤6 months), performance status, white blood cell counts at diagnosis, Southwest Oncology Group (SWOG) karyotype, AML subtype, intensity of prior induction and consolidation therapy (autologous stem cell transplant or high dose cytarabine), and presence of extramedullary leukemia. Adjusted for country and CR status, HRs reflecting treatment benefit exceeded 1.00 in 27 subsets out of 28 examined, with statistical significance detected in 14 of 28 subsets analyzed, indicating consistency across subsets.

Figure 1
figure 1

Forest plots of leukemia-free survival (LFS) hazard ratios (HR) and their confidence intervals (CI) by baseline characteristics. O/N = event rate per arm where O is the number of observed events (relapse or death) and N is the sample size. HR = hazard ratio, CI = confidence interval, CR = complete remission, CR1 = first complete remission, WBC = white blood cell, SWOG = Southwest Oncology Group, AML = acute myeloid leukemia, HiDAC = high-dose cytosine arabinoside.

Full size image

Testing for interactions to determine whether the benefit of HDC/IL-2 differed among these subsets, X2 values were all non-significant and ranged from X2 1d.f. = 0.01 to X2 1d.f. = 2.06. The X2 for country was also non-significant, whether the 7 countries with 313 patients were considered (X2 6d.f. = 9.63, P = 0.14) or whether all 10 countries were included (X2 9d.f. = 9.86, P = 0.36). Most I2 values were either equal to 0 or lower than 0.33, except for gender (I2 = 0.51) and country (7 countries, I2 = 0.38). The moderate inconsistency noted for gender and country could not be explained either through confounding factors, or through some other prior information.

Country-specific HRs stratified by CR-status were larger than 1.00 in 5 out of 7 countries included in these analyses (Figure 2), with statistical significance reached in three of them, indicating that the results were not driven by a single influential country. The treatment effect was negative in one country, but with 7 countries of equal size such a reversal of effect would be expected to occur just by chance with probability 0.16, which is close to one in seven.

Figure 2
figure 2

Forest plots of leukemia-free survival (LFS) hazard ratios (HR) and their confidence intervals (CI) by country. O/N = event rate per arm where O is the number of observed events (relapse or death) and N is the sample size.

Full size image

Robustness of treatment effects

The "leave-one-center-out" cross-validation performed with the 92 distinct centers yielded P-values ranging from 0.004 to 0.020 (mean 0.009) for the LFS analysis, instead of P = 0.008 (for the observed LFS hazard ratio of 1.43). Hence, the P-value for treatment effect remained significant after elimination of any study center (Figure 3), thereby providing confidence that no study center was so influential as to drive the statistical significance of the findings.

Figure 3
figure 3

Distribution of P -values for the treatment effect on leukemia-free survival in a "leave-one-center-out" cross-validation. N = sample size.

Full size image

When P-values for treatment effect were re-calculated after successive elimination of several centers from the analysis, statistical significance was retained until elimination of the 8 largest centers (HR = 1.32, P = 0.084, 83 patients eliminated), and the 29 smallest centers (HR = 1.32, P = 0.052, 35 patients eliminated).

Association between treatment effects on different endpoints

Country-specific HRs reflecting the treatment effects on LFS and OS were highly correlated (Figure 4). The weighted linear regression equation was HROS = 0.10 + 0.86 × HRLFS with a coefficient of determination R2 = 0.84, indicating that 84% of the variance was explained by the linear regression (P = 0.004). Hence, the observed effect of treatment on LFS was a good predictor of the effect of treatment on OS, with only a slight (14%) attenuation of the effect as reflected in the slope of 0.86. Additionally, the fitted regression line passed nearly through the origin, indicating that no effect on LFS would predict no or little effect on OS (as expected).

Figure 4
figure 4

Correlation between treatment effects on leukemia-free survival and overall survival (R 2 = coefficient of determination). The size of each circle is proportional to the number of patients in the corresponding country.

Full size image

Discussion

We critically inspected the results of this randomized phase 3 trial of HDC/IL-2 as remission maintenance therapy versus no treatment for AML patients in complete remission. Treatment effects were assessed for consistency and robustness with respect to clinically relevant prognostic variables and with respect to center or country where the treatment took place. To this end, we tested for treatment by subset interactions (Table 1 and Figures 1 and 2), calculated inconsistency indices (Table 1), performed leave-one-center-out cross-validation (Figure 3), showed that several centers could be eliminated before losing statistical significance and correlated country-specific treatment effects on LFS and on OS (Figure 4). Taken together, these analyses indicate that the benefit of HDC/IL-2 is statistically consistent and robust.

Table 1 Heterogeneity test statistics (X2) and inconsistency coefficients (I2) for baseline disease characteristics, corresponding to the hazard ratio forest plots of Figures 1 and 2
Full size table

By "consistent," we mean that (a) the treatment effects do not differ by more than random variation across prognostic factors and other design features such as country; and (b) the treatment effects on different endpoints are highly correlated. By "robust," we mean that (a) the treatment effects would have been about the same had slightly different patient populations been included (this aspect of robustness derives directly from the consistency of the results); and (b) the treatment effects remain significant even after elimination of a few centers from the analysis. We suggest that similar assessments could be useful in all randomized multicenter trials aimed at establishing the efficacy and safety of new therapies, particularly in trials with limited sample sizes (eg, resulting from a low incidence of the disease under study). These analyses would complement other sensitivity analyses that are recommended to examine the influence of protocol deviations, unintended biases, violations of assumptions and other unexpected events on the trial outcome [1].

It is commonly believed that homogeneity of the patient population through narrow selection criteria is a desirable feature of phase 3 clinical trials. This is because heterogeneity will tend to increase the variance in patient outcomes, thereby reducing the likelihood of real treatment effects reaching statistical significance. In fact, the opposite is true insofar as heterogeneity across patient and disease characteristics at baseline renders the results of the trial more generalizable. Moreover, if patients with widely different baseline characteristics are included, potential treatment-by-prognostic-factor interactions can be found. To this end, inconsistency indices, which are commonly used in meta-analyses [16], may prove more descriptively useful than interaction tests that generally lack power to detect any but the most extreme interactions.

Another commonly held view is that having a large number of sites, as is the case in most cancer trials, somehow reduces the credibility of the findings. Here again, the opposite is true. When a trial is able to show a statistically significant difference despite the presumed heterogeneity resulting from the multicentric nature of patient accrual, the trial results are even more convincing, as well as more generalizable, than if all patients came from a few carefully selected centers. An assessment of the robustness of the trial results may be useful regardless of the number of centers participating in a trial, but they are more likely to be convincing if a large number of centers participated in the trial, as was the case in the trial analyzed in the present paper.

Although there is little question that the results of this trial were consistent and robust, the point estimate of the treatment effect was zero (no effect) in one country, and negative (control better than treatment) in another. Marschner [17] argues that such findings are often overinterpreted, and proposes ways to assess the expected variability in country-specific treatment effects at the design stage. We showed that a post-hoc calculation of the probability of a reversal of the treatment effect (under some simplifying assumptions) can be useful to address concerns that there is variability in treatment effect between countries, over and above chance alone. Such analyses may be especially relevant when potential predictive factors are suspected to vary by region, perhaps as a result of genetic differences related to ethnicity.

When evaluating therapies for cancer, many factors can influence the ability to detect a statistically significant survival benefit. In the case of AML, a relatively uncommon disease, enrollment of patients in large enough numbers to adequately power a study for OS is a major challenge. Second, long follow-up durations are required, during which practice patterns change and impact OS in ways extraneous to the treatment effect. Third, most AML patients are older and have a higher probability of death than younger patients (5-year survival rates are 4% and 31% in persons ≥65 and <65 years of age, respectively) [20] and such deaths in older patients unrelated to leukemia have the potential to confound interpretation of OS data [10]. Fourth, with particular relevance to the study of remission maintenance therapies in AML, patients may receive salvage therapies post-relapse. Post-relapse salvage therapies are far from standardized and have widely different mortality risks; hence, any observed differences in OS might result from such therapies rather than from the randomized intervention. For these reasons, LFS may be more appropriate than OS to assess the benefit of strategies to prevent AML relapse.

In the present trial, with the available follow-up data at the time of the analysis, 236 patients had experienced an event contributing to the LFS endpoint (110 in the treatment group and 126 in the control group) and 196 patients had died (94 in the treatment group and 102 in the control group). Hence, the power of the LFS analysis was higher than that of the OS analysis and it was expected, for this reason only, that a higher level of significance would be reached for LFS than for OS. With this in mind, it seemed useful to assess the correlation between the effects of treatment on LFS and OS to better understand whether treatment with HDC/IL-2 was likely to have a real effect on OS, regardless of its (lack of) statistical significance. We have explored this issue using countries as the unit of analysis, extending methods that were initially proposed for meta-analyses of several trials [18].

Conclusions

Our analyses confirm the consistency and robustness of the HDC/IL-2 effect as compared with no treatment. LFS may be an acceptable surrogate for OS in future AML trials. Similar analyses may aid interpretation of data from multicenter trials, especially in populations with rare diseases, when the size of randomized clinical trials is limited.

Abbreviations

AML:

acute myeloid leukemia

BID:

twice daily

CI:

confidence interval

CR:

complete remission

CR1:

first complete remission

CR>1:

subsequent complete remission

d.f.:

degrees of freedom

DFS:

disease-free survival

∑:

summation

HDC:

histamine dihydrochloride (Ceplene®)

HiDAC:

high dose cytosine arabinoside

HR(s):

hazard ratio(s)

I2 :

inconsistency coefficient

ICH:

International Conference on Harmonization

IL-2:

interleukin-2

ITT:

intent-to-treat

√S:

square root of S

LFS:

leukemia-free survival, M0/M1/M5/M6/M7 and M2/M3/M4 refer to the French-American-British AML classification

O/N:

event rate per arm where O is the number of observed events and N is the sample size

OS:

overall survival

P:

probability

PFS:

progression-free survival

R2 :

coefficient of determination

S:

number of subsets

si :

standard error of τi

SWOG:

Southwest Oncology Group

τ:

overall treatment effect

τi :

treatment effect on the ith subset

WBC:

white blood cell

X2 :

interaction test for homogeneity

χ2 :

chi-square

References

  1. Harmonised Tripartite Guideline: Statistical Principles for Clinical Trials E9. http://www.ema.europa.eu/docs/en_GB/document_library/Scientific_guideline/2009/09/WC500002928.pdf

  2. Estey EH: Treatment of acute myeloid leukemia. Haematologica. 2009, 94: 10-16. 10.3324/haematol.2008.001263.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Redaelli A, Lee JM, Stephens JM, Pashos CL: Epidemiology and clinical burden of acute myeloid leukemia. Expert Rev Anticancer Ther. 2003, 3: 695-710. 10.1586/14737140.3.5.695.

    Article  CAS  PubMed  Google Scholar 

  4. Burchill SA: What do, can and should we learn from models to evaluate potential anticancer agents?. Future Oncol. 2006, 2: 201-211. 10.2217/14796694.2.2.201.

    Article  CAS  PubMed  Google Scholar 

  5. Maurillo L, Buccisano F, Del Principe MI, Del PG, Spagnoli A, Panetta P, Ammatuna E, Neri B, Ottaviani L, Sarlo C, Venditti D, Quaresima M, Cerretti R, Rizzo M, de FP, Lo CF, Arcese W, Amadori S, Venditti A: Toward optimization of postremission therapy for residual disease-positive patients with acute myeloid leukemia. J Clin Oncol. 2008, 26: 4944-4951. 10.1200/JCO.2007.15.9814.

    Article  PubMed  Google Scholar 

  6. Buyse M, Burzykowski T, Carroll K, Michiels S, Sargent DJ, Miller LL, Elfring GL, Pignon JP, Piedbois P: Progression-free survival is a surrogate for survival in advanced colorectal cancer. J Clin Oncol. 2007, 25: 5218-5224. 10.1200/JCO.2007.11.8836.

    Article  CAS  PubMed  Google Scholar 

  7. Buyse M, Burzykowski T, Michiels S, Carroll K: Individual- and trial-level surrogacy in colorectal cancer. Stat Methods Med Res. 2008, 17: 467-475. 10.1177/0962280207081864.

    Article  PubMed  Google Scholar 

  8. Burzykowski T, Buyse M, Yothers G, Sakamoto J, Sargent D: Exploring and validating surrogate endpoints in colorectal cancer. Lifetime Data Anal. 2008, 14: 54-64. 10.1007/s10985-007-9079-4.

    Article  PubMed  Google Scholar 

  9. Buyse ME, Squifflet P, Allard SE, Bhagwat D, Rowe JM: Leukemia-free survival (LFS) as a surrogate for overall survival (OS) in AML patients in remission: a trial of a novel immunotherapy with histamine dihydrochloride plus low-dose IL-2 (HDC/IL-2) [abstract]. Haematologica. 2008, 93 (Suppl 1): 209-210.

    Google Scholar 

  10. Yothers G: Toward progression-free survival as a primary end point in advanced colorectal cancer. J Clin Oncol. 2007, 25: 5153-5154. 10.1200/JCO.2007.13.6796.

    Article  PubMed  Google Scholar 

  11. Rowe JM: Optimal induction and post-remission therapy for AML in first remission. Hematology Am Soc Hematol Educ Program. 2009, 396-405.

    Google Scholar 

  12. Deschler B, Lubbert M: Acute myeloid leukemia: epidemiology and etiology. Cancer. 2006, 107: 2099-2107. 10.1002/cncr.22233.

    Article  PubMed  Google Scholar 

  13. Brune M, Castaigne S, Catalano J, Gehlsen K, Ho AD, Hofmann WK, Hogge DE, Nilsson B, Or R, Romero AI, Rowe JM, Simonsson B, Spearing R, Stadtmauer EA, Szer J, Wallhult E, Hellstrand K: Improved leukemia-free survival after postconsolidation immunotherapy with histamine dihydrochloride and interleukin-2 in acute myeloid leukemia: results of a randomized phase 3 trial. Blood. 2006, 108: 88-96. 10.1182/blood-2005-10-4073.

    Article  CAS  PubMed  Google Scholar 

  14. Wallhult EA, Whisnant JK, Nilsson BI, Bhagwat D, Hellstrand K, Brune ML: Quality of life during remission maintenance immunotherapy in acute myeloid leukemia: a prospective assessment using EORTC QLQ-C30 in a randomized phase III trial of histamine dihydrochloride plus low-dose interleukin-2 [abstract]. Haematologica. 2008, 93 (Suppl 1): 316-

    Google Scholar 

  15. Whitehead A, Whitehead J: A general parametric approach to the meta-analysis of randomized clinical trials. Stat Med. 1991, 10: 1665-1677. 10.1002/sim.4780101105.

    Article  CAS  PubMed  Google Scholar 

  16. Higgins JP, Thompson SG, Deeks JJ, Altman DG: Measuring inconsistency in meta-analyses. BMJ. 2003, 327: 557-560. 10.1136/bmj.327.7414.557.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Marschner IC: Regional differences in multinational clinical trials: anticipating chance variation. Clin Trials. 2010, 7: 147-156. 10.1177/1740774510361974.

    Article  PubMed  Google Scholar 

  18. Buyse M, Molenberghs G, Burzykowski T, Renard D, Geys H: The validation of surrogate endpoints in meta-analyses of randomized experiments. Biostatistics. 2000, 1: 49-67. 10.1093/biostatistics/1.1.49.

    Article  PubMed  Google Scholar 

  19. Burzykowski T, Molenberghs G, Buyse M: The Evaluation of Surrogate Endpoints. 2005, New York, NY: Springer

    Book  Google Scholar 

  20. National Cancer Institute: SEER Survival Data 1988-2005 (SEER 9). http://seer.cancer.gov/faststats/selections.php?series=cancer

Download references

Acknowledgements

The authors wish to thank Donald Fallon, ELS, of MedVal Scientific Information Services, LLC, for expert editorial assistance.

Funding

Funding to support these analyses and preparation of this paper was provided by EpiCept Corporation. EpiCept Corporation did not contribute to any of the analyses presented here, nor to their interpretation.

Author information

Authors and Affiliations

  1. International Drug Development Institute, Department of Biostatistics, Louvain-la-Neuve, Belgium

    Marc Buyse & Pierre Squifflet

  2. I-BioStat, Center for Statistics, Hasselt University, Diepenbeek, Belgium

    Marc Buyse

  3. MedVal Scientific Information Services, Medical Writing Department, Skillman, NJ, USA

    Kathryn J Lucchesi

  4. Hematology Unit, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden

    Mats L Brune

  5. Hôpital André Mignot, Service Hématologie et Oncologie, Le Chesnay, France

    Sylvie Castaigne

  6. Rambam Medical Center, Department of Hematology and Bone Marrow Transplantation, and Technion, Haifa, Israel

    Jacob M Rowe

Authors
  1. Marc Buyse
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pierre Squifflet
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kathryn J Lucchesi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mats L Brune
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sylvie Castaigne
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jacob M Rowe
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marc Buyse.

Additional information

Competing interests

MB is majority shareholder of IDDI and PS is a Biostatistician at IDDI, a company that provides biostatistical services to EpiCept Corporation. KJL is a Senior Medical Writer at MedVal Scientific Information Services and a consultant for EpiCept Corporation. MLB, SC, and JMR were investigators on the EpiCept-sponsored study of HDC/IL-2 and have received honoraria from EpiCept Corporation.

Authors' contributions

MB, PS, MLB, SC, and JMR made substantial contribution to conception and study design. MB, PS, MLB, SC, and JMR were involved in analysis and interpretation of data. MB, PS, KJL, MLB, SC and JMR were involved in drafting or revising the manuscript for important intellectual content. MB, PS, KJL, MLB, SC and JMR read and approved the final manuscript for publication.

Authors’ original submitted files for images

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Buyse, M., Squifflet, P., Lucchesi, K.J. et al. Assessment of the consistency and robustness of results from a multicenter trial of remission maintenance therapy for acute myeloid leukemia. Trials 12, 86 (2011). https://doi.org/10.1186/1745-6215-12-86

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1745-6215-12-86

Keywords

Trials

ISSN: 1745-6215