Skip to main content
Download PDF

Durable response rate as an endpoint in cancer immunotherapy: insights from oncolytic virus clinical trials

Journal for ImmunoTherapy of Cancer volume 5, Article number: 72 (2017) Cite this article

Abstract

Background

Traditional response criteria may be insufficient to characterize full clinical benefits of anticancer immunotherapies. Consequently, endpoints such as durable response rate (DRR; a continuous response [complete or partial objective response] beginning within 12 months of treatment and lasting ≥6 months) have been employed. There has not, however, been validation that DRR correlates with other more traditional endpoints of clinical benefit such as overall survival.

Methods

We evaluated whether DRR was associated with clinically meaningful measures of benefit (eg, overall survival [OS], quality of life [QoL], or treatment-free interval [TFI]) in a phase 3 clinical trial of an oncolytic virus for melanoma treatment. To evaluate the association between DRR and OS and to mitigate lead time bias, landmark analyses were used. QoL was evaluated using the FACT-BRM questionnaire (comprising the FACT-BRM Physical, Social/Family, Emotional, and Functional well-being domains, the Additional Concerns, Physical and Mental treatment-specific subscales, and the Trial Outcome Index [TOI]). TFI was defined as time from the last study therapy dose to first subsequent therapy dose (including any systemic anticancer therapy for melanoma after study therapy discontinuation).

Results

Four hundred thirty-six patients were included in the intent-to-treat population. Achieving DR was associated with a statistically significant improvement in OS in a landmark analysis at 9 months (HR = 0.07; P = 0.0003), 12 months (HR = 0.05, P < 0.0001), and 18 months (HR = 0.11; P = 0.0002) that persisted after adjusting for disease stage and line of therapy. Achieving a DR was associated with a longer median TFI (HR = 0.33; P = 0.0007) and a higher TOI improvement rate (58.1% versus 30.0%; P = 0.025).

Conclusions

Achieving a DR was associated with clinical benefits such as improved OS and QoL and prolonged TFI, thus supporting the usefulness of DR as a meaningful immunotherapy clinical trial endpoint.

Trial registration

ClinicalTrials.gov identifier, NCT00769704 (https://clinicaltrials.gov/ct2/show/NCT00769704) October 7, 2008

Background

A growing body of clinical evidence indicates that traditional response criteria may not be sufficient to completely characterize the full spectrum of activities of current anticancer immunotherapies and/or define the clinical benefit associated with their use. Although a number of immunotherapies have recently been approved based, in part, upon tumor responses evaluated by traditional response criteria (eg, Response Evaluation Criteria in Solid Tumors [RECIST] [1, 2] or World Health Organization [WHO] criteria for response [3]), these criteria may not accurately capture the full benefits of immunotherapy-based drugs or regimens. In particular, these measures of response lack a durability dimension, and thus therapeutic benefit may be overestimated. Conversely, because responses may occur after an initial increase in tumor burden or appearance of new tumor lesions characterized as progressive disease by WHO criteria or RECIST [4,5,6,7,8,9,10,11], therapeutic benefit may be underestimated. Consequently, allowing for disease progression before response is critical for evaluation of immunotherapies because initial tumor growth may not always be indicative of treatment failure [4, 11].

Assuming response criteria that allow for progression prior to response are used, a conventional analysis is to evaluate duration of response for responders; however, no prospective criteria are designated for interpreting the clinical relevance of this information at the patient level or for treatment effect in a controlled study. To this end, the endpoint of durable response rate (DRR) has been proposed, which includes standard response criteria and a prospective durability dimension. Although DRR has not been validated as a surrogate endpoint for clinical benefit, anticancer agents have been approved based on a demonstrated ability to achieve retrospectively defined durable responses (DRs) [12,13,14]. With the allowance for progression prior to response, we hypothesized that DRR is an appropriate measure of the ability of immunotherapy anticancer agents to mediate a clinically meaningful, sustained reduction in tumor burden that may be associated with measures of clinical benefit such as prolonged overall survival (OS), improved quality of life (QoL), and freedom from successive anticancer therapies. This is especially important for immunotherapy-based regimens since the kinetics of response may be different when compared to cytotoxic chemotherapy or targeted therapy that mediate antitumor activity directly in tumor cells.

For this analysis, we used prospectively collected clinical data from the OPTiM trial, a randomized phase 3 study that compared intralesional talimogene laherparepvec, a genetically modified herpes simplex virus (HSV) type-1, designed to selectively replicate in tumors and produce human granulocyte macrophage-colony stimulating factor (GM-CSF) to subcutaneous GM-CSF, to evaluate whether DRR is associated with measures of clinical benefit, such as OS and QoL or treatment-free interval (TFI) after therapy. Talimogene laherparepvec is thought to mediate antitumor activity, at least in part, through activation of systemic immune responses and initial results from previous clinical trials demonstrated delayed kinetics of response similar to observations from T-cell checkpoint inhibitor trials [8, 15]. DRR, defined as a continuous response (complete response [CR]/partial response [PR]) beginning in the first 12 months of treatment and lasting 6 months or longer, was the primary endpoint in OPTiM. Although results from the OPTiM study have been reported previously [15], this analysis was undertaken to further validate the DRR endpoint by determining if DR is associated with other measures of clinical benefit. These data have implications for incorporating DRR as a regulatory endpoint in tumor immunotherapy clinical trial designs.

Methods

Study design

Study design and patient population for OPTiM have been previously described [15]. Briefly, eligible patients with histologically confirmed, surgically unresectable, stage IIIB/IIIC/IV melanoma that could undergo direct/ultrasound-guided injection of dermal, subcutaneous, or lymph node melanoma metastases were included. Patients were randomized 2:1 to receive intralesional talimogene laherparepvec or subcutaneous GM-CSF. The primary endpoint was DRR, defined as the rate of objective response (CR/PR) by modified WHO criteria lasting ≥6 months continuously and beginning within the first 12 months of initiating treatment where disease progression was allowed prior to onset of response. Key secondary endpoints included OS, best overall response, onset and duration of response, and time to treatment failure. Exploratory objectives included evaluation of patients’ QoL and analysis of the influence of achieving a response on OS.

Analysis population

Data cutoff for DR and QoL analyses was December 2012, and data cutoff for OS and subsequent therapy analyses was February 2013. Data cutoff for duration of response per investigator was August 2014 (final analysis). A landmark approach was used to limit lead-time bias because the minimum time required to achieve a DR was 9 months (ie, 3 months to first tumor assessment plus minimum 6 months of response duration). Analyses excluded patients with a follow-up duration less than the landmark time.

Assessments

Assessment of durable response in OPTiM has been described previously [15]. Briefly, visible/palpable lesions were assessed by clinical evaluation performed on day 1 of each cycle; computed tomography assessments of response were performed at baseline and every 12 weeks thereafter. Patients who had a best response of CR/PR per modified WHO criteria based on investigator assessment or were on therapy ≥9 months were evaluated for response by a blinded endpoint assessment committee (EAC) [15]. Patients were considered in response if there was ≥50% reduction in total tumor burden of all measurable lesions compared with baseline or, if any new tumors/lesions had appeared, compared with when they were first documented. Disease progression was considered a >25% increase in total tumor burden or appearance of new lesions, and clinically relevant disease progression was defined as disease progression associated with a decline in performance status and/or required alternative therapy. Treatment continued for 24 weeks, irrespective of progression. After 24 weeks, treatment continued until clinically relevant disease progression, intolerability, withdrawal of consent, complete remission, lack of response by 12 months, or disappearance of all injectable lesions (talimogene laherparepvec only) [15]. After 12 months, patients with stable/responding disease could continue treatment for 6 additional months.

Quality of life was assessed using a validated Functional Assessment of Cancer Therapy–Biologic Response Modifier (FACT-BRM) questionnaire, which comprises four domains (Physical, Social/Family, Emotional, and Functional well-being) and two treatment-specific subscales (Additional Concerns: Physical and Mental) [16]. The Trial Outcome Index (TOI) is a 27-item sum of the scores of the Physical and Functional well-being domains and the two treatment-specific subscales of FACT-BRM that has been shown to be a helpful single scale instrument for assessment of QoL in clinical trials [17, 18]. Changes in QoL were evaluated using the TOI as well as the FACT-BRM Total, FACT-BRM subdomains, and treatment-specific subscales. The questionnaire was completed before study procedures were conducted on day 1 of each treatment cycle (5 weeks for the first cycle and 4 weeks for subsequent treatment cycles) until the end of treatment and at the end-of-treatment visit (30 days after last treatment). In this analysis, a clinically meaningful improvement in QoL was defined as a ≥5-point increase from baseline lasting ≥28 days for the TOI and FACT-BRM Total and a ≥2-point increase for all other domains and Additional Concerns [19]. A minimum clinically important difference for TOI of 5 to 7 points has been established for group changes.

Melanoma treatments administered after discontinuation of talimogene laherparepvec/GM-CSF were recorded during the survival follow-up. Subsequent therapy was defined as any systemic anticancer therapy for melanoma after discontinuation of study therapy and was categorized as chemotherapy/targeted agents or immunotherapy.

Statistical analysis

The primary analysis was planned when no further patients had the possibility of meeting the criteria for durable response; the final OS analysis was planned for after all patients had reached 18 months from their first dose of treatment. To mitigate potential for lead-time bias (ie, patients who live long enough to have a DR tend to have longer survival, irrespective of whether durable response prolongs survival), OS for patients who had achieved a DR and were alive was compared with OS for patients who had not achieved a DR and were alive in a landmark analysis at 9, 12, and 18 months after randomization [20]. In this analysis, OS was calculated from a landmark time to death; patients who died or who were censored before the landmark time were excluded from the analysis. Because disease stage and line of therapy were found to be associated with DR and OS in multivariate analyses and because the talimogene laherparepvec treatment effect on DRR and OS was pronounced in patients with stage IIIB/IIIC/IVM1a melanoma and treatment-naive patients in exploratory subgroup analyses of OPTiM, Cox model hazard ratio estimates and log-rank tests in landmark analysis were stratified by these factors, accounting for observed baseline imbalances (ie, disease stages IIIB/IIIC/IVM1a versus IVM1b/IVM1c, first-line versus second-line or later therapy).

To further evaluate any potential association between achievement of DR and OS, the time when DR was achieved was also evaluated in a Cox proportional hazards model as a time-dependent covariate for all randomized patients. Treatment-free interval (defined as time from the last dose of study therapy to first dose of subsequent therapy or censoring in the absence thereof at end of follow-up) was estimated using the Kaplan-Meier method. As with OS, the association between TFI and achieving a DR was evaluated in a landmark analysis using a Cox proportional hazards model and log-rank test. The TOI analysis set included patients with a baseline score (defined as the maximum possible score—5-point absolute increase criterion for improvement), ≥1 post-baseline non-missing score, and tumor assessments for ≥9 months of follow-up. Associations between FACT-BRM improvement and achievement of DR were evaluated using an odds ratio stratified by disease stage and line of therapy in a landmark analysis at 9 months after randomization. Odds ratios for those who achieved a DR versus those who did not and P values for TOI improvement were obtained by fitting an exact logistic regression model using DR status as a predictor and TOI improvement as response. Statistical significance was evaluated at a nominal two-sided 0.05 significance level without multiplicity assessment.

Results

Patients

In total, 436 patients were included in the intent-to-treat population (295 in the talimogene laherparepvec arm and 141 in the GM-CSF arm). Baseline demographic/clinical characteristics for the study population are summarized in Table 1 and have been reported previously by arm [15]. At the primary analysis, 86 patients in the intent-to-treat population achieved an OR per EAC and, of these, the OR duration did not qualify for a DR for 35 patients but it did for 51 (talimogene laherparepvec, n = 48; GM-CSF, n = 3), 23 of whom had progression before response (all in the talimogene laherparepvec arm). Among the 86 patients with an OR, a similar proportion of DR versus non-DR patients had early stage disease (82% versus 74%) and received first-line therapy (65% versus 63%). At the final analysis, 59 patients achieved a DR per investigator (talimogene laherparepvec, n = 57; GM-CSF, n = 2; Additional file 1: Figure S1), indicating that responses continued to evolve over time.

Table 1 Baseline Demographics and Clinical Characteristics for Patients Treated with Talimogene Laherparepvec and GM-CSF
Full size table

Association between durable response and overall survival

Achieving a DR was associated with a statistically significant improvement in OS in a landmark analysis at 9 months (HR = 0.07; 95% CI, 0.01–0.48; P = 0.0003; Fig. 1a), at 12 months (HR = 0.05, 95% CI, 0.01–0.33; P < 0.0001; Fig. 1b), and at 18 months (HR = 0.11; 95% CI, 0.03–0.44; P = 0.0002; Fig. 1c). Because comparisons of OS and DR may be confounded (eg, by lead-time bias), we employed analytical techniques to mitigate against such potential biases. The association between DR and OS remained after adjusting for potentially confounding imbalances in disease stage and line of therapy (both were shown to be predictive for treatment effect of talimogene laherparepvec in post hoc exploratory analyses [15]) between those who achieved a DR and those who did not (9 months, HR = 0.07; 95% CI, 0.01–0.54; 12 months, HR = 0.05; 95% CI, 0.01–0.035; 18 months, HR = 0.11, [95% CI, 0.03–0.47]; Table 2). Consistent results were obtained when achievement of DR was evaluated in a Cox proportional hazards model as a time-dependent covariate among all randomized patients (HR = 0.08; 95% CI, 0.03–0.26).

Fig. 1
figure1

Kaplan-Meier plots of overall survival in patients who achieved a durable response versus patients who did not achieve a durable response prior to landmark times of 9 months (a), 12 months (b), and 18 months from randomization (c), and treatment-free survival in patients who achieved a durable response versus patients who did not achieve a durable response (d). For landmark analyses, OS was calculated from the landmark time (9, 12, or 18 months after randomization) to death. TFI analysis was limited to treated patients with tumor assessments ≥9 months. Unadjusted hazard ratios (HR) and log-rank P values are shown. DR durable response, NE not evaluable, OS overall survival, TFI treatment-free interval

Full size image
Table 2 Incidence of DR at Each Landmark Time Assessment in OPTiM Patients Treated with Talimogene Laherparepvec and GM-CSFa
Full size table

Durable response and treatment-free interval

Of the 436 patients included in the intent-to-treat population, 129 received study therapy and had tumor assessments at ≥9 months of follow-up and were included in the TFI analysis; of these, 50 patients achieved a DR per the EAC (talimogene laherparepvec, n = 47; GM-CSF, n = 3) and 79 patients did not (talimogene laherparepvec, n = 65; GM-CSF, n = 14). Of the 50 patients with a DR, 11 (22%) were treated with subsequent systemic anti-melanoma therapy after the end of their assigned treatment with GM-CSF/talimogene laherparepvec (talimogene laherparepvec, n = 9; GM-CSF, n = 2). Of 79 patients without a DR, 38 (48%) were treated with subsequent systemic anti-melanoma therapy (talimogene laherparepvec, n = 28; GM-CSF, n = 10).

Kaplan-Meier plots of freedom from subsequent systemic anti-melanoma therapy in patients who achieved a DR versus patients who did not achieve a DR with tumor assessments at ≥9 months, including hazard ratio (HR) and log-rank P value, are shown in Fig. 1. DR was associated with a significantly longer median TFI (HR = 0.33; 95% CI, 0.17–0.65; P = 0.0007; Fig. 1d). Achieving a DR was also associated with a 27.5% (95% CI, 10.6–44.4) reduced risk of initiating subsequent systemic therapy at 36 months (DR, 76.5% [95% CI, 61.4–86.2]; no DR, 49.0% [95% CI, 36.9–60.0]).

Fig. 2
figure2

Association of durable response with (a) FACT-BRM domain and subscale improvement and (b) TOI Improvement. aAnalysis was limited to patients with tumor assessments ≥9 months evaluable for improvement. bOdds ratio stratified by disease stage and lines of therapy. cOnly patients followed up for ≥9 months included. DR durable response, FACT-BRM Functional Assessment of Cancer Therapy Biologic Response Modifier, HR hazard ratio, TOI Trial Outcome Index

Full size image

Quality of life

Of the 129 patients with tumor assessments at ≥9 months of follow-up, 117 had QoL data and 103 had data for the TOI analysis. Overall, achieving a DR was associated with improved scores in the TOI, the FACT-BRM Total, and all FACT-BRM domains and treatment-specific subscales, except for social well-being (Fig. 2a).

Achievement of a DR was associated with a higher TOI improvement rate. Among patients who achieved a DR, 58.1% (25/43) had a clinically meaningful TOI improvement, compared with 30.0% (18/60) of patients who did not achieve a DR (P = 0.025; Fig. 2b). In a landmark analysis limited to patients with ≥9 months of follow-up for tumor response assessment, the odds ratio for TOI improvement was 2.8 (95% CI, 1.1–7.0; Table 3). A sensitivity analysis evaluated whether the association was retained when TOI improvement required a larger absolute increase from baseline and/or longer improvement duration. Although nominal 0.05 significance was not achieved in all cases, it was achieved for a magnitude up to 9 points or a duration up to 4 cycles. In addition, with one exception, odds ratios were greater than 1 for all magnitude and duration combinations (Additional file 1: Table S1).

Table 3 TOI Association with Achieving a DR (per Endpoint Assessment Committee)a
Full size table

Discussion

Data from this analysis of outcomes in the phase 3 OPTiM study indicate that achievement of a DR in patients with unresectable regionally and distantly advanced melanoma was associated with several independent clinical benefits, providing further support for DR as a useful endpoint in patients with melanoma. Achievement of a DR was associated with improved OS in landmark analyses at 9, 12, and 18 months, lower risk of subsequent systemic therapy use at 36 months, and improved QoL at ≥9 months of follow-up. The risk of death was decreased by approximately 90% for patients with a DR. Similar results were obtained in analyses adjusted for imbalances in baseline demographic/clinical characteristics and in a Cox proportional hazards model that evaluated achievement of DR as a time-dependent covariate. Furthermore, patients with a DR have an approximately two-thirds reduction in the risk of requiring a new therapy and were approximately 3 times more likely to have a clinically meaningful improvement in QoL. The association with improvement in QoL is particularly notable in the melanoma setting where skin lesions may be regarded as disfiguring by patients. Taken together, this evidence indicates that DR is an efficacy endpoint that is associated with other favorable clinical outcomes.

Since the proposed mechanism of action of talimogene laherparepvec includes release of tumor-associated antigens and cell- and damage-associated molecular pattern molecules, and local expression of GM-CSF, talimogene laherparepvec is likely able to recruit and expand tumor associated antigen-reactive T cells [21]. This process may take time, and lesions may continue to grow before regression. Furthermore, this process may cause a local inflammatory-like response in lesions, resulting in a period of “pseudo-progression” before response [15, 22]; thus, alternative measures of clinical response may be needed. These observations of progression before response are consistent with the immune-mediated antitumor activity associated with the talimogene laherparepvec mechanism of action, and have been reported with other immunotherapy agents such as ipilimumab [23]. With the allowance for progression before response, our results demonstrate the utility of DR as an appropriate endpoint for oncolytic virus clinical trials and for trials involving combination regimens of immunotherapeutic agents. An element of DR that may be a key to its clinical value is that it incorporates a time component: responses must be maintained for ≥6 months continuously and begun within the first 12 months of initiating treatment. In contrast, the WHO criteria and RECIST do not make allowance for progression before response or define a meaningful minimum duration of response. In a randomized clinical trial of ipilimumab in melanoma, a significant improvement in OS was seen; however, treatment had no impact on progression-free survival (PFS) [10]. These results highlight the inherent problems in using PFS using conventional response criteria as a primary endpoint in immunotherapy clinical trials, and the need for identification of alternative endpoints to accurately assess immunotherapy drugs in early phase clinical development where OS may not be a feasible endpoint. Our data support the use of DRR as a flexible and appropriate surrogate of OS and other measures of clinical benefit.

Other attempts to define alternative clinical trial endpoints for immunotherapy agents include modifications of RECIST (such as immune-related response criteria; irRC [4]), which are being used to evaluate tumor responses in clinical trials across a variety of tumor types [24]. A benefit to the use of irRC is that progressive disease prior to treatment response is permitted, consistent with the criteria for DR in the OPTiM study. However, like the WHO criteria and RECIST, irRC does not define a meaningful duration for tumor response. Furthermore, endpoints such as objective response or progression-free survival based on irRC have not yet been validated as correlates of OS.

Unlike survival endpoints, response indicates a direct biological effect of a therapy on the tumor. Patients can survive for prolonged periods without treatment, but tumors rarely recede or disappear without intervention. To be considered a DR, however, the response must be maintained for a period of at least 6 months. This duration component may make achieving a DR a more descriptive endpoint than others such as objective response, which requires only response confirmation at least 4 weeks after the initial assessment of response. Six months was initially selected as a reasonable duration because most non-immunotherapy treatments rarely induce responses beyond 6 months in melanoma [25]. The expanded use of DRR for other cancers allows for the selection of the most appropriate duration based on the natural history of the disease and known impact of established therapeutic regimens. Thus, by altering the duration of response, DRR can be used in a more flexible manner for other cancers that may exhibit different natural history and/or have other standard treatments available that extend survival for variable times. The inclusion of the initiation at any time within 12 months of starting treatment allows capturing pseudoprogression, which has been reported in some immunotherapy trials, and permits continued treatment beyond clinically asymptomatic progression, as has been reported for irRC proposed for tumor immunotherapy studies [4]. It is also possible that a rate of durable stable disease might represent an informative endpoint; however, further evaluation would be required to validate such an endpoint.

This study had certain limitations. First, these analyses were exploratory and should therefore be interpreted with caution. Second, although we identified associations between DR and clinical outcomes, causative relationships could not be evaluated. For example, although our analysis indicated an association between DR and OS, it is possible that factors other than achievement of DR (eg, imbalances in disease stage and line of therapy, or subsequent therapy) might have influenced the observed outcome. Although endeavors were made to mitigate the potential for confounding by such factors, it is difficult to determine how successful they might have been. Additionally, the selection of 6 months as the minimum duration for achievement of a durable response was based on responses to cytotoxic chemotherapy agents; this time point was, to an extent, arbitrary. In the OPTiM study, some patients had DRs that lasted substantially longer than 6 months. It is unknown whether the associations found in this analysis would have been observed had the distribution of DR duration been closer to the 6-month minimum. Finally, it is possible that the associations seen were driven by the preferential occurrence of complete response among patients with DR (of any duration).

Conclusions

Results from this analysis indicate that the achievement of a DR in patients with unresectable regionally and distantly advanced melanoma was associated with improved clinical benefit and QoL. Although causal relationships cannot be determined via these analyses, these findings support the utility of DR as a meaningful trial endpoint when assessing efficacy of immunotherapies for solid tumors. Further consideration of durable response rate as a clinical endpoint in cancer immunotherapy trials is also warranted and may allow for improved selection of promising agents for later phase clinical development.

Abbreviations

CR:

Complete response

DR:

Durable response

DRR:

Durable response rate

EAC:

Endpoint assessment committee

FACT-BRM:

Functional Assessment of Cancer Therapy-Biologic Response Modifier

GM-CSF:

Granulocyte macrophage-colony stimulating factor

HR:

Hazard ratio

HSV:

Herpes simplex virus

irRC:

Immune-related response criteria

OS:

Overall survival

PFS:

Progression-free survival

PR:

Partial response

QoL:

Quality of life

RECIST:

Response Evaluation Criteria in Solid Tumors

TFI:

Treatment-free interval

TOI:

Trial outcome index

WHO:

World Health Organization

References

  1. 1.

    Eisenhauer EA, Therasse P, Bogaerts J, Schwartz LH, Sargent D, Ford R, Dancey J, Arbuck S, Gwyther S, Mooney M, Rubinstein L, Shankar L, Dodd L, Kaplan R, Lacombe D, Verweij J. New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1). Eur J Cancer. 2009;45:228–47.

    CAS  Article  PubMed  Google Scholar 

  2. 2.

    Therasse P, Arbuck SG, Eisenhauer EA, Wanders J, Kaplan RS, Rubinstein L, Verweij J, Van Glabbeke M, van Oosterom AT, Christian MC, Gwyther SG. New guidelines to evaluate the response to treatment in solid tumors. European Organization for Research and Treatment of cancer, National Cancer Institute of the United States, National Cancer Institute of Canada. J Natl Cancer Inst. 2000;92:205–16.

    CAS  Article  PubMed  Google Scholar 

  3. 3.

    WHO Handbook for Reporting Results of Cancer Treatment. Geneva, Switzerland: World Health Organization; 1979.

  4. 4.

    Wolchok JD, Hoos A, O'Day S, Weber JS, Hamid O, Lebbe C, Maio M, Binder M, Bohnsack O, Nichol G, Humphrey R, Hodi FS. Guidelines for the evaluation of immune therapy activity in solid tumors: immune-related response criteria. Clin Cancer Res. 2009;15:7412–20.

    CAS  Article  PubMed  Google Scholar 

  5. 5.

    Little RF, Pluda JM, Wyvill KM, Rodriguez-Chavez IR, Tosato G, Catanzaro AT, Steinberg SM, Yarchoan R. Activity of subcutaneous interleukin-12 in AIDS-related Kaposi sarcoma. Blood. 2006;107:4650–7.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  6. 6.

    Kruit WH, van Ojik HH, Brichard VG, Escudier B, Dorval T, Dreno B, Patel P, van Baren N, Avril MF, Piperno S, Khammari A, Stas M, Ritter G, Lethe B, Godelaine D, Brasseur F, Zhang Y, van der Bruggen P, Boon T, Eggermont AM, Marchand M. Phase 1/2 study of subcutaneous and intradermal immunization with a recombinant MAGE-3 protein in patients with detectable metastatic melanoma. Int J Cancer. 2005;117:596–604.

    CAS  Article  PubMed  Google Scholar 

  7. 7.

    Di Giacomo AM, Danielli R, Guidoboni M, Calabro L, Carlucci D, Miracco C, Volterrani L, Mazzei MA, Biagioli M, Altomonte M, Maio M. Therapeutic efficacy of ipilimumab, an anti-CTLA-4 monoclonal antibody, in patients with metastatic melanoma unresponsive to prior systemic treatments: clinical and immunological evidence from three patient cases. Cancer Immunol Immunother. 2009;58:1297–306.

    CAS  Article  PubMed  Google Scholar 

  8. 8.

    Oxnard GR, Morris MJ, Hodi FS, Baker LH, Kris MG, Venook AP, Schwartz LH. When progressive disease does not mean treatment failure: reconsidering the criteria for progression. J Natl Cancer Inst. 2012;104:1534–41.

    Article  PubMed  PubMed Central  Google Scholar 

  9. 9.

    Topalian SL, Hodi FS, Brahmer JR, Gettinger SN, Smith DC, McDermott DF, Powderly JD, Carvajal RD, Sosman JA, Atkins MB, Leming PD, Spigel DR, Antonia SJ, Horn L, Drake CG, Pardoll DM, Chen L, Sharfman WH, Anders RA, Taube JM, McMiller TL, Xu H, Korman AJ, Jure-Kunkel M, Agrawal S, McDonald D, Kollia GD, Gupta A, Wigginton JM, Sznol M. Safety, activity, and immune correlates of anti-PD-1 antibody in cancer. N Engl J Med. 2012;366:2443–54.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  10. 10.

    Hodi FS, O'Day SJ, McDermott DF, Weber RW, Sosman JA, Haanen JB, Gonzalez R, Robert C, Schadendorf D, Hassel JC, Akerley W, van den Eertwegh AJ, Lutzky J, Lorigan P, Vaubel JM, Linette GP, Hogg D, Ottensmeier CH, Lebbe C, Peschel C, Quirt I, Clark JI, Wolchok JD, Weber JS, Tian J, Yellin MJ, Nichol GM, Hoos A, Urba WJ. Improved survival with ipilimumab in patients with metastatic melanoma. N Engl J Med. 2010;363:711–23.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  11. 11.

    Davies M. New modalities of cancer treatment for NSCLC: focus on immunotherapy. Cancer Manag Res. 2014;6:63–75.

    Article  PubMed  PubMed Central  Google Scholar 

  12. 12.

    Mekinist (trametinib). Full Prescribing Information, GlaxoSmithKline, Triangle Park, NC, 2014.

  13. 13.

    Tafinlar (dabrafenib). Full Prescribing Information, GlaxoSmithKline, Research Triangle Park, NC, 2014.

  14. 14.

    Proleukin® (aldesleukin). Full Prescribing Information, Prometheus Laboratories, Inc., San Diego, CA, 2012.

  15. 15.

    Andtbacka RH, Kaufman HL, Collichio F, Amatruda T, Senzer N, Chesney J, Delman KA, Spitler LE, Puzanov I, Agarwala SS, Milhem M, Cranmer L, Curti B, Lewis K, Ross M, Guthrie T, Linette GP, Daniels GA, Harrington K, Middleton MR, Miller WH Jr, Zager JS, Ye Y, Yao B, Li A, Doleman S, VanderWalde A, Gansert J, Coffin RS. Talimogene laherparepvec improves durable response rate in patients with advanced melanoma. J Clin Oncol. 2015;33:2780–8.

    CAS  Article  PubMed  Google Scholar 

  16. 16.

    Bacik J, Mazumdar M, Murphy BA, Fairclough DL, Eremenco S, Mariani T, Motzer RJ, Cella D. The functional assessment of cancer therapy-BRM (FACT-BRM): a new tool for the assessment of quality of life in patients treated with biologic response modifiers. Qual Life Res. 2004;13:137–54.

    CAS  Article  PubMed  Google Scholar 

  17. 17.

    Motzer RJ, Murphy BA, Bacik J, Schwartz LH, Nanus DM, Mariani T, Loehrer P, Wilding G, Fairclough DL, Cella D, Mazumdar M. Phase III trial of interferon alfa-2a with or without 13-cis-retinoic acid for patients with advanced renal cell carcinoma. J Clin Oncol. 2000;18:2972–80.

    CAS  Article  PubMed  Google Scholar 

  18. 18.

    Cella D, Eton DT, Fairclough DL, Bonomi P, Heyes AE, Silberman C, Wolf MK, Johnson DH. What is a clinically meaningful change on the functional assessment of cancer therapy-lung (FACT-L) questionnaire? Results from eastern cooperative oncology group (ECOG) study 5592. J Clin Epidemiol. 2002;55:285–95.

    Article  PubMed  Google Scholar 

  19. 19.

    Yost KJ, Sorensen MV, Hahn EA, Glendenning GA, Gnanasakthy A, Cella D. Using multiple anchor- and distribution-based estimates to evaluate clinically meaningful change on the functional assessment of cancer therapy-biologic response modifiers (FACT-BRM) instrument. Value Health. 2005;8:117–27.

    Article  PubMed  Google Scholar 

  20. 20.

    Anderson JR, Cain KC, Gelber RD. Analysis of survival by tumor response and other comparisons of time-to-event by outcome variables. J Clin Oncol. 2008;26:3913–5.

    Article  PubMed  Google Scholar 

  21. 21.

    Liu BL, Robinson M, Han ZQ, Branston RH, English C, Reay P, McGrath Y, Thomas SK, Thornton M, Bullock P, Love CA, Coffin RS. ICP34.5 deleted herpes simplex virus with enhanced oncolytic, immune stimulating, and anti-tumour properties. Gene Ther. 2003;10:292–303.

    CAS  Article  PubMed  Google Scholar 

  22. 22.

    Chiou VL, Burotto M. Pseudoprogression and immune-related response in solid tumors. J Clin Oncol. 2015;33:3541–3.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  23. 23.

    Hoos A, Ibrahim R, Korman A, Abdallah K, Berman D, Shahabi V, Chin K, Canetta R, Humphrey R. Development of ipilimumab: contribution to a new paradigm for cancer immunotherapy. Semin Oncol. 2010;37:533–46.

    CAS  Article  PubMed  Google Scholar 

  24. 24.

    Hoos A, Wolchok JD, Humphrey RW, Hodi FS. CCR 20th anniversary commentary: immune-related response criteria--capturing clinical activity in Immuno-oncology. Clin Cancer Res. 2015;21:4989–91.

    CAS  Article  PubMed  Google Scholar 

  25. 25.

    Wilson MA, Schuchter LM. Chemotherapy for melanoma. Cancer Treat Res. 2016;167:209–29.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

The authors thank Jennifer Gansert, MD, PhD (Amgen Inc.), for contribution to data interpretation, and Meghan Johnson, PhD (Complete Healthcare Communications, LLC, West Chester, PA), for medical writing assistance in the preparation of this manuscript; their work was funded by Amgen Inc. We also thank the patients and families who participated in the clinical trial.

Funding

This study was funding by Amgen, Inc.

Availability of data and materials

The datasets generated and/or analyzed during the current study are not publicly available due, in part, to the study protocol’s requirements for patient privacy and confidentiality. Requests for access to the data may be directed to the authors.

Author information

Affiliations

  1. Rutgers Cancer Institute of New Jersey, 195 Little Albany Street, New Brunswick, NJ, 08901, USA

    Howard L. Kaufman

  2. Huntsman Cancer Institute, University of Utah, 1950 Circle of Hope Drive, Salt Lake City, UT, 84112, USA

    Robert H. I. Andtbacka

  3. The University of North Carolina Chapel Hill, 170 Manning Drive, Box 7305, Chapel Hill, NC, 27599, USA

    Frances A. Collichio

  4. Amgen Inc., One Amgen Center Drive, Thousand Oaks, CA, 91320, USA

    Michael Wolf, Zhongyun Zhao & Mark Shilkrut

  5. Department of Medicine, Roswell Park Cancer Institute, Elm and Carlton Streets, Buffalo, NY, 14263, USA

    Igor Puzanov

  6. MD Anderson Cancer Center, 1515 Holcombe Blvd, Houston, TX, 77030, USA

    Merrick Ross

Authors
  1. Howard L. Kaufman
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Robert H. I. Andtbacka
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Frances A. Collichio
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Michael Wolf
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Zhongyun Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Mark Shilkrut
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Igor Puzanov
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Merrick Ross
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

HLK, RHIA, FAC, IP, and MR made substantial contributions to the analysis and interpretation of the data and contributed to the drafting and revising of the manuscript. MW, ZZ, and MS made substantial contributions to the acquisition of data, analysis and interpretation of data, and contributed to the drafting and revising of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Howard L. Kaufman.

Ethics declarations

Ethics approval and consent to participate

This was a retrospective exploratory evaluation of outcomes in the OPTiM study and, as such, ethical approval was not required to conduct this analysis. Clinical outcomes in the primary analysis of the OPTiM have been reported elsewhere [15]. As previously described, all patients provided their written informed consent to participate in the clinical study and study procedures were conducted in accordance with the ethical principles founded in the Declaration of Helsinki, as well as the demands of the national drug and data protection laws and any other applicable regulatory requirements. Approval was obtained from the appropriate regulatory authorities of each participating country before sites were initiated. The study protocol was approved by an institutional review board (IRB)/independent ethics committee (IEC) at each participating institution, and all patients provided written informed consent before initiating any study procedures.

Consent for publication

Not applicable.

Competing interests

HLK has been a consultant/advisor for BioVex and Amgen; has served as a consultant for EMD Serono, Merck, Prometheus, and Sanofi; receives research funding from Amgen Inc., Bristol-Myers Squibb, EMD Serono, Merck, Prometheus, and Viralytics; has received compensation from Compass Therapeutics; and serves on a speaker’s bureau for Merck and returns all honoraria to Rutgers University. RHIA has received honoraria from Amgen. FAC has received research funding from Amgen, Bristol-Myers Squibb, Novartis, and Morphotek; and has been a consultant to Amgen. IP has been a steering committee member and advisory board member for Amgen. MR has received honoraria from, been an advisory board member, and been a paid consultant to Merck, Provectus, GSK, and Amgen; and has received honoraria from Merck, Provectus, GSK, and Amgen. MW, ZZ, and MS are employees of and stock holders in Amgen Inc.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

Table S1. TOI Improvement Rate Association with Achievement of a DR (per EAC). Figure S1. Talimogene laherparepvec Duration of Response (per Investigator). As of the final analysis 93 of 295 patients (31.5%) randomized to talimogene laherparepvec had an overall response per investigator assessment (complete response, n = 50; partial response, n = 43) and 57 patients (19.3%) had a durable response. (ZIP 1510 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Kaufman, H.L., Andtbacka, R.H.I., Collichio, F.A. et al. Durable response rate as an endpoint in cancer immunotherapy: insights from oncolytic virus clinical trials. j. immunotherapy cancer 5, 72 (2017). https://doi.org/10.1186/s40425-017-0276-8

Download citation

Keywords

  • Melanoma
  • Talimogene laherparepvec
  • Durable response rate
  • Patient-reported outcomes