Skip to main content
Grant Details

Grant Number: 5R01CA207220-02 Interpret this number
Primary Investigator: Heller, Glenn
Organization: Sloan-Kettering Inst Can Research
Project Title: Inferential Methods to Assess the Incremental Value of New Biomarkers in Risk Classification Models
Fiscal Year: 2018
Back to top


Abstract This proposal aims to develop statistical methods to evaluate improvement in risk classification measures due to the inclusion of new biomarkers. Risk classification modeling has a direct impact on patient treatment and health. These models are used to identify the need for diagnostic testing in the general population, or the type of treatment to be administered in a specified patient population. The most common risk classification improvement measures include the difference in the area under the receiver operating characteristic curve, the net reclassification index, the integrated discrimination improvement, and the difference in sensitivity and specificity. The new statistical methods will provide a metric to decide whether a change in patient risk, stemming from the evaluation of new biomarkers, is random variation or a true improvement in the accuracy of a risk classification model. The metric is defined through asymptotic distribution theory within a nested models framework. Methods to assess improvement in the accuracy of risk models are not well-developed, with current methods relying on classical hypothesis tests of association. These tests may lead to dissonance, since the results of parametric association statistics may not align with the nonparametric risk improvement statistics used in the models being evaluated. The objective of this grant proposal is to develop a coherent statistical inferential strategy that directly measures the incremental value of new biomarkers in risk classification models with binary and survival endpoints. The aims of the proposal are: 1) To develop inferential methods for the difference in concordance probability measures from nested proportional hazards models with a survival endpoint.2) To develop inferential methods for the incremental value of Net Reclassification Index (NRI) and Integrated Discrimination Improvement (IDI) with binary and survival regression models. 3) To develop inferential methods for the incremental value of sensitivity and specificity with binary and survival regression models. Measures of risk classification improvement impact medical decision making. The statistical evaluation of the incremental benefit of a new panel of markers, in relation to clinical measures and laboratory tests that are acquired in the course of routine clinical practice, will play a role in the level of confidence physicians and medical researchers have in updating their medical intervention algorithm.

Back to top


Circulating Tumor Cell Number as a Response Measure of Prolonged Survival for Metastatic Castration-Resistant Prostate Cancer: A Comparison With Prostate-Specific Antigen Across Five Randomized Phase III Clinical Trials.
Authors: Heller G. , McCormack R. , Kheoh T. , Molina A. , Smith M.R. , Dreicer R. , Saad F. , de Wit R. , Aftab D.T. , Hirmand M. , et al. .
Source: Journal Of Clinical Oncology : Official Journal Of The American Society Of Clinical Oncology, 2018-02-20 00:00:00.0; 36(6), p. 572-580.
EPub date: 2017-12-22 00:00:00.0.
PMID: 29272162
Related Citations

Phenotypic Heterogeneity of Circulating Tumor Cells Informs Clinical Decisions between AR Signaling Inhibitors and Taxanes in Metastatic Prostate Cancer.
Authors: Scher H.I. , Graf R.P. , Schreiber N.A. , McLaughlin B. , Jendrisak A. , Wang Y. , Lee J. , Greene S. , Krupa R. , Lu D. , et al. .
Source: Cancer Research, 2017-10-15 00:00:00.0; 77(20), p. 5687-5698.
EPub date: 2017-08-17 00:00:00.0.
PMID: 28819021
Related Citations

Back to Top