Skip to main content
Grant Details

Grant Number: 5R01CA207220-03 Interpret this number
Primary Investigator: Heller, Glenn
Organization: Sloan-Kettering Inst Can Research
Project Title: Inferential Methods to Assess the Incremental Value of New Biomarkers in Risk Classification Models
Fiscal Year: 2019
Back to top


Abstract This proposal aims to develop statistical methods to evaluate improvement in risk classification measures due to the inclusion of new biomarkers. Risk classification modeling has a direct impact on patient treatment and health. These models are used to identify the need for diagnostic testing in the general population, or the type of treatment to be administered in a specified patient population. The most common risk classification improvement measures include the difference in the area under the receiver operating characteristic curve, the net reclassification index, the integrated discrimination improvement, and the difference in sensitivity and specificity. The new statistical methods will provide a metric to decide whether a change in patient risk, stemming from the evaluation of new biomarkers, is random variation or a true improvement in the accuracy of a risk classification model. The metric is defined through asymptotic distribution theory within a nested models framework. Methods to assess improvement in the accuracy of risk models are not well-developed, with current methods relying on classical hypothesis tests of association. These tests may lead to dissonance, since the results of parametric association statistics may not align with the nonparametric risk improvement statistics used in the models being evaluated. The objective of this grant proposal is to develop a coherent statistical inferential strategy that directly measures the incremental value of new biomarkers in risk classification models with binary and survival endpoints. The aims of the proposal are: 1) To develop inferential methods for the difference in concordance probability measures from nested proportional hazards models with a survival endpoint.2) To develop inferential methods for the incremental value of Net Reclassification Index (NRI) and Integrated Discrimination Improvement (IDI) with binary and survival regression models. 3) To develop inferential methods for the incremental value of sensitivity and specificity with binary and survival regression models. Measures of risk classification improvement impact medical decision making. The statistical evaluation of the incremental benefit of a new panel of markers, in relation to clinical measures and laboratory tests that are acquired in the course of routine clinical practice, will play a role in the level of confidence physicians and medical researchers have in updating their medical intervention algorithm.

Back to top


Error Notice

If you are accessing this page during weekend or evening hours, the database may currently be offline for maintenance and should operational within a few hours. Otherwise, we have been notified of this error and will be addressing it immediately.

Please contact us if this error persists.

We apologize for the inconvenience.
- The DCCPS Team.

Back to Top