TY - JOUR
T1 - Improving early clinical trial phase identification of promising therapeutics
AU - Kent, Thomas A.
AU - Shah, Shreyansh D.
AU - Mandava, Pitchaiah
PY - 2015/1/1
Y1 - 2015/1/1
N2 - This review addresses decision-making underlying the frequent failure to confirm early-phase positive trial results and how to prioritize which early agents to transition to late phase. While unexpected toxicity is sometimes responsible for late-phase failures, lack of efficacy is also frequently found. In stroke as in other conditions, early trials often demonstrate imbalances in factors influencing outcome. Other issues complicate early trial analysis, including unequally distributed noise inherent in outcome measures and variations in natural history among studies. We contend that statistical approaches to correct for imbalances and noise, while likely valid for homogeneous conditions, appear unable to accommodate disease complexity and have failed to correctly identify effective agents. While blinding and randomization are important to reduce selection bias, these methods appear insufficient to insure valid conclusions. We found potential sources of analytical errors in nearly 90% of a sample of early stroke trials. To address these issues, we recommend changes in early-phase analysis and reporting: (1) restrict use of statistical correction to studies where the underlying assumptions are validated, (2) select dichotomous over continuous outcomes for small samples, (3) consider pooled samples to model natural history to detect early therapeutic signals and increase the likelihood of replication in larger samples, (4) report subgroup baseline conditions, (5) consider post hoc methods to restrict analysis to subjects with an appropriate match, and (6) increase the strength of effect threshold given these cumulative sources of noise and potential errors. More attention to these issues should lead to better decision-making regarding selection of agents to proceed to pivotal trials.
AB - This review addresses decision-making underlying the frequent failure to confirm early-phase positive trial results and how to prioritize which early agents to transition to late phase. While unexpected toxicity is sometimes responsible for late-phase failures, lack of efficacy is also frequently found. In stroke as in other conditions, early trials often demonstrate imbalances in factors influencing outcome. Other issues complicate early trial analysis, including unequally distributed noise inherent in outcome measures and variations in natural history among studies. We contend that statistical approaches to correct for imbalances and noise, while likely valid for homogeneous conditions, appear unable to accommodate disease complexity and have failed to correctly identify effective agents. While blinding and randomization are important to reduce selection bias, these methods appear insufficient to insure valid conclusions. We found potential sources of analytical errors in nearly 90% of a sample of early stroke trials. To address these issues, we recommend changes in early-phase analysis and reporting: (1) restrict use of statistical correction to studies where the underlying assumptions are validated, (2) select dichotomous over continuous outcomes for small samples, (3) consider pooled samples to model natural history to detect early therapeutic signals and increase the likelihood of replication in larger samples, (4) report subgroup baseline conditions, (5) consider post hoc methods to restrict analysis to subjects with an appropriate match, and (6) increase the strength of effect threshold given these cumulative sources of noise and potential errors. More attention to these issues should lead to better decision-making regarding selection of agents to proceed to pivotal trials.
UR - http://www.scopus.com/inward/record.url?scp=84937722381&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84937722381&partnerID=8YFLogxK
U2 - 10.1212/WNL.0000000000001757
DO - 10.1212/WNL.0000000000001757
M3 - Review article
C2 - 26109712
AN - SCOPUS:84937722381
SN - 0028-3878
VL - 85
SP - 274
EP - 283
JO - Neurology
JF - Neurology
IS - 3
ER -