Trial Design Optimizer — Engineering the Experiment That Answers the Right Question
Trial design is where clinical development budgets are won or lost. A well-designed Phase 2 with an adaptive enrichment strategy can deliver the same signal as a conventional Phase 3 at one-third the cost. A poorly designed pivotal trial burns $150-300M and 3-4 years before delivering an uninterpretable result. The physician-scientist's edge in venture is recognizing design flaws that financial analysts cannot see: an inadequate run-in period, a composite endpoint that dilutes signal, a control arm that will be obsolete by readout.
Trial-cost benchmarks: for per-phase / per-patient trial cost and SCA/platform savings, use cost-estimator's references/development-cost-benchmarks.md rather than a separate table here.
ICH E9 R1 Estimand Framework
Every modern trial design begins with the estimand — the precise question the trial is designed to answer. ICH E9 R1 (2019) formalized this into five attributes that must be specified before choosing a statistical method:
| Attribute |
Definition |
Design Implication |
| Population |
Who is the target patient? |
Inclusion/exclusion criteria, enrichment strategy |
| Treatment |
What treatment regimen? |
Dose, duration, combination rules |
| Endpoint |
What variable is measured? |
Primary endpoint selection (see endpoint-selection skill) |
| Intercurrent events |
What happens that affects interpretation? |
Treatment switching, rescue medication, discontinuation |
| Population-level summary |
What statistical measure? |
Mean difference, hazard ratio, responder rate |
The intercurrent events strategy is where most trial designs fail in venture diligence. Five strategies exist:
- Treatment policy — analyze all patients regardless of what happens (ITT). Use when: the real-world question is "what happens if I prescribe this drug?"
- Composite — incorporate the intercurrent event into the endpoint. Use when: discontinuation due to AEs is itself informative.
- Hypothetical — estimate what would have happened without the intercurrent event. Use when: treatment switching confounds OS.
- Principal stratum — analyze only patients who would not experience the intercurrent event. Use when: adherent subpopulations are of interest.
- While on treatment — only measure while patients remain on treatment. Use when: pharmacodynamic endpoints matter.
Adaptive Design Taxonomy
| Design Type |
Mechanism |
Best For |
Regulatory Acceptance |
| Group Sequential |
Pre-planned interim analyses with stopping rules |
Efficacy/futility early stopping |
Well-accepted; FDA Guidance 2019 |
| Sample Size Re-estimation (SSR) |
Adjust N at interim based on variance |
Uncertain effect size |
Accepted if blinded; unblinded SSR requires justification |
| Adaptive Randomization |
Shift allocation toward better-performing arms |
Multi-arm dose-finding |
Accepted in Phase 2; less common Phase 3 |
| Adaptive Enrichment |
Restrict enrollment to responsive subgroup at interim |
Biomarker-driven oncology |
Increasingly accepted; KEYNOTE-042 model |
| MAMS (Multi-Arm Multi-Stage) |
Multiple experimental arms, dropping losers at interim stages |
Platform trials, dose-finding |
Strong precedent (RECOVERY, STAMPEDE) |
| Bayesian Adaptive |
Continuous updating of posterior probability |
Rare disease, pediatric, device |
FDA receptive; requires strong prior justification |
| Platform Trial |
Perpetual protocol, arms added/dropped dynamically |
Pandemic response, oncology master protocols |
RECOVERY trial validated; I-SPY 2 model |
Platform Trial Architecture
Platform trials (I-SPY 2, RECOVERY, GBM AGILE) represent the most capital-efficient trial design innovation in a decade:
- Shared control arm: 50-70% reduction in control patients needed across arms
- Bayesian adaptive randomization: shift enrollment to arms showing signal
- Seamless Phase 2/3: graduate arms directly to registration
- Cost efficiency: $15-25M per arm vs $50-100M for standalone trials
- Speed: 6-12 months to initial signal vs 18-24 months conventional
Basket, Umbrella, and Master Protocols
| Design |
Structure |
Example |
When to Use |
| Basket |
One drug, multiple tumor types sharing a biomarker |
Larotrectinib (NTRK+ tumors), vemurafenib (BRAF V600E) |
Targeted therapy with tumor-agnostic mechanism |
| Umbrella |
One disease, multiple biomarker-drug pairs |
Lung-MAP (NSCLC), ALCHEMIST |
When multiple actionable biomarkers exist in one disease |
| Platform |
Perpetual protocol, any drug can enter/exit |
I-SPY 2 (breast cancer), RECOVERY (COVID-19) |
When many candidates need testing efficiently |
Synthetic Control Arm (SCA) Decision Engine
Synthetic control arms using real-world data (RWD) represent the highest-impact innovation in trial design economics. When appropriate, they can save $100-200M in development costs and accelerate enrollment by 30%.
SCA Appropriateness Decision Tree
START: Is there a well-established standard of care?
|
YES --> Is the natural history well-characterized with existing data?
| |
| YES --> Are primary endpoints objective and measurable in RWD?
| | |
| | YES --> Is the patient population identifiable in RWD sources?
| | | |
| | | YES --> SCA FEASIBLE: Proceed to data quality assessment
| | | NO --> SCA NOT RECOMMENDED: population matching impossible
| | NO --> SCA NOT RECOMMENDED: endpoint not capturable in RWD
| NO --> SCA NOT RECOMMENDED: insufficient historical context
|
NO --> Is this a single-arm trial in severe/rare disease?
|
YES --> SCA STRONGLY RECOMMENDED (FDA/EMA precedent in rare disease)
NO --> SCA NOT RECOMMENDED: randomized control required
SCA Data Quality Requirements
| Criterion |
Minimum Standard |
Gold Standard |
| Sample size |
2:1 external:treated ratio |
5:1 or greater |
| Data recency |
Within 5 years of trial enrollment |
Concurrent with trial period |
| Endpoint capture |
Primary endpoint measurable |
Primary + key secondaries |
| Covariate overlap |
Key prognostic factors available |
Full propensity score matching |
| Data source |
Single registry or EHR system |
Multiple linked sources (Flatiron, Tempus, Optum) |
Regulatory Precedent for SCAs
- Bavencio (avelumab): FDA accepted external control for urothelial carcinoma maintenance
- Zolgensma (onasemnogene): SMA natural history as external comparator
- Blincyto (blinatumomab): Historical control for ALL accelerated approval
- FDA Draft Guidance (2023): Framework for using RWD/RWE in regulatory decision-making
- EMA Qualification: DARWIN EU platform for population-level RWD studies
Cost-Benefit Analysis
| Parameter |
Traditional RCT |
SCA-Augmented Design |
| Control arm enrollment |
100% randomized |
0-50% randomized + external |
| Per-patient cost (control) |
$40,000-80,000 |
$5,000-15,000 (data licensing) |
| Enrollment timeline |
18-36 months |
12-24 months |
| Total savings potential |
Baseline |
$50-200M depending on indication |
| Regulatory risk |
Low |
Moderate (mitigated by pre-submission FDA dialogue) |
Sample Size Estimation Logic
Key Inputs for Power Calculation
- Primary endpoint type: continuous, binary, time-to-event
- Expected effect size: informed by Phase 2 data, competitor data, or mechanism
- Alpha level: typically 0.025 one-sided (0.05 two-sided)
- Power: 80% (minimum), 90% (preferred for pivotal)
- Dropout rate: 10-30% depending on disease and duration
- Interim analysis penalty: alpha spending function (O'Brien-Fleming, Lan-DeMets)
Rules of Thumb for Venture Diligence
- If a company claims <200 patients for a pivotal trial in a non-orphan indication, interrogate the assumptions
- Adaptive enrichment can reduce required N by 30-50% but introduces operational complexity
- Time-to-event trials: the number of events, not patients, drives power
- Bayesian designs can achieve equivalent evidence with 20-30% fewer patients but require regulatory pre-agreement
Structured Output Format
When generating a trial design recommendation, output:
TRIAL DESIGN RECOMMENDATION
============================
Therapeutic Hypothesis: [one-sentence hypothesis]
Development Stage: [Phase 1b/2/2b/3]
Target Population: [population definition]
ESTIMAND:
Population: [target population]
Treatment: [regimen]
Endpoint: [primary endpoint]
Intercurrent Event Strategy: [strategy + rationale]
Summary Measure: [statistical measure]
RECOMMENDED DESIGN:
Type: [conventional/adaptive/platform/basket]
Adaptive Features: [if applicable]
Estimated N: [sample size with assumptions]
Control Arm: [active comparator/placebo/synthetic/external]
Key Interim Analyses: [timing and decision rules]
SYNTHETIC CONTROL ASSESSMENT:
Feasibility: [feasible/not recommended]
Rationale: [3-4 sentences]
Potential Savings: [$X-YM]
Regulatory Risk: [low/moderate/high]
DESIGN RISKS:
1. [Risk + mitigation]
2. [Risk + mitigation]
3. [Risk + mitigation]
TIMELINE ESTIMATE: [months to primary endpoint readout]
BUDGET ESTIMATE: [range based on design parameters]
Cross-Domain Connections
- Biotech-venture/endpoint-selection: Endpoint choice drives trial design parameters — an OS endpoint requires fundamentally different design than a surrogate
- Biotech-venture/biomarker-enrichment: Enrichment strategies affect design complexity, adding adaptive elements and modifying sample size requirements
- Biotech-venture/cost-estimator: Trial design directly determines development costs — adaptive designs, platform trials, and SCAs each have distinct cost profiles
- Research/spelunker: Deep research on regulatory precedent for novel trial designs, synthetic control arm acceptance, and adaptive methodology
1---2name: trial-design-optimizer3description: Generate optimized clinical trial designs given a therapeutic hypothesis, target population, and development stage. Incorporates adaptive designs, modern estimand frameworks, and synthetic control arm feasibility assessment. Reference when evaluating whether a company's trial design maximizes probability of success while minimizing cost and timeline, or when designing de novo studies for platform companies.4---56# Trial Design Optimizer — Engineering the Experiment That Answers the Right Question78Trial design is where clinical development budgets are won or lost. A well-designed Phase 2 with an adaptive enrichment strategy can deliver the same signal as a conventional Phase 3 at one-third the cost. A poorly designed pivotal trial burns $150-300M and 3-4 years before delivering an uninterpretable result. The physician-scientist's edge in venture is recognizing design flaws that financial analysts cannot see: an inadequate run-in period, a composite endpoint that dilutes signal, a control arm that will be obsolete by readout.910> **Trial-cost benchmarks:** for per-phase / per-patient trial cost and SCA/platform savings, use cost-estimator's `references/development-cost-benchmarks.md` rather than a separate table here.1112## ICH E9 R1 Estimand Framework1314Every modern trial design begins with the estimand — the precise question the trial is designed to answer. ICH E9 R1 (2019) formalized this into five attributes that must be specified before choosing a statistical method:1516| Attribute | Definition | Design Implication |17|---|---|---|18| **Population** | Who is the target patient? | Inclusion/exclusion criteria, enrichment strategy |19| **Treatment** | What treatment regimen? | Dose, duration, combination rules |20| **Endpoint** | What variable is measured? | Primary endpoint selection (see endpoint-selection skill) |21| **Intercurrent events** | What happens that affects interpretation? | Treatment switching, rescue medication, discontinuation |22| **Population-level summary** | What statistical measure? | Mean difference, hazard ratio, responder rate |2324The intercurrent events strategy is where most trial designs fail in venture diligence. Five strategies exist:25261. **Treatment policy** — analyze all patients regardless of what happens (ITT). Use when: the real-world question is "what happens if I prescribe this drug?"272. **Composite** — incorporate the intercurrent event into the endpoint. Use when: discontinuation due to AEs is itself informative.283. **Hypothetical** — estimate what would have happened without the intercurrent event. Use when: treatment switching confounds OS.294. **Principal stratum** — analyze only patients who would not experience the intercurrent event. Use when: adherent subpopulations are of interest.305. **While on treatment** — only measure while patients remain on treatment. Use when: pharmacodynamic endpoints matter.3132## Adaptive Design Taxonomy3334| Design Type | Mechanism | Best For | Regulatory Acceptance |35|---|---|---|---|36| **Group Sequential** | Pre-planned interim analyses with stopping rules | Efficacy/futility early stopping | Well-accepted; FDA Guidance 2019 |37| **Sample Size Re-estimation (SSR)** | Adjust N at interim based on variance | Uncertain effect size | Accepted if blinded; unblinded SSR requires justification |38| **Adaptive Randomization** | Shift allocation toward better-performing arms | Multi-arm dose-finding | Accepted in Phase 2; less common Phase 3 |39| **Adaptive Enrichment** | Restrict enrollment to responsive subgroup at interim | Biomarker-driven oncology | Increasingly accepted; KEYNOTE-042 model |40| **MAMS (Multi-Arm Multi-Stage)** | Multiple experimental arms, dropping losers at interim stages | Platform trials, dose-finding | Strong precedent (RECOVERY, STAMPEDE) |41| **Bayesian Adaptive** | Continuous updating of posterior probability | Rare disease, pediatric, device | FDA receptive; requires strong prior justification |42| **Platform Trial** | Perpetual protocol, arms added/dropped dynamically | Pandemic response, oncology master protocols | RECOVERY trial validated; I-SPY 2 model |4344### Platform Trial Architecture4546Platform trials (I-SPY 2, RECOVERY, GBM AGILE) represent the most capital-efficient trial design innovation in a decade:4748- **Shared control arm**: 50-70% reduction in control patients needed across arms49- **Bayesian adaptive randomization**: shift enrollment to arms showing signal50- **Seamless Phase 2/3**: graduate arms directly to registration51- **Cost efficiency**: $15-25M per arm vs $50-100M for standalone trials52- **Speed**: 6-12 months to initial signal vs 18-24 months conventional5354## Basket, Umbrella, and Master Protocols5556| Design | Structure | Example | When to Use |57|---|---|---|---|58| **Basket** | One drug, multiple tumor types sharing a biomarker | Larotrectinib (NTRK+ tumors), vemurafenib (BRAF V600E) | Targeted therapy with tumor-agnostic mechanism |59| **Umbrella** | One disease, multiple biomarker-drug pairs | Lung-MAP (NSCLC), ALCHEMIST | When multiple actionable biomarkers exist in one disease |60| **Platform** | Perpetual protocol, any drug can enter/exit | I-SPY 2 (breast cancer), RECOVERY (COVID-19) | When many candidates need testing efficiently |6162## Synthetic Control Arm (SCA) Decision Engine6364Synthetic control arms using real-world data (RWD) represent the highest-impact innovation in trial design economics. When appropriate, they can save $100-200M in development costs and accelerate enrollment by 30%.6566### SCA Appropriateness Decision Tree6768```69START: Is there a well-established standard of care?70 |71 YES --> Is the natural history well-characterized with existing data?72 | |73 | YES --> Are primary endpoints objective and measurable in RWD?74 | | |75 | | YES --> Is the patient population identifiable in RWD sources?76 | | | |77 | | | YES --> SCA FEASIBLE: Proceed to data quality assessment78 | | | NO --> SCA NOT RECOMMENDED: population matching impossible79 | | NO --> SCA NOT RECOMMENDED: endpoint not capturable in RWD80 | NO --> SCA NOT RECOMMENDED: insufficient historical context81 |82 NO --> Is this a single-arm trial in severe/rare disease?83 |84 YES --> SCA STRONGLY RECOMMENDED (FDA/EMA precedent in rare disease)85 NO --> SCA NOT RECOMMENDED: randomized control required86```8788### SCA Data Quality Requirements8990| Criterion | Minimum Standard | Gold Standard |91|---|---|---|92| **Sample size** | 2:1 external:treated ratio | 5:1 or greater |93| **Data recency** | Within 5 years of trial enrollment | Concurrent with trial period |94| **Endpoint capture** | Primary endpoint measurable | Primary + key secondaries |95| **Covariate overlap** | Key prognostic factors available | Full propensity score matching |96| **Data source** | Single registry or EHR system | Multiple linked sources (Flatiron, Tempus, Optum) |9798### Regulatory Precedent for SCAs99100- **Bavencio (avelumab)**: FDA accepted external control for urothelial carcinoma maintenance101- **Zolgensma (onasemnogene)**: SMA natural history as external comparator102- **Blincyto (blinatumomab)**: Historical control for ALL accelerated approval103- **FDA Draft Guidance (2023)**: Framework for using RWD/RWE in regulatory decision-making104- **EMA Qualification**: DARWIN EU platform for population-level RWD studies105106### Cost-Benefit Analysis107108| Parameter | Traditional RCT | SCA-Augmented Design |109|---|---|---|110| Control arm enrollment | 100% randomized | 0-50% randomized + external |111| Per-patient cost (control) | $40,000-80,000 | $5,000-15,000 (data licensing) |112| Enrollment timeline | 18-36 months | 12-24 months |113| Total savings potential | Baseline | $50-200M depending on indication |114| Regulatory risk | Low | Moderate (mitigated by pre-submission FDA dialogue) |115116## Sample Size Estimation Logic117118### Key Inputs for Power Calculation1191201. **Primary endpoint type**: continuous, binary, time-to-event1212. **Expected effect size**: informed by Phase 2 data, competitor data, or mechanism1223. **Alpha level**: typically 0.025 one-sided (0.05 two-sided)1234. **Power**: 80% (minimum), 90% (preferred for pivotal)1245. **Dropout rate**: 10-30% depending on disease and duration1256. **Interim analysis penalty**: alpha spending function (O'Brien-Fleming, Lan-DeMets)126127### Rules of Thumb for Venture Diligence128129- If a company claims <200 patients for a pivotal trial in a non-orphan indication, interrogate the assumptions130- Adaptive enrichment can reduce required N by 30-50% but introduces operational complexity131- Time-to-event trials: the number of events, not patients, drives power132- Bayesian designs can achieve equivalent evidence with 20-30% fewer patients but require regulatory pre-agreement133134## Structured Output Format135136When generating a trial design recommendation, output:137138```139TRIAL DESIGN RECOMMENDATION140============================141Therapeutic Hypothesis: [one-sentence hypothesis]142Development Stage: [Phase 1b/2/2b/3]143Target Population: [population definition]144145ESTIMAND:146 Population: [target population]147 Treatment: [regimen]148 Endpoint: [primary endpoint]149 Intercurrent Event Strategy: [strategy + rationale]150 Summary Measure: [statistical measure]151152RECOMMENDED DESIGN:153 Type: [conventional/adaptive/platform/basket]154 Adaptive Features: [if applicable]155 Estimated N: [sample size with assumptions]156 Control Arm: [active comparator/placebo/synthetic/external]157 Key Interim Analyses: [timing and decision rules]158159SYNTHETIC CONTROL ASSESSMENT:160 Feasibility: [feasible/not recommended]161 Rationale: [3-4 sentences]162 Potential Savings: [$X-YM]163 Regulatory Risk: [low/moderate/high]164165DESIGN RISKS:166 1. [Risk + mitigation]167 2. [Risk + mitigation]168 3. [Risk + mitigation]169170TIMELINE ESTIMATE: [months to primary endpoint readout]171BUDGET ESTIMATE: [range based on design parameters]172```173174## Cross-Domain Connections175176- **Biotech-venture/endpoint-selection**: Endpoint choice drives trial design parameters — an OS endpoint requires fundamentally different design than a surrogate177- **Biotech-venture/biomarker-enrichment**: Enrichment strategies affect design complexity, adding adaptive elements and modifying sample size requirements178- **Biotech-venture/cost-estimator**: Trial design directly determines development costs — adaptive designs, platform trials, and SCAs each have distinct cost profiles179- **Research/spelunker**: Deep research on regulatory precedent for novel trial designs, synthetic control arm acceptance, and adaptive methodology