Biology & medicine

Protein Design

Generate protein structures for binding and catalytic tasks.

Task & evaluation

Objective
Generate protein backbones for four design settings.
Input
Design constraints and, where applicable, a binding target or active site.
Output
Generated protein backbones for unconditional, binder and enzyme-design tasks.
Data
A curated 51-target RFdiffusion3 benchmark and a dated RCSB development corpus.
Evaluation
Designability and pass rates evaluated with LigandMPNN and RoseTTAFold3.
Research challenge
Satisfy geometry and interaction constraints while producing foldable designs.

Understanding the task

Invent a protein around a molecular constraint, then test whether a sequence can fold back into the intended design.

Invent a protein that can actually hold its shape

Designing a protein starts with a desired structure or function rather than a known sequence. A ligand-binding task supplies a small molecule but no ready-made pocket. An enzyme task supplies catalytic atoms whose arrangement must be preserved. The surrounding protein still has to be invented.

This environment tests one system across four settings: free generation, small-molecule binding, protein binding and enzyme scaffolding. A plausible drawing is only the beginning. Can a sequence be found that folds back into the proposed design?

Start from a real input: a ligand without a pocket

27 SAM heavy atoms and 29 bonds projected from the actual benchmark conditioning file
Actual SAM target from 7c7m: 27 heavy atoms and 29 recorded bonds. This XY projection uses the supplied coordinates; depth and bond order are omitted. No generated scaffold is present in this input.

What must be invented?

A 150-residue protein must be generated around the ligand. The pocket geometry and fold are outputs, not templates. Sequence design then asks which amino acids could realize that geometry.

Enzyme scaffolding instead supplies catalytic atoms; protein binding supplies a target surface and hotspots. These are different conditioning problems for one shared system.

Ligand coordinates · PDB-derived coordinates (CC0); RFdiffusion3 benchmark selection.

Inside the generator, outside the measuring instrument

The generator gradually resolves noisy atoms around fixed constraints. A separate folding model then tests whether a sequence can realize the design.

  1. Condition + noiseMotif, ligand or target atoms held at zero noise; generated atoms perturbed.
  2. Connect atoms and residuesCombine local atomic detail with information about the wider protein.
  3. Conditional denoisingRepeatedly refine the surrounding structure while keeping the supplied constraint fixed.
  4. Generated coordinatesPropose a scaffold that accommodates the fixed molecular geometry.

External assay → 4 inverse-folded sequences → RoseTTAFold3 predictions → track-specific thresholds. A denoising training loss is not the benchmark score.

Build around a constraint, then test the round trip

Interactive 2D schematic. Move the scaffold, then deform its refold: fitting a context and reproducing a fold are different questions. No molecular inference, affinity prediction or benchmark scoring runs here.

1 · Conditional structure

Cyan scaffold · amber constraint
Catalytic anchors and ligand define the fixed context; the surrounding scaffold is editable.

2 · Sequence → refold → compare

LigandMPNN · 4 sequences → RoseTTAFold3

Solid design · dashed toy refold
Alignment removes rigid pose differences, not internal deformation. The toy overlay uses all drawn nodes; the enzyme assay instead aligns motif backbone atoms and measures motif all-atom agreement.

Actual track criterion

Enzyme: motif all-atom RMSD ≤ 1.5 Å after motif-backbone alignment, plus no non-motif N, CA or C atom within 1.5 Å of a ligand atom in the raw design.

Preserving catalytic geometry does not establish catalytic activity. A matching refold is computational evidence, not a functional experiment.

Report four separate target-averaged pass rates and diversity; no composite score. Missing designs remain failures. A design passes if any of four sequences meets its track rule (enzyme also considers five predictor models per sequence).

A computable score example

Illustrative small-molecule design, not a measured result. Each row is one refolded sequence. All four conditions must pass in the same row.

SequenceBackbone RMSD (Å)Ligand RMSD (Å)Interface PAEipTMResult
11.24.01.20.79Fail: ipTM
21.64.01.20.85Fail: backbone
31.25.51.20.85Fail: ligand
41.24.01.80.85Fail: PAE

Design fails: none of its four sequences meets all conditions.

For one target requesting 100 designs, suppose 20 already pass and 10 outputs are missing. Adding this design's verdict gives 20 / 100 = 20%. Missing outputs stay in the denominator. Four small-molecule target rates are then averaged; tracks remain separate.

Diversity is a different fraction: if those 20 passing structures form 5 clusters, target diversity is 5 / 20 = 0.25. It is averaged across targets, with zero assigned when none passes. Duplicating a successful fold can raise pass count without adding a new cluster.

Different constraints leave different freedoms

The real ligand displayed above is a useful example: its atomic coordinates are known, but the protein around it is absent. Protein-binding requests instead provide a target surface and important contact sites. Enzyme requests specify a catalytic arrangement that the new scaffold must accommodate.

Evaluation contains 51 targets and requests 100 designs for each. Development structures come from the Protein Data Bank. Some evaluation structures are old enough to have appeared in upstream design-model training, so these results do not establish generalization to entirely unseen structural families.

Example design requests
Four kinds of design request
Track / countInput exampleDesigned length
Enzyme · 41M0024 / 1nzy: six catalytic residues FAHGWD + BCA ligand; selected atoms constrain the motif180 residues
Small molecule · 4SAM from 7c7m: ligand coordinates only; see the real coordinate projection above150 residues
Protein binder · 5Targets include PD-L1 (5o45) and insulin receptor (4zxb), with hotspots80 residues
Unconditional · 1Synthetic request uncond_L100: only a length100 residues

Grow a structure around fixed atoms

The baseline is a compact RFdiffusion3 model with about 12.4 million learned parameters. During training, it receives disturbed coordinates and learns to recover a structure. Supplied ligand, target or catalytic atoms stay fixed while the surrounding atoms are denoised.

This teaches a relationship between a constraint and a compatible scaffold. Keeping catalytic atoms in place is easier than arranging a whole protein that can support them, however. The design must also be realizable by an amino-acid sequence.

Send the design on a round trip

For every proposed structure, an inverse-folding model suggests four sequences that might realize it. A structure predictor folds those sequences, and the resulting structures are compared with the intended design. Different tracks check overall shape, interface placement or catalytic geometry.

Coordinate discrepancies are measured in ångströms, a tenth of a nanometre. Confidence scores also enter some interface rules, but they are not measured binding affinity. Passing this computational assay does not establish binding or catalytic activity in a laboratory.

Each track reports its own pass rate and diversity. Repeating one successful structure may increase the number of passing designs while adding no new fold; diversity reveals that distinction. Missing designs remain failures.

Technical reference
Computational success criteria by design task
TrackPass condition
UnconditionalBackbone RMSD ≤ 1.5 Å
Small-molecule binderBackbone RMSD ≤ 1.5 Å; ligand RMSD ≤ 5 Å; interface PAE ≤ 1.5; ipTM ≥ 0.8
Protein binderBinder backbone RMSD ≤ 2.0 Å; interface min PAE ≤ 1.5
EnzymeMotif all-atom RMSD ≤ 1.5 Å, plus ligand-clash condition

Free generation is easier than functional design

The author-reported run passes about 42% of unconditional designs, 6% of enzyme designs, 3% of small-molecule binders and 0.2% of protein binders. The final figure is just one passing protein binder out of 500 requests, making relative improvements easy to overstate.

Enzyme success is also concentrated: 28 of 41 targets have no passing designs. All tracks satisfy the supplied conditioning geometry, showing why obeying a geometric constraint is not enough to survive the sequence-and-fold round trip.

The run was not independently reproduced, and repeated training seeds or matched conditioning ablations are unreported. The local assay uses RoseTTAFold3 rather than the original paper’s AlphaFold evaluation, so the rates are not directly comparable.

Reported computational results; passing is not proof of laboratory function
Design taskPass rateDiversity score
Enzyme6.2%0.34
Small-molecule binder2.8%0.75
Protein binder0.2%0.20
Unconditional42.0%1.00

Compute and resources

Training and design assay

Reported measurement

≈460.4 GPU-h
Time
57 h 33 min
Hardware
8 × L40S
GPU allocation
≈460.4 GPU-h

Reported stages for the reference model.

GPU allocation by stage

Generator training
384 GPU-h
Design assay
76.4 GPU-h

Measured training and evaluation only; data preparation is excluded.

Timing and hardware details

Generator training

Reported measurement

384 GPU-h
Time
48 h
Hardware
8 × L40S
GPU allocation
384 GPU-h

Training from random weights for the same baseline evaluated below.

Training and the full assay together account for about 460.4 GPU-hours; data preparation is not included.

Full design assay

Reported measurement

≈76.4 GPU-h
Time
9 h 33 min
Hardware
8 × L40S
GPU allocation
≈76.4 GPU-h

Evaluation of 51 targets with 100 designs each.

Task-author measurement; it does not measure generator training cost.

Find out whether the model uses the constraint

Compare designs made with the correct target against designs made with a shuffled target. Inspect how success varies across individual enzymes, rather than only averaging them. For binders, check whether the intended contact surface is engaged in addition to the scored thresholds.

These experiments would separate learned conditional design from reuse of a few convenient shapes. Improvements should preserve diversity and use comparable generation and refolding budgets.

References and provenance

De novo Design of All-atom Biomolecular Interactions with RFdiffusion3

Motivates conditional all-atom generation; the Foundry implementation supplies the RFD3 generator and RF3 structure predictor.

LigandMPNN

Dauparas et al.

Provides sequence-design tools that take surrounding molecular context into account.

Task definition and experimental evidence

Describes this task’s smaller generator and computational assay. Passing that assay is not evidence of laboratory validation.

Task description and code

Code links require access to the project’s GitHub repository.

Leaderboard

Simulated

Design preview · leaderboard values and research histories are simulated.

Agent search and reference methods ranked together by Design pass rate.
#MethodTypeDesign pass rate ↑Binder success ↑Backbone validity ↑Research timeRun
1Agent search0.66000.49880.660076 h
2Agent search0.65810.49730.658160 h
3RFdiffusion3 (rfd3-small)Reference0.65500.49500.6550——
How to read these leaderboard metrics

These leaderboard values and research histories are simulated design examples. The leaderboard is ranked by Design pass rate. The research curves show relative improvement in this metric over RFdiffusion3 (rfd3-small); only accepted new-best results update the retained trajectory. A positive gain means a better result, with the sign adjusted for metrics where lower is better. The task protocol is described in Task & evaluation above. These preview columns and trajectories are not measured benchmark results and must not be compared with the recorded experiments. The leaderboard and agent-search curves are simulated interface examples. Their generic Design pass rate / Binder success / Backbone validity values are not measured rfd3-small results and are not the official scoring protocol. Real evaluation reports four separate target-averaged pass rates and diversity, with no composite reward. See the author-reported results and exact thresholds below.

Design pass ratePrimary metric · Higher is better
The fraction of generated designs meeting the task’s acceptance criteria. The task-specific verifier determines which properties are required.
Binder successHigher is better
The fraction of binder designs passing the designated evaluation. Computational acceptance should be distinguished from experimental binding validation.
Backbone validityHigher is better
The fraction of generated protein backbones satisfying the task’s geometry and structural-validity checks.