Evaluation / Manuscript results

Benchmark results

Two dynamics tasks, complementary test splits. Binding transfer is reported separately.

These tables reproduce a local manuscript snapshot. Public checkpoint, evaluator version and runnable evaluation package: Coming soon. No community ranking is implied.
Trajectory generationSingle-conformer predictionBinding transfer

Trajectory generation

Input: an initial conformer. Output: 101 coordinate frames over 100 ns. Geometry metrics use future 100 frames; RMSF uses all 101. Aggregate within RNA first, then across RNAs.

test_struct

MethodKBond MAE ↓O3′–P max ↓Chiral flip (%) ↓Clash / 1k ↓RMSF r ↑PCA W₂ ↓Time / trajectory
Reference—0.033080.1938000.98190.72958.1 h
ConfRover10.19315120.47470.03103581.45200.06669.3105340.4s
MDGen40.0802415.14880.0310395.93980.37372.42007.2s
BioKinema40.026124.46820.038362.07460.87701.927640.2s
w/o PG40.024182.44550.030971.18840.85941.9085/
RNADynNet40.024241.88580.030850.82250.87461.873924.5s

test_flex

MethodKBond MAE ↓O3′–P max ↓Chiral flip (%) ↓Clash / 1k ↓RMSF r ↑PCA W₂ ↓Time / trajectory
Reference—0.033070.1966000.96333.113713.9h
ConfRover10.16506133.04200419.78480.228811.1922501.5s
MDGen40.1078618.9945mathbf{<10^{-588.90580.29948.928211.0s
BioKinema40.029508.35860.020125.82410.75365.940647.8s
w/o PG40.025559.11710.001602.84160.74406.1744/
RNADynNet40.025674.24000.000933.04040.76585.916932.9s

Distances in Å. Generation runtimes measured per trajectory on H200. Reference rows report MD quantities.

Single-conformer dynamics prediction

Input: one conformer. Output: per-residue covariance, RMSF and normalized motion coupling (NMC). † identifies independently trained probes on frozen representations; other learned-model rows use direct predictors.

test_struct

MethodRMSF r ↑RMSF MAE ↓Cov. RMWD ↓Cov. sym. KL ↓Cov. IoU ↑NMC r ↑NMC MAE ↓
MD reference0.87550.37700.79600.55250.54970.85320.1462
RNA-FM †0.29391.61882.11734.98680.17310.36900.2644
Geometry-GNN0.28011.12411.57962.86620.25610.48210.2591
RNA-FM+2D GCN0.12572.01172.63038.59140.18310.47970.2569
BackFlip0.80980.46080.94490.75990.49190.79480.1707
DynaProt0.77260.52660.97860.82880.45020.24540.2775
w/o align. and PG †0.74730.60561.07560.98270.39660.79240.1717
w/o PG †0.77970.51600.98390.75420.45400.78340.1744
RNADynNet †0.86260.40760.87410.58230.52760.79580.1694
RNADynNet0.86650.39830.86510.57430.52600.81150.1629

test_flex

MethodRMSF r ↑RMSF MAE ↓Cov. RMWD ↓Cov. sym. KL ↓Cov. IoU ↑NMC r ↑NMC MAE ↓
MD reference0.75841.64153.55051.34710.41850.75200.2145
RNA-FM †0.20853.81485.03904.23670.23180.36350.2952
Geometry-GNN0.33853.42764.68703.19590.30540.44420.2910
RNA-FM+2D GCN0.15363.55114.83774.93980.26250.53330.2609
BackFlip0.73111.79743.71184.40110.40580.73990.2084
DynaProt0.55182.58613.97571.93980.36920.18890.3132
w/o align. and PG †0.62322.15153.81371.33430.38110.75060.2088
w/o PG †0.69201.89833.58101.10550.40690.74430.2101
RNADynNet †0.77821.75603.33590.87750.45220.75770.2035
RNADynNet0.78271.58003.27000.85330.45280.76140.2027

MD reference compares two non-overlapping 50-ns blocks; model predictions are evaluated against full 100-ns statistics. Native-head and frozen-probe results are distinct.

RNA–ligand binding transfer

RNADynNet exceeds GerNA-Bind in five of eight reported settings. Improvements are not universal.

MethodBiosensor · RandomBiosensor · RNA homologyBiosensor · Ligand fingerprintBiosensor · BothRobin · RandomRobin · RNA homologyRobin · Ligand fingerprintRobin · Both
RSAPred0.87640.75500.67070.60190.63270.53920.63200.4938
DeepDTIs0.93000.83990.68130.61180.63020.55030.62900.4987
DeepConv-DTI0.92490.84270.68940.62130.63010.56250.63900.5104
GraphDTA0.89920.82840.70140.63700.65900.55280.64810.5510
GerNA-Bind0.97550.90140.77230.72790.70940.61880.68140.6176
RNADynNet0.95820.90660.70410.76730.71190.68990.67600.6619

Reproduce the evaluation

Evaluator code, environment, checkpoint identities and runnable examples: Coming soon.

Read the evaluation contract →