Skip to content

feat: add SANA-Video 2.0 four-step preview - #471

Merged
lawrence-cj merged 8 commits into
mainfrom
feat/sana-video2-4step-preview
Sep 9, 2026
Merged

lawrence-cj merged 8 commits into
mainfrom
feat/sana-video2-4step-preview

Conversation

@lawrence-cj

Copy link
Copy Markdown
Collaborator

Summary

  • add the fixed four-stage stochastic sampler used by the SANA-Video 2.0 DMD preview
  • load model-only state_dict_ema exports while preserving the existing checkpoint formats
  • keep the original 50-step T2V/TI2V release path unchanged and add a separate T2V-only 4-step path
  • document the independent preview checkpoint, exact command, online Space, and verified seed-4 demo
  • add the 4-step checkpoint to the SANA-Video 2.0 model zoo; no 14B config is included

Preview checkpoint

The preview is a full-model DMD EMA export at global step 1000, initialized from the merged ReFL step-500 model. It is not a LoRA adapter. The release artifact contains model tensors only and is published separately from the existing 50-step base model.

The sampler uses four fixed sana_shift6_dpm stages, CFG 1, one BF16 initial-noise draw, three BF16 transition-noise draws, 81 frames at 16 FPS, and no motion-score suffix or negative prompt. It currently supports canonical T2V only.

Validation

  • target checkpoint audit: 797 tensors; keys, shapes, element count, and dtypes match the public 5B architecture; no LoRA or training-state keys
  • real target-checkpoint GPU inference: 1280 × 736, 81 frames, 16 FPS, 5.0625 seconds; the four model evaluations completed successfully
  • visual review: 12 evenly spaced frames plus full-resolution start/middle/end frames; no obvious artifact or temporal discontinuity for seed 4
  • pytest -q tests/test_fastvideo_dmd_sampler.py tests/test_sana_video2.py: 16 passed
  • PRE_COMMIT_HOME=/tmp/sana-pr-precommit python -m pre_commit run --all-files: passed
  • Space sampler reference tests: 3 passed

@lawrence-cj lawrence-cj self-assigned this Aug 27, 2026
lawrence-cj and others added 3 commits September 7, 2026 22:13
Co-authored-by: Shuchen Xue <74777491+scxue@users.noreply.github.com>
Co-authored-by: Yuyang Zhao <43061147+HeliosZhao@users.noreply.github.com>
Co-authored-by: Haozhe Liu <53887227+HaozheLiu-ST@users.noreply.github.com>
Co-authored-by: Yitong Li <135998170+lyttttt3333@users.noreply.github.com>
Co-authored-by: Enze Xie <20984575+xieenze@users.noreply.github.com>
Co-authored-by: Jincheng Yu <19924374+loveSy@users.noreply.github.com>
@lawrence-cj
lawrence-cj requested review from HeliosZhao and removed request for HeliosZhao September 9, 2026 08:52
@lawrence-cj
lawrence-cj merged commit d511a8a into main Sep 9, 2026
12 checks passed
@lawrence-cj
lawrence-cj deleted the feat/sana-video2-4step-preview branch September 9, 2026 11:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant