Repository navigation
Add a Speculative decoding models tutorial section - #1936
Merged
Merged
Conversation
A new top-level tutorial section with five pages: train an EAGLE-3 draft head, train a DFlash block drafter, train a DSpark drafter, benchmark every family against no speculation and draft-free methods, and serve and retrain the drafters nightly on an agent's traces. Union-only parts (artifacts with model and data cards, rollback) are gated. Bumps unionai-examples to the head of unionai/unionai-examples#347, which is stacked on #343, the commit this repo already pins. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
Points at the merge of unionai/unionai-examples#347 into niels/training-rl (281fba1), which also carries #343. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
GHA build & deploy previewBuilt by
Updated automatically on every push. |
Speedup, acceptance length, prefix agreement against the noise floor, and GSM8K accuracy for all eight configurations across chat, agent, and math. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
cosmicbboy
marked this pull request as ready for review
November 7, 2026 08:55
cosmicbboy
requested review from
EngHabu,
kumare3,
ppiegaze and
samhita-alla
as code owners
November 7, 2026 08:55
Training reports for EAGLE-3, DFlash, and DSpark, the dataset report, and the benchmark reports. Correct the DFlash page's claim that its first-position accuracy is close to EAGLE-3's: it was 78% against 95%. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
The speculative decoding examples merged to main with #343. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
…reenshots From a validation pass: 250 agent episodes through the EAGLE-3 app, then one retrain cycle, whose gate kept the current head. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds Tutorials › Speculative decoding models, a new top-level section with a flat list of five pages:
speculatorsin online mode.flyte.trace, and retrains each family nightly, promoting a candidate only when its acceptance length improves.The landing page explains speculative decoding, compares the three families, and lists what Flyte and Union provide. Union-only parts are gated: artifacts with model and data cards, and rollback.
Code: unionai/unionai-examples#347, merged into
niels/training-rl(#343's branch). The submodule pointer moves to that merge commit,281fba1, which contains the #343 commitmainalready pins, so the existing model-training pages keep their examples.Status: draft until the full benchmark run finishes
The full cross-family run is running on demo.hosted.unionai.cloud. Its numbers go into a results section on the benchmark page before this leaves draft. Smoke runs of every pipeline pass end to end on one L40S per task.
Checks run locally
make check-links,check-subpage-cards,check-icon-names: passcheck_heading_shortcodes.py, cspell, markdownlint: passmake variant VARIANT=unionandVARIANT=flyte: both build with no errors or warnings, and the Union-only sections are absent from the Flyte variant and its Markdown twins.Merge order
Speculative decoding models: train, benchmark, serve, and retrain EAGLE-3, DFlash, and DSpark drafters unionai-examples#347: merged intoniels/training-rl.main.281fba1asmainis pinned to aniels/training-rlcommit today. Bump the pointer to examplesmainafterwards.🤖 Generated with Claude Code