Repository navigation
Frontier AI tutorials, and SkyRL moves into Reinforcement learning - #1949
Merged
Merged
Conversation
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
…oth variants Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
…ideo curation, sparse autoencoders, closed-loop discovery The section index now frames frontier AI by the workloads labs run day to day, with a table of who does each one and what makes it hard at scale. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
…nfra to the SkyRL redirects Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
cosmicbboy
requested review from
EngHabu,
kumare3,
ppiegaze and
samhita-alla
as code owners
November 8, 2026 19:17
GHA build & deploy previewBuilt by
Updated automatically on every push. |
cosmicbboy
added a commit
that referenced
this pull request
Nov 10, 2026
…design, self-play league (#1938) * Reinforcement learning tutorials: humanoid locomotion, Eureka reward design, self-play league Add three tutorials to the Reinforcement learning section, each validated end to end on a Union cluster, with report and artifact screenshots from the validated runs: - Teach a humanoid to run: Brax PPO over MuJoCo MJX, 8,192 G1 robots on one GPU. - Reward design with Claude and sandboxes: an Eureka-style reward search with every candidate trained in a unionai-sandbox session. - Self-play league for Connect Four: a league of past snapshots, Elo, caching, and an app to play the champion. Rewrite the section index with a comparison table, update the tutorials index card, and link the new tutorials from the user guide. Point unionai-examples at the commit that adds the examples (unionai/unionai-examples#348). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * Reinforcement learning tutorials: match each card to its page description Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * Frontier AI tutorials, and SkyRL moves into Reinforcement learning (#1949) * Move the SkyRL tutorial into Reinforcement learning (rename only) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * Reinforcement learning: list the SkyRL tutorial in the section, for both variants Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * Frontier AI tutorials: pretraining data refinery, checkpoint evals, video curation, sparse autoencoders, closed-loop discovery The section index now frames frontier AI by the workloads labs run day to day, with a table of who does each one and what makes it hard at scale. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * Bump unionai-examples to the Frontier AI tutorials and unionai-docs-infra to the SkyRL redirects Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> --------- Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com> --------- Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Reorganizes the tutorials so that Reinforcement learning holds every RL tutorial and Frontier AI covers the workloads frontier AI labs run day to day. Adds five Frontier AI tutorials, each validated end to end on a Union cluster.
Stacked on #1938 (the reinforcement learning tutorials): merge that first.
SkyRL moves into Reinforcement learning
tutorials/frontier-ai/agentic-rl-skyrlis nowtutorials/reinforcement-learning/agentic-rl-skyrl. The move is a rename-only commit, and the user-guide links are updated.New Frontier AI tutorials. The section index now opens with the three kinds of work these labs do (data factories, decisions from many small runs, continuous measurement) and a table of who does each workload.
OnArtifacttrigger runs a cached benchmark suite on each oneProcess
Pointers. The
unionai-examplespointer moves to the commit in unionai/unionai-examples#349, andunionai-docs-infrato the commit in unionai/unionai-docs-infra#363. Both should move to their repos'mainonce those PRs merge.Checks. markdownlint, cspell,
make check-links,check-images,check-subpage-cards,check-icon-namesandcheck-deleted-pagespass, andmake distbuilds both variants.🤖 Generated with Claude Code