Repository navigation
Add Claude Fable 5.1 and GLM 5.3 Flash runs - #7
Merged
Merged
Conversation
ardecvz
commented
Sep 2, 2026
Collaborator
- Claude Fable 5.1, 63 runs on the 21 atomic tasks
- GLM 5.3 Flash, 63 runs under its real name (the ox-alpha stealth runs are kept for the record)
Co-authored-by: Vladimir Dementyev <dementiev.vm@gmail.com>
There was a problem hiding this comment.
🟢 Approval recommended
The change set is additive run data with complete per-run artifacts and consistent directory structure matching the stated scope (21 tasks × 3 runs per model).
Pull request overview
Adds a new run set under runs/2026-09-01-atomic-tasks-fable-5-1-and-glm-5-3-flash/ capturing 63 executions (21 atomic tasks × 3 runs) for each of the two models: Claude Fable 5.1 and GLM 5.3 Flash. This fits the repository’s pattern of checking in run artifacts (checks.json, verifier.log, result.json, trajectory.json, agent.patch) to preserve evaluation results and reproduction context.
Changes:
- Add 63 atomic-task run artifact directories for
claude-fable-5.1. - Add 63 atomic-task run artifact directories for
glm-5.3-flash(under the model’s real name as described). - Include per-run verifier logs and structured check outcomes (including failed checks where they occurred) for traceability.
File summaries
| File | Description |
|---|---|
| runs/2026-09-01-atomic-tasks-fable-5-1-and-glm-5-3-flash/claude-fable-5.1/ | Adds the Claude Fable 5.1 atomic-task run artifacts (21 tasks × 3 runs). |
| runs/2026-09-01-atomic-tasks-fable-5-1-and-glm-5-3-flash/glm-5.3-flash/ | Adds the GLM 5.3 Flash atomic-task run artifacts (21 tasks × 3 runs) under the model’s real name. |
Review details
- Files reviewed: 56/692 changed files
- Comments generated: 0
- Review effort level: Lite
💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.