Skip to content

Add Claude Fable 5.1 and GLM 5.3 Flash runs - #7

Merged
skryukov merged 2 commits into
mainfrom
add-claude-fable-5-1-and-glm-5-3-flash-runs
Sep 2, 2026
Merged

skryukov merged 2 commits into
mainfrom
add-claude-fable-5-1-and-glm-5-3-flash-runs

Conversation

@ardecvz

@ardecvz ardecvz commented Sep 2, 2026

Copy link
Copy Markdown
Collaborator
  • Claude Fable 5.1, 63 runs on the 21 atomic tasks
  • GLM 5.3 Flash, 63 runs under its real name (the ox-alpha stealth runs are kept for the record)

ardecvz and others added 2 commits September 2, 2026 12:44
Co-authored-by: Vladimir Dementyev <dementiev.vm@gmail.com>
@ardecvz
ardecvz requested review from skryukov and a lite review from Copilot September 2, 2026 12:49
@skryukov
skryukov merged commit a41f633 into main Sep 2, 2026
1 check passed
@skryukov
skryukov deleted the add-claude-fable-5-1-and-glm-5-3-flash-runs branch September 2, 2026 12:51

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

The change set is additive run data with complete per-run artifacts and consistent directory structure matching the stated scope (21 tasks × 3 runs per model).

Pull request overview

Adds a new run set under runs/2026-09-01-atomic-tasks-fable-5-1-and-glm-5-3-flash/ capturing 63 executions (21 atomic tasks × 3 runs) for each of the two models: Claude Fable 5.1 and GLM 5.3 Flash. This fits the repository’s pattern of checking in run artifacts (checks.json, verifier.log, result.json, trajectory.json, agent.patch) to preserve evaluation results and reproduction context.

Changes:

  • Add 63 atomic-task run artifact directories for claude-fable-5.1.
  • Add 63 atomic-task run artifact directories for glm-5.3-flash (under the model’s real name as described).
  • Include per-run verifier logs and structured check outcomes (including failed checks where they occurred) for traceability.
File summaries
File Description
runs/2026-09-01-atomic-tasks-fable-5-1-and-glm-5-3-flash/claude-fable-5.1/ Adds the Claude Fable 5.1 atomic-task run artifacts (21 tasks × 3 runs).
runs/2026-09-01-atomic-tasks-fable-5-1-and-glm-5-3-flash/glm-5.3-flash/ Adds the GLM 5.3 Flash atomic-task run artifacts (21 tasks × 3 runs) under the model’s real name.
Review details
  • Files reviewed: 56/692 changed files
  • Comments generated: 0
  • Review effort level: Lite

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants