feat(eval-routing): decouple judge/agent_judge backend+model from the agent's route - #137

Merged

akshaylive merged 9 commits into

mainfrom

akshaya/checker_context

Aug 27, 2026

Commits on Aug 26, 2026

feat(eval-routing): decouple judge/agent_judge backend+model from the agent's own route

akshaylive
and
claude
committed
78c25bf
fix(routing): make _resolve_backend_route's match exhaustive

akshaylive
and
claude
committed
ba03660
fix(eval-routing): restore DEFAULT_JUDGE_MODEL floor + add litellm judge transport

akshaylive
and
claude
committed
3c4f0de
feat(litellm-judge): support arbitrary litellm kwargs via params/auth

akshaylive
and
claude
committed
de4c476
refactor(litellm-judge): drop settings coupling, rename auth to env_params

akshaylive
and
claude
committed
f7583c0
ci(fix): install litellm extra for pyright, address CodeQL findings

akshaylive
and
claude
committed
0a2d47a
fix(checker-context): typed model, reject litellm+agent_judge/sim, live test

akshaylive
and
claude
committed
9af5367
ci: retrigger checks (previous push did not trigger CI)
akshaylive
committed
a15970b
ci: retrigger checks (GH Actions appeared stalled repo-wide)
akshaylive
committed
cfd8217