Skip to content

P2 共同基准第一批 + P3 MCP browser_task 最小入口 - #12

Merged
jiangkoumo merged 4 commits into
mainfrom
integration/p2-p3
Oct 26, 2026
Merged

jiangkoumo merged 4 commits into
mainfrom
integration/p2-p3

Conversation

@jiangkoumo

Copy link
Copy Markdown
Owner

合并 lfs/p2-bench(2e468fc)与 lfs/p3-mcp(56ae54e)。

  • P2:bench/common-benchmark,复用 P1 的 10 项任务,双宿主统一 runner 与报告口径。
  • P3:mcp/server.mjs,stdio MCP 工具 browser_task,包装 scripts/run-cdp-task.mjs,引擎逻辑不改;实验性,依赖只在 mcp/。

本地验证(macOS):test-common-benchmark PASS;test-cdp-runner 104/0/1 skip;mcp/test-stdio 41/0(先 npm ci)。

Thin MCP boundary over the P1 runCdpTask entry: requires a deterministic until, returns verified final-URL evidence, executed-action records, cancellation and connection-release state. Same taskId never reruns in one process; conflicts and capacity fail closed. Dependency is pinned inside mcp/ only.
Reuse the P1 acceptance fixtures and verifiers, add per-task budgets
(steps, wall clock, decision requests), a single runner for ego lite and
external Chrome, and a fixed report schema (success/false-success rate,
latency, requests, cost, guardrail rejections, takeover, failure cost).

Both legs pass 10/10 offline. Live sites are listed as candidates only.
Copilot AI balanced review requested due to automatic review settings October 26, 2026 03:30

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has insufficient remaining quota.

@jiangkoumo
jiangkoumo merged commit eb54c3b into main Oct 26, 2026
1 check passed
@jiangkoumo jiangkoumo mentioned this pull request Oct 26, 2026
@jiangkoumo
jiangkoumo deleted the integration/p2-p3 branch October 26, 2026 11:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants