Add sqlclient-perf-pr pipeline comparing against main branch source

[cheenamalhotra]

Summary

Introduces a PR-oriented variant of the perf pipeline: eng/pipelines/perf/sqlclient-perf-pr-pipeline.yml.

Pipeline in ADO: sqlclient-perf-pr
Purpose: To be used to run perf tests to capture benchmarks for PRs, personal braches, and publish comparison results locally against dotnet/sqlclient:main branch.

It extends the same v1/Perf.Test.Job.yml@PerfTemplates template and exposes the same configuration options as sqlclient-perf-pipeline.yml (platform, framework, run mode, confirmation runs, regression threshold/gate, managed SNI, optimized async behaviour, connection pool V2), but:

• Runs on the branch the run is queued on — manual/queue-time only (pr: none, trigger: none).
• Uses main branch source code as the baseline instead of a released NuGet package.
• Does not ingest results into Kusto — no ADX variable group, no translate/publish/ingest steps.

Source baseline mechanism

The perf template only exposes post-test steps, so both benchmark passes must happen inside the on-VM script. The run scripts therefore gain a second, mutually-exclusive baseline selector:

Script	New arguments
run-perf-tests.sh	--baseline-source-ref, --baseline-repo-url
run-perf-tests.ps1	-BaselineSourceRef, -BaselineRepoUrl

When a source ref is given, the script materialises that ref outside the checkout (so it can never be picked up by the candidate build or the results copy-back):

1. git fetch --no-tags --depth 1 origin '+refs/heads/<ref>:refs/remotes/perfbaseline/<ref>' + git worktree add --detach — uses the copied checkout's own origin.
2. Falls back to git clone --quiet --depth 1 --branch <ref> <baselineRepoUrl> when the tree arrived without .git or origin needs credentials the VM lacks.

The baseline pass then builds that ref's own PerformanceTests project, whose default ProjectReference points at that ref's driver source. This keeps interleave_perf.py's --baseline-exe-dir / --current-exe-dir contract unchanged, and both passes still use the same injected RUNNER_CONFIG / DATATYPES_CONFIG so configuration is identical on both sides.

The comparison is labelled <ref>@<sha> (e.g. main@9b20e5ec3) so each run records exactly which baseline commit it measured against.

The existing package baseline (--baseline-version -> ReferenceType=Package + MdsPackageVersion) is unchanged; supplying both selectors fails fast.

Verification

• bash -n on run-perf-tests.sh; PowerShell parser check on run-perf-tests.ps1
• YAML parse of the new pipeline
• Both git-acquisition paths smoke-tested (origin fetch and clone fallback), incl. a fix for .git being a file in a worktree
• Out-of-tree baseline build: dotnet build of the perf project from a detached worktree into a separate output dir — 0 warnings, 0 errors, ~13s

Notes for reviewers

• The new pipeline still needs to be registered in Azure DevOps pointing at eng/pipelines/perf/sqlclient-perf-pr-pipeline.yml.
• End-to-end validation requires the Perf Test Lab VM; the first real run should exercise both the .git-present path and the GitHub clone fallback.
• If a PR adds or removes benchmarks, compare_perf.py reports them as new / removed rather than failing.

Checklist

• Tests added or updated — n/a (pipeline/infra change; scripts smoke-tested as above)
• Public API changes documented — n/a, no public API change
• Verified against customer repro (if applicable) — n/a
• Ensure no breaking changes introduced — existing sqlclient-perf pipeline and its package-baseline path are unchanged
• Documentation updated — eng/pipelines/perf/README.md covers both pipelines, the source-baseline mechanism, PR-only parameters, and new troubleshooting entries

[Copilot]

Pull request overview

Adds a PR-oriented performance pipeline that runs the existing SqlClient perf benchmark suite against the queued branch (“current”) and compares it to a source baseline from another ref in this repo (default main), without ingesting results into Kusto. This fits into the existing eng/pipelines/perf/ perf automation by reusing the same Perf Test Lab extends template and the same on-VM run scripts.

Changes:

• Introduces sqlclient-perf-pr-pipeline.yml, a manual-only perf pipeline variant using source-baseline comparison and publishing artifacts/summaries only (no Kusto).
• Extends the on-VM run scripts (run-perf-tests.sh / .ps1) with a mutually-exclusive baseline selector that can materialize/build a baseline from another git ref’s source.
• Updates perf pipeline documentation to describe the new PR pipeline and the new baseline-source mechanism.

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated no comments.

File	Description
eng/pipelines/perf/sqlclient-perf-pr-pipeline.yml	New manual-only PR perf pipeline wiring source-baseline parameters into the existing PerfTemplates job, omitting Kusto steps.
eng/pipelines/perf/scripts/run-perf-tests.sh	Adds --baseline-source-ref / --baseline-repo-url support and refactors baseline execution to allow package or source baselines.
eng/pipelines/perf/scripts/run-perf-tests.ps1	Windows equivalent support for source-baseline acquisition (origin fetch/worktree + clone fallback) and baseline execution refactor.
eng/pipelines/perf/README.md	Documents the PR pipeline, source-baseline behavior, and troubleshooting updates.

---

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.