Conversation
…C arm Signed-off-by: furionw <qiwa@nvidia.com>
Signed-off-by: furionw <qiwa@nvidia.com>
Signed-off-by: furionw <qiwa@nvidia.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
The multimodal sweep could not exercise AIPerf image-UUID reuse, so repeated conversational images were always resent and EC comparisons mixed request transport with encoder-cache behavior. A deterministic UUID workload and an explicit harness switch let standalone vLLM, native CPU EC, and Dynamo EC receive the same requests while repeated image content is stripped after first use. Transport validation makes that benchmark invariant observable instead of inferred.
What Change
classDiagram SweepConfig --> SweepOrchestrator : selects UUID transport SweepOrchestrator --> AIPerfRunner : configures each arm AIPerfRunner ..> AIPerf : passes UUID stripping note for SweepConfig "Owns the UUID transport switch" note for AIPerfRunner "Builds the UUID-aware profile command"Test Plan
vllm-serve,vllm-serve-native-ec, andvllm-serve-dynamo-ec: three repetitions per arm, 240 requests per run, zero errors.1.5.0.dev20260914, vLLM0.28.0, AIPerf0.12.0, NVTX off.sha256:9149bd7780ccd59291f1978d273188c086cfc796785f087f2353ac9c43a7895a.