Repository navigation
[CUB] Support stream-aware launch wrappers - #12265
Closed
oleksandr-pavlyk wants to merge 4 commits into
Closed
oleksandr-pavlyk wants to merge 4 commits into
oleksandr-pavlyk wants to merge 4 commits into
Conversation
Contributor
|
Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually. Contributors can view more details about this message here. |
oleksandr-pavlyk
force-pushed
the
launch-helper-and-tests
branch
3 times, most recently
from
October 28, 2026 18:24
0d5fcc3 to
9fb2bbc
Compare
Contributor
Author
|
/ok to test 9fb2bbc |
This comment has been minimized.
This comment has been minimized.
Infer trailing stream-like arguments through cuda::get_stream and preserve ordering with test setup across all launch modes: - TEST_LAUNCH=0: forward the supplied stream to the host API and synchronize it before returning. Preserve omitted stream arguments. - TEST_LAUNCH=1: synchronize the supplied host stream before launching the parent kernel, invoke the API on the device-side default stream, and wait for device execution to complete. - TEST_LAUNCH=2: capture on the supplied non-default stream, or a temporary stream when the default stream is requested. Launch the graph on the requested stream and synchronize it before returning. Use checked C2H buffers for temporary storage and scalar results. Fix the device-side memory resource to return the allocation's starting offset. Add stream-forwarding and explicit default-stream tests, and update the launch-wrapper usage documentation.
oleksandr-pavlyk
force-pushed
the
launch-helper-and-tests
branch
from
October 29, 2026 13:46
9fb2bbc to
93b2bde
Compare
Contributor
Author
|
/ok to test 93b2bde |
Contributor
Author
|
/ok to test 47fffd1 |
Contributor
🥳 CI Workflow Results🟩 Finished in 1h 51m: Pass: 100%/137 | Total: 4d 04h | Max: 1h 45m | Hits: 53%/227343See results here. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
This PR is a focused part of #11374 that modifies launch helper macros to support passing execution stream as last argument.
Infer trailing stream-like arguments through
cuda::get_streamand preserve ordering with test setup across all launch modes:TEST_LAUNCH=0: forward the supplied stream to the host API and synchronize it before returning. Preserve omitted stream arguments.TEST_LAUNCH=1: synchronize the supplied host stream before launching the parent kernel, invoke the API on the device-side default stream, and wait for device execution to complete.TEST_LAUNCH=2: capture on the supplied non-default stream, or a temporary stream when the default stream is requested. Launch the graph on the requested stream and synchronize it before returning.Use checked C2H buffers for temporary storage and scalar results. Fix the device-side memory resource to return the allocation's starting offset.
Add stream-forwarding and explicit default-stream tests, and update the launch-wrapper usage documentation.
gated by #12263
Checklist