Repository navigation
Replace the stale "OSS backend doesn't apply raw_data_path" note with a flyteorg/flyte v2.0.54 requirement - #1937
Draft
unionai-docsy-agent[bot] wants to merge 1 commit into
Draft
unionai-docsy-agent[bot] wants to merge 1 commit into
unionai-docsy-agent[bot] wants to merge 1 commit into
Conversation
… a flyteorg/flyte v2.0.54 requirement Drafted by Docsy for case 3486. Signed-off-by: unionai-docsy-agent[bot] <336110417+unionai-docsy-agent[bot]@users.noreply.github.com>
GHA build & deploy previewBuilt by
Updated automatically on every push. |
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What changed in the product
flyteorg/flyte#8026 ("feat(runs): apply the run base dir and raw data path settings") merged on 2026-11-02 as commit
c773118d. It shipped in flyteorg/flytev2.0.54, published 2026-11-03. The commit is an ancestor of thev2.0.54tag and not ofv2.0.53.Before #8026, the open-source backend accepted a run's raw data prefix but wrote offloaded data under each action's output location. From
v2.0.54, the backend uses the prefix. Here is where it's applied in flyteorg/flyte atv2.0.54:actions/k8s/client.go:applyRunSpecToTaskActioncopiesrunSpec.RawDataStorage.RawDataPrefixintoTaskAction.Spec.RawDataPrefix. Child actions inherit it from the parent ininheritRunContextFromParentTaskAction.executor/pkg/plugin/task_exec_context.go: the newComputeActionRawOutputPathbuilds the action's raw output paths fromSpec.RawDataPrefixwhen it's set. It falls back to the output prefix only when no prefix is set. Checkpoint paths resolve the same way.runs/service/run_service.go:CreateRunno longer replaces an empty raw data prefix with the default storage prefix.On the SDK side, flyte-sdk
main(src/flyte/_run.py) sendswith_runcontext(raw_data_path=...)asRawDataStorage(raw_data_prefix=...), which is the field the backend now reads.Signal that asked for this
unionai-docs#1879 deferred this follow-up in its description: "When flyteorg/flyte#8026 merges and ships in a release, remove the note in
where-data-lives.mdand the pointers to it." That release is now out.Open-source deployments on a backend older than
v2.0.54still don't apply the setting. The docs style rule says to state a version requirement when behavior depends on one. So instead of only deleting the "doesn't apply" text, this PR replaces it with a one-line requirement wherever the Flyte variant saysraw_data_pathroutes offloaded data: "On the open-source Flyte backend, remote runs applyraw_data_pathonly with flyteorg/flytev2.0.54or later."#1879 also deferred adding a pointer to
run-command-options.md,integrations/huggingface/_index.mdandintegrations/hydra/_index.md. This PR adds the requirement line torun-command-options.md, which documents--raw-data-path. The Hugging Face and Hydra pages aren't changed.Changes, page by page
Every changed block is a
{{< variant flyte >}}block, so only the Flyte variant changes. Union pages are unaffected.content/user-guide/get-started/core-concepts/where-data-lives.md: under "Per-run customization:raw_data_path", replaced the NOTE with the version requirement. Removed the one-line pointer after "The short version" list. That list'sraw_data_pathbullet is a summary, and the condition is stated in the section above it.content/user-guide/tasks/task-deployment/run-context.md: replaced the line after the Storage table with the requirement, covering bothraw_data_pathand--raw-data-path.content/user-guide/run-scaling/data-flow.md: replaced the pointer after "Output upload" with the requirement. Removed the duplicate pointer after "Per-run configuration", because the line earlier on the page covers both mentions.content/user-guide/tasks/task-deployment/run-command-options.md: added the requirement for--raw-data-pathin that option's section, after the examples.No other page links to the removed NOTE. The
#per-run-customization-raw_data_pathanchor is a section heading, so the link from the Hugging Face page still works.Not verified / open questions
v2.0.54OSS backend. The evidence above comes from reading the merged code at the tag.v2.0.54came out days ago, so many self-hosted open-source deployments are probably still on an earlier backend. That is why the requirement is stated. It's still open when the line can go: either once older backends are out of support, or never, as with the other "requires X or later" lines in the docs. No owner on the routing list covers the OSS backend, so this question isn't addressed to anyone.Pre-flight review
Docsy's reviewer read this draft before it was opened and found 4 problems to fix. The draft was amended for them, and a check of the amendment found nothing left to fix.
Docsy case 3486: https://docsy.apps.demo.hosted.unionai.cloud/cases/3486
Drafted by Docsy, Union.ai's documentation agent, from the product changes and requests in this case. Review it like any PR; close it if it's not wanted.