Skip to content

fix(podman): resolve macOS Podman socket dynamically - #3135

Open
gmenher wants to merge 10 commits into
NVIDIA:mainfrom
gmenher:docs/macos-podman-socket-1690
Open

fix(podman): resolve macOS Podman socket dynamically#3135
gmenher wants to merge 10 commits into
NVIDIA:mainfrom
gmenher:docs/macos-podman-socket-1690

Conversation

@gmenher

@gmenher gmenher commented Sep 2, 2026

Copy link
Copy Markdown

Summary

This PR removes the last macOS Podman socket assumption from the driver-config volume e2e path and makes the Podman-backed e2e harness respect the socket reported by podman machine inspect.

On newer macOS Podman setups, the legacy ~/.local/share/containers/podman/machine/podman.sock path is not a reliable source of truth after restarting podman machine. That meant the driver-config volume helper and the Podman e2e flow could fail even when the VM was healthy and reachable through the socket Podman itself reports.

Related Issue

Closes #1690

Changes

  • Prefer OPENSHELL_PODMAN_SOCKET when it is already set, so explicit user overrides still win.
  • On macOS, resolve the Podman API socket from podman machine inspect before falling back to the legacy socket path.
  • Export CONTAINER_HOST whenever the Podman socket is resolved so child processes and follow-on commands use the same endpoint.
  • Make the Podman e2e preflight use the resolved socket consistently instead of assuming the legacy socket layout.
  • Add focused tests for parsing macOS podman machine inspect output.
  • Tighten a couple of Bash array expansions in the e2e and prebuilt-binary scripts so empty-array cases stay safe.

While validating the macOS Podman Machine change, I hit two unrelated harness bugs in gateway-common.sh and stage-prebuilt-binaries.sh caused by set -u plus empty arrays. I included those fixes because they blocked local e2e verification, but they are separate from the macOS socket change.

Testing

  • mise run pre-commit passes
  • Unit tests added/updated
  • E2E coverage updated and validated for the Podman lane
  • Manual smoke test after restarting podman machine confirmed the full user flow

Checklist

  • Follows Conventional Commits

gmenher added 3 commits August 4, 2026 18:23
On macOS, Homebrew-installed Podman does not create the default socket
path that the Podman driver probes. Document the OPENSHELL_PODMAN_SOCKET
override and the podman machine inspect lookup in both the compute
drivers reference and the debug-openshell-cluster skill.

Fixes NVIDIA#1690

Signed-off-by: Gaizka Menendez Hernandez <gmenende@redhat.com>
Signed-off-by: Gaizka Menendez Hernandez <gmenende@redhat.com>
@copy-pr-bot

copy-pr-bot Bot commented Sep 2, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown

All contributors have signed the DCO ✍️ ✅
Posted by the DCO Assistant Lite bot.

@gmenher

gmenher commented Sep 2, 2026

Copy link
Copy Markdown
Author

I have read the DCO document and I hereby sign the DCO.

Signed-off-by: Gaizka Menendez Hernandez <gmenende@redhat.com>

@johntmyers johntmyers left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

gator-agent

PR Review Status

The macOS Podman fix is project-valid and the focused socket changes are ready to continue, but the latest commit also removes a repository-advertised troubleshooting skill while leaving its callers and documentation intact.

Action required: restore .agents/skills/debug-openshell-cluster/SKILL.md, or move an intentional coordinated removal into a complete, separately scoped change.

Blocking findings:

  • GATOR-b92131c8-01: the deleted skill remains referenced by repository guidance and companion workflows.

Carried findings:

  • None
Gator metadata
  • Validation: Concentrated macOS Podman compatibility fix linked to triaged issue #1690
  • Docs: Fern compute-driver reference updated; existing reference-folder navigation covers the page
  • Checks: Current-head branch and Helm gates are waiting for the copy-PR mirror
  • E2E: Required for Podman runtime behavior; dispatch deferred until blocking review feedback is resolved
  • Head SHA: b92131c8a572bf935fd60a0f2784116b823ec676
  • Base SHA: 8bc79552638a625971f8c6d30c26efa917a19cf9
  • Merge base SHA: 06f0aa6fe30177f2aecba9af396649adae4d7cdd
  • Patch ID: 4bae9c48f63693d1ea65d2a789486c786b681b6d
  • Gator payload: 8
  • Review mode: initial
  • Previous reviewed SHA: none
  • Review budget exhausted: no
  • Maintainer decision required: no
  • Next state: gator:in-review

Comment thread .agents/skills/debug-openshell-cluster/SKILL.md
@johntmyers johntmyers added the gator:in-review Gator is reviewing or awaiting PR review feedback label Sep 2, 2026
Signed-off-by: Gaizka Menendez Hernandez <gmenende@redhat.com>
Signed-off-by: Gaizka Menendez Hernandez <gmenende@redhat.com>
Signed-off-by: Gaizka Menendez Hernandez <gmenende@redhat.com>
@johntmyers johntmyers added the test:e2e Requires end-to-end coverage label Sep 2, 2026
@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown

Label test:e2e applied, but pull-request/3135 does not exist yet. A maintainer needs to comment /ok to test 69bf396d84f2b52f2b96b5c4e24e237211913560 to mirror this PR. Once the mirror exists, re-apply the label or re-run Branch E2E Checks from the Actions tab.

@johntmyers

Copy link
Copy Markdown
Collaborator

/ok to test 69bf396

@johntmyers johntmyers left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

gator-agent

PR Review Status

The author-only follow-up resolves GATOR-b92131c8-01: the effective PR tree keeps the canonical public troubleshooting skill and applies the intended macOS Podman guidance there. The bounded delta review found no new blocking findings, and the required Branch Checks, Helm Lint, and E2E workflows are queued for the current head.

Blocking findings:

  • No blocking findings remain

Carried findings:

  • None; GATOR-b92131c8-01 is resolved
Gator metadata
  • Validation: Concentrated macOS Podman compatibility fix linked to triaged issue #1690
  • Docs: Fern compute-driver reference and canonical public troubleshooting skill are updated; existing reference navigation covers the page
  • Checks: Current-head Branch Checks and Helm Lint workflows are queued
  • E2E: test:e2e applied; /ok to test 69bf396d84f2b52f2b96b5c4e24e237211913560 posted; current-head Branch E2E workflow is queued
  • Head SHA: 69bf396d84f2b52f2b96b5c4e24e237211913560
  • Base SHA: 8bc79552638a625971f8c6d30c26efa917a19cf9
  • Merge base SHA: 06f0aa6fe30177f2aecba9af396649adae4d7cdd
  • Patch ID: a80112376cbab89bacc549dc61b77904c9dfd8ba
  • Gator payload: 8
  • Review mode: follow_up
  • Previous reviewed SHA: b92131c8a572bf935fd60a0f2784116b823ec676
  • Review budget exhausted: no
  • Maintainer decision required: no
  • Next state: gator:watch-pipeline

@johntmyers johntmyers added gator:watch-pipeline Gator is monitoring PR CI/CD status gator:approval-needed Gator completed review; maintainer approval needed and removed gator:in-review Gator is reviewing or awaiting PR review feedback gator:watch-pipeline Gator is monitoring PR CI/CD status labels Sep 2, 2026

@elezar elezar left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we remove the unrelated skills changes from this PR and keep it focusses on the macos-specific podman machine changes.

Signed-off-by: Gaizka Menendez Hernandez <gmenende@redhat.com>
Signed-off-by: Gaizka Menendez Hernandez <gmenende@redhat.com>
@gmenher
gmenher requested a review from elezar September 3, 2026 16:47

@johntmyers johntmyers left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

gator-agent

PR Review Status

Thanks @elezar. I checked your request to keep this focused on the macOS Podman Machine change against the two author commits and the effective patch after the merge from main. The unrelated E2E shell edits net out against the previously reviewed head, and the bounded delta review found no new blocking code defects, but skills/debug-openshell-cluster/SKILL.md still has the nine-line addition you asked to remove.

Action required: @gmenher, remove the remaining skills/debug-openshell-cluster/SKILL.md change, or obtain an explicit maintainer decision to retain it in this PR.

Blocking findings:

  • No new Gator blocking findings

Carried feedback:

  • @elezar's requested scope change remains unresolved
Gator metadata
  • Validation: Concentrated macOS Podman compatibility fix linked to validated issue #1690
  • Docs: Fern compute-driver reference is updated; maintainer-requested skill scope cleanup remains
  • Checks: Current-head required checks are pending; pipeline handoff is deferred until review feedback is resolved
  • E2E: test:e2e remains required; current-head dispatch is deferred until review feedback is resolved
  • Head SHA: 39f5ede5df3633a5e785254457dc61d38591855a
  • Base SHA: 0f0c94bda3a2056bd3413accd13e361488288cc4
  • Merge base SHA: 0f0c94bda3a2056bd3413accd13e361488288cc4
  • Patch ID: a7eba7991fb1b953ad1fd0497a1bceef33f91f79
  • Gator payload: 8
  • Review mode: follow_up
  • Previous reviewed SHA: 69bf396d84f2b52f2b96b5c4e24e237211913560
  • Review budget exhausted: no
  • Maintainer decision required: no
  • Next state: gator:in-review

@johntmyers johntmyers added gator:in-review Gator is reviewing or awaiting PR review feedback and removed gator:approval-needed Gator completed review; maintainer approval needed labels Sep 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

gator:in-review Gator is reviewing or awaiting PR review feedback test:e2e Requires end-to-end coverage

Projects

None yet

Development

Successfully merging this pull request may close these issues.

docs: document macOS Podman socket path mismatch and dynamic lookup

3 participants