Repository navigation
Vouch request: [dmonakhov] #5445
dmonakhov
started this conversation in
Vouch Request
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
What do you want to work on?
pytorch fails to work inside sandbox with standard nvcr.io/nvidia/pytorch container out of box.
So trivial torch check fail with scary message which is not clear for majority of non technical people:
Why this change?
By default openshell sandbox does not allow to access /opt but it is mandatory for torch to load library from /opt/hpcx,
also it restrict access to /sys/, which makes it impossible for container to read system topology like /sys/devices/system/cpu, as result nccl will not able to bind tasks to correct CPUs.
This is not clear whether /opt and /sys should be accessible by default, but they we definitely need a policy example which allow to work standard ML containers out of box. My PR add exactly that example
Please review : https://github.com/dmonakhov/OpenShell/tree/ngc-pytorch-gpu-example
Checklist
All reactions