You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This issue possible related to #20285, but we think this problem is different.
We use nomad with raw_exec module without root (yes, we know that this is unrecommended setup). We use raw_exec because exec module has too high overhead with fs isolation. For example, if Nvidia CUDA is installed exec module copies over 10Gb of CUDA library into every task. On the other side use raw_exec with root access isn't secure enough.
So... raw_exec module can use cgroupV2 and create group for every task. We modified Nomad systemd service in this way:
With that setup Nomad process under nomad user has full rights to nomad.slice, can manage resources and read stats.
In Nomad 1.7.7 everything is working perfectly. But Nomad 1.8.0 reports zero values for allocation resource usage.
Reproduction steps
Start nomad in Linux environment without root access with example systemd setup. Start any job with raw_exec driver.
Expected Result
Reported actual allocation resource usage.
Actual Result
Reported zeros for allocation resource usage.
The text was updated successfully, but these errors were encountered:
I'm going to lock this issue because it has been closed for 120 days ⏳. This helps our maintainers find and focus on the active issues.
If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.
Nomad version
Nomad v1.8.0
BuildDate 2024-05-28T17:38:17Z
Revision 28b82e4
Operating system and Environment details
Debian 11, raw_exec, cgroupV2
Issue
This issue possible related to #20285, but we think this problem is different.
We use nomad with
raw_exec
module without root (yes, we know that this is unrecommended setup). We useraw_exec
becauseexec
module has too high overhead with fs isolation. For example, if Nvidia CUDA is installedexec
module copies over 10Gb of CUDA library into every task. On the other side useraw_exec
with root access isn't secure enough.So...
raw_exec
module can use cgroupV2 and create group for every task. We modified Nomad systemd service in this way:With that setup Nomad process under nomad user has full rights to
nomad.slice
, can manage resources and read stats.In Nomad 1.7.7 everything is working perfectly. But Nomad 1.8.0 reports zero values for allocation resource usage.
Reproduction steps
Start nomad in Linux environment without root access with example systemd setup. Start any job with
raw_exec
driver.Expected Result
Reported actual allocation resource usage.
Actual Result
Reported zeros for allocation resource usage.
The text was updated successfully, but these errors were encountered: