Skip to content

docs(gpu-operator): clarify MPS support #505

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
efegokdemir wants to merge 1 commit into from
+14 −2
Closed

docs(gpu-operator): clarify MPS support #505

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions gpu-operator/getting-started.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -917,10 +917,11 @@ Next Steps

After verifying the installation, you can configure the GPU Operator for your workloads:

- :doc:`gpu-sharing` — Share a single GPU across multiple pods using time-slicing or MPS.
- :doc:`gpu-sharing` — Share a single GPU across multiple pods using time-slicing.
- :doc:`gpu-operator-mig` — Configure Multi-Instance GPU (MIG) partitioning on supported GPUs.
- :doc:`gpu-operator-rdma` — Enable GPUDirect RDMA for high-performance networking.
- :doc:`dra-intro-install` — Allocate GPUs by using Kubernetes Dynamic Resource Allocation (DRA).
- :doc:`dra-intro-install` — Allocate GPUs by using Kubernetes Dynamic Resource Allocation (DRA),
including experimental MPS sharing.
- :doc:`nvidia-driver-configuration` — Use the NVIDIA GPU Driver Custom Resource Definition to manage drivers per node.
- :doc:`precompiled-drivers` — Speed up driver deployments with precompiled kernel modules.
- :doc:`cdi` — Learn about Container Device Interface (CDI) and NRI Plugin mode.
11 changes: 11 additions & 0 deletions gpu-operator/gpu-sharing.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,17 @@ of extended options for the `NVIDIA Kubernetes Device Plugin <https://catalog.ng
GPU time-slicing enables workloads that are scheduled on oversubscribed GPUs to
interleave with one another.

.. note::

GPU sharing through the ClusterPolicy and NVIDIA Kubernetes Device Plugin
is supported through time-slicing and MIG. MPS is not officially supported
through this integration. MPS can run on statically partitioned MIG
instances; refer to the `MIG User Guide <https://docs.nvidia.com/datacenter/tesla/mig-user-guide/index.html>`__
for application considerations. Experimental MPS support through the DRA
driver requires the Alpha ``MPSSupport`` feature gate. Refer to
:doc:`dra-intro-install` for the DRA feature gates and their compatibility
constraints.

This mechanism for enabling *time-slicing* of
GPUs in Kubernetes enables a system administrator to define a set of
*replicas* for a GPU, each of which can be handed out independently to a
Expand Down