Field "device_minor" is not a valid field to query

[motooka79]

Testing "Detaching state" for GPU I experienced the following error.

2026-04-07T08:56:38Z INFO utils_gpus start running the command {"podName": "nvidia-driver-daemonset-vxjpr", "containerName": "nvidia-driver-ctr", "command": ["/usr/bin/nvidia-smi", "--query-gpu=device_minor,gpu_uuid,pci.bus_id", "--format=csv,noheader,nounits"]}
2026-04-07T08:56:38Z ERROR composable_resource_controller failed to drain target gpu {"deviceID": "GPU-857a4d38-2f79-73ac-c67b-b5638d5564f0", "composableResource": "gpu-c77b36ea-6c9c-4142-9095-0396643cdea0gjqgn", "error": "get gpu info command failed: err: 'command terminated with exit code 2', stderr: '', stdout: 'Field "device_minor" is not a valid field to query.\n\n'"}
github.com/CoHDI/composable-resource-operator/internal/controller.(*ComposableResourceReconciler).requeueOnErr
/workspace/internal/controller/composableresource_controller.go:427
github.com/CoHDI/composable-resource-operator/internal/controller.(*ComposableResourceReconciler).handleDetachingState
/workspace/internal/controller/composableresource_controller.go:354
github.com/CoHDI/composable-resource-operator/internal/controller.(*ComposableResourceReconciler).Reconcile
/workspace/internal/controller/composableresource_controller.go:114
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile
/workspace/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:119
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler
/workspace/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:334
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem
/workspace/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2
/workspace/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255

driver.version is 580.126.20

root@pod1:/# nvidia-smi --version
NVIDIA-SMI version : 580.126.20
NVML version : 580.126
DRIVER version : 580.126.20
CUDA Version : 13.0
root@pod1:/# nvidia-smi --query-gpu=device_minor,gpu_uuid,pci.bus_id --format=csv,noheader,nounits
Field "device_minor" is not a valid field to query.

[motooka79]

The code:

https://github.com/CoHDI/composable-resource-operator/blob/main/internal/utils/gpus.go#L396

"nvidia-smi -q" can run

root@pod1:/# nvidia-smi -q | grep -i minor
Minor Number : 0

[shogom2]

Thank you for your feedback. We are currently making the necessary fixes internally and testing the changes. We plan to submit a pull request next week or later.