ValueError: ROCm is not supported by requested frameworks: ['pytorch']

[AmdSampsa]

ValueError: ROCm is not supported by requested frameworks: ['pytorch']

Did as instructed in the main readme & tried a few branches (dev, v2.2_rcom). Got always:

Processing /root/TransformerEngine
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error

  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [22 lines of output]
      Traceback (most recent call last):
        File "/usr/local/lib/python3.12/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
          main()
        File "/usr/local/lib/python3.12/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
          json_out["return_val"] = hook(**hook_input["kwargs"])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/usr/local/lib/python3.12/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 143, in get_requires_for_build_wheel
          return hook(config_settings)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-yolp2wpm/overlay/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 331, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=[])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-yolp2wpm/overlay/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 301, in _get_build_requires
          self.run_setup()
        File "/tmp/pip-build-env-yolp2wpm/overlay/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 512, in run_setup
          super().run_setup(setup_script=setup_script)
        File "/tmp/pip-build-env-yolp2wpm/overlay/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 317, in run_setup
          exec(code, locals())
        File "<string>", line 33, in <module>
        File "/root/TransformerEngine/build_tools/utils.py", line 352, in get_frameworks
          raise ValueError(f"ROCm is not supported by requested frameworks: {_unsupported_frameworks}")
      ValueError: ROCm is not supported by requested frameworks: ['pytorch']
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed to build 'file:///root/TransformerEngine' when getting requirements to build wheel

[aasim-m]

Hi @AmdSampsa, I faced the same issue.

First, check the version of torch using:

pip show torch

If it shows something like:

Name: torch
Version: 2.9.1

and not something like:

Name: torch
Version: 2.9.1+rocmXX

then the installed PyTorch build is incorrect.

Most likely you ran:

pip3 install torch torchvision --index-url https://download.pytorch.org/whl/rocmXX

However, this does not install the ROCm build of PyTorch.
Instead, you must either copy-paste the link or download the correct wheel directly from:

https://download.pytorch.org/whl/torch/

and install it manually:

pip3 install <LINK_TO_THE_WHEEL_FILE>

[zixianwang2022]

Hi @aasim-m ,

I am also getting the same error even when having:

Name: torch
Version: 2.9.1+rocm6.4

I am using MI250X, built with the following command:

export NVTE_FRAMEWORK=pytorch
export NVTE_ROCM_ARCH=gfx90a
export NVTE_USE_HIPBLASLT=1
git clone --recursive https://github.com/ROCm/TransformerEngine && cd TransformerEngine && pip install . && cd ..

Unpacking objects: 100% (5/5), 1.59 KiB | 181.00 KiB/s, done.
From https://github.com/HaiShaw/minGPT
 * branch            fde597f25386b8e287e805f60c9391e3d6d419d7 -> FETCH_HEAD
Submodule path 'examples/pytorch/minGPT': checked out 'fde597f25386b8e287e805f60c9391e3d6d419d7'
Submodule path 'examples/pytorch/nanogpt': checked out '877e8e3c5e838f60dd1b30a56410215f2330b831'
Processing ./.
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error
  
  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [26 lines of output]
      /lustre/orion/gen150/scratch/zixianw4/tmp/pip-build-env-yzxtj3n1/overlay/lib/python3.12/site-packages/wheel/bdist_wheel.py:4: FutureWarning: The 'wheel' package is no longer the canonical location of the 'bdist_wheel' command, and will be removed in a future release. Please update to setuptools v70.1 or later which contains an integrated version of this command.
        warn(
      /lustre/orion/gen150/scratch/zixianw4/tmp/pip-build-env-yzxtj3n1/overlay/lib/python3.12/site-packages/torch/cuda/__init__.py:65: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
        import pynvml  # type: ignore[import]
      Traceback (most recent call last):
        File "/lustre/orion/world-shared/gen150/zixianw4/envs/megatron-build-rocm6.4.2-torch2.9/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
          main()
        File "/lustre/orion/world-shared/gen150/zixianw4/envs/megatron-build-rocm6.4.2-torch2.9/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
          json_out["return_val"] = hook(**hook_input["kwargs"])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/lustre/orion/world-shared/gen150/zixianw4/envs/megatron-build-rocm6.4.2-torch2.9/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 143, in get_requires_for_build_wheel
          return hook(config_settings)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "/lustre/orion/gen150/scratch/zixianw4/tmp/pip-build-env-yzxtj3n1/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 333, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=[])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/lustre/orion/gen150/scratch/zixianw4/tmp/pip-build-env-yzxtj3n1/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 301, in _get_build_requires
          self.run_setup()
        File "/lustre/orion/gen150/scratch/zixianw4/tmp/pip-build-env-yzxtj3n1/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 518, in run_setup
          super().run_setup(setup_script=setup_script)
        File "/lustre/orion/gen150/scratch/zixianw4/tmp/pip-build-env-yzxtj3n1/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 317, in run_setup
          exec(code, locals())
        File "<string>", line 32, in <module>
        File "/lustre/orion/gen150/scratch/zixianw4/TransformerEngine/build_tools/utils.py", line 415, in get_frameworks
          raise ValueError(f"ROCm is not supported by requested frameworks: {_unsupported_frameworks}")
      ValueError: ROCm is not supported by requested frameworks: ['pytorch']
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed to build 'file:///lustre/orion/gen150/scratch/zixianw4/TransformerEngine' when getting requirements to build wheel
(megatron-build-rocm6.4.2-torch2.9) zixianw4@login10:/lustre/orion/gen150/scratch/zixianw4/TransformerEngine> 
(megatron-build-rocm6.4.2-torch2.9) zixianw4@login10:/lustre/orion/gen150/scratch/zixianw4/TransformerEngine> pip show torch
Name: torch
Version: 2.9.1+rocm6.4
Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
Home-page: https://pytorch.org
Author: 
Author-email: PyTorch Team <packages@pytorch.org>
License: BSD-3-Clause
Location: /lustre/orion/world-shared/gen150/zixianw4/envs/megatron-build-rocm6.4.2-torch2.9/lib/python3.12/site-packages
Requires: filelock, fsspec, jinja2, networkx, pytorch-triton-rocm, setuptools, sympy, typing-extensions
Required-by: torchvision

[YellowRoseCx]

I was able to get around this issue by removing "torch>=2.1" from the pyproject.toml file, just make sure you already have torch-rocm installed

[Micky774]

You can also try pip install . --no-build-isolation which might help the issue.