Upgrading PyTorch to v2.6.0, torchvision to v0.21.0 and torchaudio to v2.6.0 - Pre Release

[atalman]

Similar to: #4905

Hi @mayankmalik-colab We have rc5 of torch ready for testing in Google Colab:

Release schedule
https://dev-discuss.pytorch.org/t/pytorch-release-2-6-0-call-for-features/2574

M4: Release branch finalized, Announce final launch date, Feature classifications published (week of 1/13/25) - Final RC is produced.
M4.1: Tutorial drafts submission deadline (1/15/25)
M5: External-Facing Content Finalized (1/24/25)
M6: Release Day (1/29/25)

pip install torch==2.6.0  --index-url https://download.pytorch.org/whl/test/cu124_full --force-reinstall
pip install triton==3.2.0 --index-url https://download.pytorch.org/whl/test/

This should install Python 3.11 Cuda 12.4 full release and triton 3.2.0

Release notes can be found at:
https://github.com/pytorch/pytorch/releases/tag/v2.5.0

[metrizable]

Thanks for the heads up! Tracking internally at b/390481152.

[atalman]

Hello @mayankmalik-colab added torchvision and torchaudio to the index:

 pip install torch==2.6.0 torchvision torchaudio --index-url https://download.pytorch.org/whl/test/cu124_full --force-reinstall
Looking in indexes: https://download.pytorch.org/whl/test/cu124_full
Collecting torch==2.6.0
  Obtaining dependency information for torch==2.6.0 from https://download.pytorch.org/whl/test/cu124_full/torch-2.6.0%2Bcu124-cp311-cp311-linux_x86_64.whl.metadata
  Downloading https://download.pytorch.org/whl/test/cu124_full/torch-2.6.0%2Bcu124-cp311-cp311-linux_x86_64.whl.metadata (26 kB)
Collecting torchvision
  Obtaining dependency information for torchvision from https://download.pytorch.org/whl/test/cu124_full/torchvision-0.21.0%2Bcu124-cp311-cp311-linux_x86_64.whl.metadata
  Downloading https://download.pytorch.org/whl/test/cu124_full/torchvision-0.21.0%2Bcu124-cp311-cp311-linux_x86_64.whl.metadata (6.1 kB)
Collecting torchaudio
  Obtaining dependency information for torchaudio from https://download.pytorch.org/whl/test/cu124_full/torchaudio-2.6.0%2Bcu124-cp311-cp311-linux_x86_64.whl.metadata
  Downloading https://download.pytorch.org/whl/test/cu124_full/torchaudio-2.6.0%2Bcu124-cp311-cp311-linux_x86_64.whl.metadata (6.4 kB)
Collecting filelock (from torch==2.6.0)
  Downloading https://download.pytorch.org/whl/test/filelock-3.13.1-py3-none-any.whl (11 kB)
Collecting typing-extensions>=4.10.0 (from torch==2.6.0)
  Downloading https://download.pytorch.org/whl/test/typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Collecting networkx (from torch==2.6.0)
  Downloading https://download.pytorch.org/whl/test/networkx-3.3-py3-none-any.whl (1.7 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 42.0 MB/s eta 0:00:00
Collecting jinja2 (from torch==2.6.0)
  Downloading https://download.pytorch.org/whl/test/Jinja2-3.1.4-py3-none-any.whl (133 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.3/133.3 kB 6.2 MB/s eta 0:00:00
Collecting fsspec (from torch==2.6.0)
  Downloading https://download.pytorch.org/whl/test/fsspec-2024.6.1-py3-none-any.whl (177 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 177.6/177.6 kB 8.2 MB/s eta 0:00:00
Collecting sympy==1.13.1 (from torch==2.6.0)
  Downloading https://download.pytorch.org/whl/test/sympy-1.13.1-py3-none-any.whl (6.2 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.2/6.2 MB 71.3 MB/s eta 0:00:00
Collecting mpmath<1.4,>=1.1.0 (from sympy==1.13.1->torch==2.6.0)
  Downloading https://download.pytorch.org/whl/test/mpmath-1.3.0-py3-none-any.whl (536 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 536.2/536.2 kB 23.5 MB/s eta 0:00:00
Collecting numpy (from torchvision)
  Downloading https://download.pytorch.org/whl/test/numpy-2.1.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16.3/16.3 MB 55.7 MB/s eta 0:00:00
Collecting pillow!=8.3.*,>=5.3.0 (from torchvision)
  Downloading https://download.pytorch.org/whl/test/pillow-11.0.0-cp311-cp311-manylinux_2_28_x86_64.whl (4.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.4/4.4 MB 55.8 MB/s eta 0:00:00
Collecting MarkupSafe>=2.0 (from jinja2->torch==2.6.0)
  Downloading https://download.pytorch.org/whl/test/MarkupSafe-2.1.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (28 kB)
Downloading https://download.pytorch.org/whl/test/cu124_full/torch-2.6.0%2Bcu124-cp311-cp311-linux_x86_64.whl (2556.5 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.6/2.6 GB 716.6 kB/s eta 0:00:00
Downloading https://download.pytorch.org/whl/test/cu124_full/torchvision-0.21.0%2Bcu124-cp311-cp311-linux_x86_64.whl (7.3 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.3/7.3 MB 40.7 MB/s eta 0:00:00
Downloading https://download.pytorch.org/whl/test/cu124_full/torchaudio-2.6.0%2Bcu124-cp311-cp311-linux_x86_64.whl (3.4 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.4/3.4 MB 20.2 MB/s eta 0:00:00
Using cached https://download.pytorch.org/whl/test/cu124_full/torch-2.6.0%2Bcu124-cp311-cp311-linux_x86_64.whl (2556.5 MB)
Using cached https://download.pytorch.org/whl/test/cu124_full/torchvision-0.21.0%2Bcu124-cp311-cp311-linux_x86_64.whl (7.3 MB)
Using cached https://download.pytorch.org/whl/test/cu124_full/torchaudio-2.6.0%2Bcu124-cp311-cp311-linux_x86_64.whl (3.4 MB)
Installing collected packages: mpmath, typing-extensions, sympy, pillow, numpy, networkx, MarkupSafe, fsspec, filelock, jinja2, torch, torchvision, torchaudio
  Attempting uninstall: typing-extensions
    Found existing installation: typing_extensions 4.12.2
    Uninstalling typing_extensions-4.12.2:
      Successfully uninstalled typing_extensions-4.12.2
  Attempting uninstall: MarkupSafe
    Found existing installation: MarkupSafe 2.1.3
    Uninstalling MarkupSafe-2.1.3:
      Successfully uninstalled MarkupSafe-2.1.3
  Attempting uninstall: filelock
    Found existing installation: filelock 3.13.1
    Uninstalling filelock-3.13.1:
      Successfully uninstalled filelock-3.13.1
  Attempting uninstall: jinja2
    Found existing installation: Jinja2 3.1.4
    Uninstalling Jinja2-3.1.4:
      Successfully uninstalled Jinja2-3.1.4
Successfully installed MarkupSafe-2.1.5 filelock-3.13.1 fsspec-2024.6.1 jinja2-3.1.4 mpmath-1.3.0 networkx-3.3 numpy-2.1.2 pillow-11.0.0 sympy-1.13.1 torch-2.6.0+cu124 torchaudio-2.6.0+cu124 torchvision-0.21.0+cu124 typing-extensions-4.12.2
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv

Please note you still need to:

pip install triton==3.2.0 --index-url https://download.pytorch.org/whl/test/

[mayankmalik-colab]

Hi @atalman - Thanks for the wheels. They seem to be fine and our build succeeded. However, our one of the depenencies - fastai still needs torch < 2.6 . Most of the times, they upgrade fastai in next 1-3 weeks after torch upgrade. So, I am hoping for the same this time too. Hence, we will upgrade torch once fastai is upgraded too.

Also, let me know when you move the wheels to https://download.pytorch.org/whl/cu124/ path. We would prefer installing from more official path. Thanks

[atalman]

HI @mayankmalik-colab These builds will be available via :

pip install torch==2.6.0 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu124_full --force-reinstall

Similar to previous release: #4905

[atalman]

Install of torch 2.6.0:

Hi @mayankmalik-colab Please use:

pip install torch==2.6.0 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu124_full --force-reinstall
pip install triton

Please see the log:

pip3 install torch==2.6.0 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu124_full --force-reinstall
Looking in indexes: https://download.pytorch.org/whl/cu124_full
Collecting torch==2.6.0
  Downloading https://download.pytorch.org/whl/cu124_full/torch-2.6.0%2Bcu124-cp311-cp311-linux_x86_64.whl.metadata (26 kB)
Collecting torchvision
  Downloading https://download.pytorch.org/whl/cu124_full/torchvision-0.21.0%2Bcu124-cp311-cp311-linux_x86_64.whl.metadata (6.1 kB)
Collecting torchaudio
  Downloading https://download.pytorch.org/whl/cu124_full/torchaudio-2.6.0%2Bcu124-cp311-cp311-linux_x86_64.whl.metadata (6.4 kB)
Collecting filelock (from torch==2.6.0)
  Downloading https://download.pytorch.org/whl/filelock-3.13.1-py3-none-any.whl.metadata (2.8 kB)
Collecting typing-extensions>=4.10.0 (from torch==2.6.0)
  Downloading https://download.pytorch.org/whl/typing_extensions-4.12.2-py3-none-any.whl.metadata (3.0 kB)
Collecting networkx (from torch==2.6.0)
  Downloading https://download.pytorch.org/whl/networkx-3.3-py3-none-any.whl.metadata (5.1 kB)
Collecting jinja2 (from torch==2.6.0)
  Downloading https://download.pytorch.org/whl/Jinja2-3.1.4-py3-none-any.whl.metadata (2.6 kB)
Collecting fsspec (from torch==2.6.0)
  Downloading https://download.pytorch.org/whl/fsspec-2024.6.1-py3-none-any.whl.metadata (11 kB)
Collecting sympy==1.13.1 (from torch==2.6.0)
  Downloading https://download.pytorch.org/whl/sympy-1.13.1-py3-none-any.whl (6.2 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.2/6.2 MB 57.8 MB/s eta 0:00:00
Collecting mpmath<1.4,>=1.1.0 (from sympy==1.13.1->torch==2.6.0)
  Downloading https://download.pytorch.org/whl/mpmath-1.3.0-py3-none-any.whl (536 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 536.2/536.2 kB 11.0 MB/s eta 0:00:00
Collecting numpy (from torchvision)
  Downloading https://download.pytorch.org/whl/numpy-2.1.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (60 kB)
Collecting pillow!=8.3.*,>=5.3.0 (from torchvision)
  Downloading https://download.pytorch.org/whl/pillow-11.0.0-cp311-cp311-manylinux_2_28_x86_64.whl.metadata (9.1 kB)
Collecting MarkupSafe>=2.0 (from jinja2->torch==2.6.0)
  Downloading https://download.pytorch.org/whl/MarkupSafe-2.1.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (28 kB)
Downloading https://download.pytorch.org/whl/cu124_full/torch-2.6.0%2Bcu124-cp311-cp311-linux_x86_64.whl (2556.5 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.6/2.6 GB 15.3 MB/s eta 0:00:00
Downloading https://download.pytorch.org/whl/cu124_full/torchvision-0.21.0%2Bcu124-cp311-cp311-linux_x86_64.whl (7.3 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.3/7.3 MB 78.3 MB/s eta 0:00:00
Downloading https://download.pytorch.org/whl/cu124_full/torchaudio-2.6.0%2Bcu124-cp311-cp311-linux_x86_64.whl (3.4 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.4/3.4 MB 121.8 MB/s eta 0:00:00
Downloading https://download.pytorch.org/whl/pillow-11.0.0-cp311-cp311-manylinux_2_28_x86_64.whl (4.4 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.4/4.4 MB 89.6 MB/s eta 0:00:00
Downloading https://download.pytorch.org/whl/typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Downloading https://download.pytorch.org/whl/filelock-3.13.1-py3-none-any.whl (11 kB)
Downloading https://download.pytorch.org/whl/fsspec-2024.6.1-py3-none-any.whl (177 kB)
Downloading https://download.pytorch.org/whl/Jinja2-3.1.4-py3-none-any.whl (133 kB)
Downloading https://download.pytorch.org/whl/networkx-3.3-py3-none-any.whl (1.7 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 106.4 MB/s eta 0:00:00
Downloading https://download.pytorch.org/whl/numpy-2.1.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.3 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16.3/16.3 MB 144.0 MB/s eta 0:00:00
Installing collected packages: mpmath, typing-extensions, sympy, pillow, numpy, networkx, MarkupSafe, fsspec, filelock, jinja2, torch, torchvision, torchaudio
Successfully installed MarkupSafe-2.1.5 filelock-3.13.1 fsspec-2024.6.1 jinja2-3.1.4 mpmath-1.3.0 networkx-3.3 numpy-2.1.2 pillow-11.0.0 sympy-1.13.1 torch-2.6.0+cu124 torchaudio-2.6.0+cu124 torchvision-0.21.0+cu124 typing-extensions-4.12.2
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
(py311) [root@1f2245fa04e6 /]# pip install triton
Collecting triton
  Downloading triton-3.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.4 kB)
Downloading triton-3.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (253.2 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 253.2/253.2 MB 110.9 MB/s eta 0:00:00
Installing collected packages: triton
Successfully installed triton-3.2.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.