Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Install Assistance Multiple Errors - ComfyUI Standalone #79

Open
NC17z opened this issue Dec 26, 2024 · 1 comment
Open

Install Assistance Multiple Errors - ComfyUI Standalone #79

NC17z opened this issue Dec 26, 2024 · 1 comment

Comments

@NC17z
Copy link

NC17z commented Dec 26, 2024

I've been trying to install SageAttention 2 for ComfyUI and am having many issues with installation. I've followed a lot of instructions from several sources on the internet however, no matter what I try or do I end up with many errors. I've tried Different versions of Cuda Tool Kit 12.5 and most recently uninstalled and reinstalled 12.4. I'm running ComfyUI Standalone, and not the portable version.
I have Python 12.7 installed and I'm pretty sure my Environment Path's are setup correctly however, I'm getting multiple Fails when running the python.exe setup.py install command.

Here's my cmd report if anyone cares to take a glance at for me: Thank you in advance for any assistance in this matter,

Microsoft Windows [Version 10.0.19045.4894]
(c) Microsoft Corporation. All rights reserved.

C:\ComfyUI\SageAttention>python.exe setup.py install
running install
C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_distutils\cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!

    ********************************************************************************
    Please avoid running ``setup.py`` directly.
    Instead, use pypa/build, pypa/installer or other
    standards-based tools.

    See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
    ********************************************************************************

!!
self.initialize_options()
C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_distutils\cmd.py:66: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!

    ********************************************************************************
    Please avoid running ``setup.py`` and ``easy_install``.
    Instead, use pypa/build, pypa/installer or other
    standards-based tools.

    See https://github.com/pypa/setuptools/issues/917 for details.
    ********************************************************************************

!!
self.initialize_options()
running bdist_egg
running egg_info
writing sageattention.egg-info\PKG-INFO
writing dependency_links to sageattention.egg-info\dependency_links.txt
writing top-level names to sageattention.egg-info\top_level.txt
reading manifest file 'sageattention.egg-info\SOURCES.txt'
adding license file 'LICENSE'
writing manifest file 'sageattention.egg-info\SOURCES.txt'
installing library code to build\bdist.win-amd64\egg
running install_lib
running build_py
copying sageattention\core.py -> build\lib.win-amd64-cpython-312\sageattention
copying sageattention\quant.py -> build\lib.win-amd64-cpython-312\sageattention
copying sageattention_init_.py -> build\lib.win-amd64-cpython-312\sageattention
copying sageattention\triton\attn_qk_int8_block_varlen.py -> build\lib.win-amd64-cpython-312\sageattention\triton
copying sageattention\triton\attn_qk_int8_per_block.py -> build\lib.win-amd64-cpython-312\sageattention\triton
copying sageattention\triton\attn_qk_int8_per_block_causal.py -> build\lib.win-amd64-cpython-312\sageattention\triton
copying sageattention\triton\attn_qk_int8_per_block_causal_varlen.py -> build\lib.win-amd64-cpython-312\sageattention\triton
copying sageattention\triton\quant_per_block.py -> build\lib.win-amd64-cpython-312\sageattention\triton
copying sageattention\triton\quant_per_block_varlen.py -> build\lib.win-amd64-cpython-312\sageattention\triton
copying sageattention\triton\quant_per_thread.py -> build\lib.win-amd64-cpython-312\sageattention\triton
copying sageattention\triton_init_.py -> build\lib.win-amd64-cpython-312\sageattention\triton
running build_ext
building 'sageattention.qattn' extension
Emitting ninja build file C:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\build.ninja...
Compiling objects...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
[1/5] cl /showIncludes /nologo /O2 /W3 /GL /DNDEBUG /MD /MD /wd4819 /wd4251 /wd4244 /wd4267 /wd4275 /wd4018 /wd4190 /wd4624 /wd4067 /wd4068 /EHsc -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\torch\csrc\api\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\TH -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\THC "-IC:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\include" -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Include "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\ATLMFC\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Auxiliary\VS\include" -c C:\ComfyUI\SageAttention\csrc\qattn\pybind.cpp /FoC:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/pybind.obj -g -O3 -fopenmp -lgomp -std=c++17 -DENABLE_BF16 -D_GLIBCXX_USE_CXX11_ABI=0 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=qattn -D_GLIBCXX_USE_CXX11_ABI=0 /std:c++17
FAILED: C:/ComfyUI/SageAttention/build/temp.win-amd64-cpython-312/Release/csrc/qattn/pybind.obj
cl /showIncludes /nologo /O2 /W3 /GL /DNDEBUG /MD /MD /wd4819 /wd4251 /wd4244 /wd4267 /wd4275 /wd4018 /wd4190 /wd4624 /wd4067 /wd4068 /EHsc -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\torch\csrc\api\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\TH -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\THC "-IC:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\include" -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Include "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\ATLMFC\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Auxiliary\VS\include" -c C:\ComfyUI\SageAttention\csrc\qattn\pybind.cpp /FoC:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/pybind.obj -g -O3 -fopenmp -lgomp -std=c++17 -DENABLE_BF16 -D_GLIBCXX_USE_CXX11_ABI=0 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=qattn -D_GLIBCXX_USE_CXX11_ABI=0 /std:c++17
cl : Command line warning D9002 : ignoring unknown option '-g'
cl : Command line warning D9002 : ignoring unknown option '-O3'
cl : Command line warning D9002 : ignoring unknown option '-fopenmp'
cl : Command line warning D9002 : ignoring unknown option '-lgomp'
cl : Command line warning D9002 : ignoring unknown option '-std=c++17'
C:\Users\nc17z\AppData\Local\Programs\Python\Python312\include\pyconfig.h(59): fatal error C1083: Cannot open include file: 'io.h': No such file or directory
[2/5] C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\bin\nvcc --generate-dependencies-with-compile --dependency-output C:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/qk_int_sv_f16_buffer_cuda.obj.d -std=c++17 --use-local-env -Xcompiler /MD -Xcompiler /wd4819 -Xcompiler /wd4251 -Xcompiler /wd4244 -Xcompiler /wd4267 -Xcompiler /wd4275 -Xcompiler /wd4018 -Xcompiler /wd4190 -Xcompiler /wd4624 -Xcompiler /wd4067 -Xcompiler /wd4068 -Xcompiler /EHsc -Xcudafe --diag_suppress=base_class_has_different_dll_interface -Xcudafe --diag_suppress=field_without_dll_interface -Xcudafe --diag_suppress=dll_interface_conflict_none_assumed -Xcudafe --diag_suppress=dll_interface_conflict_dllexport_assumed -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\torch\csrc\api\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\TH -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\THC "-IC:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\include" -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Include "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\ATLMFC\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Auxiliary\VS\include" -c C:\ComfyUI\SageAttention\csrc\qattn\qk_int_sv_f16_buffer_cuda.cu -o C:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/qk_int_sv_f16_buffer_cuda.obj -D__CUDA_NO_HALF_OPERATORS -D__CUDA_NO_HALF_CONVERSIONS_ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr -O3 -std=c++17 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ --use_fast_math --threads=8 -Xptxas=-v -diag-suppress=174 -D_GLIBCXX_USE_CXX11_ABI=0 -gencode arch=compute_86,code=sm_86 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=qattn -D_GLIBCXX_USE_CXX11_ABI=0
FAILED: C:/ComfyUI/SageAttention/build/temp.win-amd64-cpython-312/Release/csrc/qattn/qk_int_sv_f16_buffer_cuda.obj
C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\bin\nvcc --generate-dependencies-with-compile --dependency-output C:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/qk_int_sv_f16_buffer_cuda.obj.d -std=c++17 --use-local-env -Xcompiler /MD -Xcompiler /wd4819 -Xcompiler /wd4251 -Xcompiler /wd4244 -Xcompiler /wd4267 -Xcompiler /wd4275 -Xcompiler /wd4018 -Xcompiler /wd4190 -Xcompiler /wd4624 -Xcompiler /wd4067 -Xcompiler /wd4068 -Xcompiler /EHsc -Xcudafe --diag_suppress=base_class_has_different_dll_interface -Xcudafe --diag_suppress=field_without_dll_interface -Xcudafe --diag_suppress=dll_interface_conflict_none_assumed -Xcudafe --diag_suppress=dll_interface_conflict_dllexport_assumed -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\torch\csrc\api\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\TH -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\THC "-IC:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\include" -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Include "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\ATLMFC\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Auxiliary\VS\include" -c C:\ComfyUI\SageAttention\csrc\qattn\qk_int_sv_f16_buffer_cuda.cu -o C:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/qk_int_sv_f16_buffer_cuda.obj -D__CUDA_NO_HALF_OPERATORS_ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr -O3 -std=c++17 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ --use_fast_math --threads=8 -Xptxas=-v -diag-suppress=174 -D_GLIBCXX_USE_CXX11_ABI=0 -gencode arch=compute_86,code=sm_86 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=qattn -D_GLIBCXX_USE_CXX11_ABI=0
qk_int_sv_f16_buffer_cuda.cu
cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_OPERATORS_' with '/U__CUDA_NO_HALF_OPERATORS__'
cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_CONVERSIONS__' with '/U__CUDA_NO_HALF_CONVERSIONS__'
qk_int_sv_f16_buffer_cuda.cu
C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.42.34433/include\crtdefs.h(10): fatal error C1083: Cannot open include file: 'corecrt.h': No such file or directory
cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_OPERATORS__' with '/U__CUDA_NO_HALF_OPERATORS__'
cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_CONVERSIONS__' with '/U__CUDA_NO_HALF_CONVERSIONS__'
qk_int_sv_f16_buffer_cuda.cu
C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.42.34433/include\crtdefs.h(10): fatal error C1083: Cannot open include file: 'corecrt.h': No such file or directory
[3/5] C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\bin\nvcc --generate-dependencies-with-compile --dependency-output C:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/qk_int_sv_f8_cuda.obj.d -std=c++17 --use-local-env -Xcompiler /MD -Xcompiler /wd4819 -Xcompiler /wd4251 -Xcompiler /wd4244 -Xcompiler /wd4267 -Xcompiler /wd4275 -Xcompiler /wd4018 -Xcompiler /wd4190 -Xcompiler /wd4624 -Xcompiler /wd4067 -Xcompiler /wd4068 -Xcompiler /EHsc -Xcudafe --diag_suppress=base_class_has_different_dll_interface -Xcudafe --diag_suppress=field_without_dll_interface -Xcudafe --diag_suppress=dll_interface_conflict_none_assumed -Xcudafe --diag_suppress=dll_interface_conflict_dllexport_assumed -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\torch\csrc\api\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\TH -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\THC "-IC:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\include" -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Include "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\ATLMFC\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Auxiliary\VS\include" -c C:\ComfyUI\SageAttention\csrc\qattn\qk_int_sv_f8_cuda.cu -o C:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/qk_int_sv_f8_cuda.obj -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr -O3 -std=c++17 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ --use_fast_math --threads=8 -Xptxas=-v -diag-suppress=174 -D_GLIBCXX_USE_CXX11_ABI=0 -gencode arch=compute_86,code=sm_86 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=qattn -D_GLIBCXX_USE_CXX11_ABI=0
FAILED: C:/ComfyUI/SageAttention/build/temp.win-amd64-cpython-312/Release/csrc/qattn/qk_int_sv_f8_cuda.obj
C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\bin\nvcc --generate-dependencies-with-compile --dependency-output C:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/qk_int_sv_f8_cuda.obj.d -std=c++17 --use-local-env -Xcompiler /MD -Xcompiler /wd4819 -Xcompiler /wd4251 -Xcompiler /wd4244 -Xcompiler /wd4267 -Xcompiler /wd4275 -Xcompiler /wd4018 -Xcompiler /wd4190 -Xcompiler /wd4624 -Xcompiler /wd4067 -Xcompiler /wd4068 -Xcompiler /EHsc -Xcudafe --diag_suppress=base_class_has_different_dll_interface -Xcudafe --diag_suppress=field_without_dll_interface -Xcudafe --diag_suppress=dll_interface_conflict_none_assumed -Xcudafe --diag_suppress=dll_interface_conflict_dllexport_assumed -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\torch\csrc\api\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\TH -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\THC "-IC:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\include" -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Include "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\ATLMFC\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Auxiliary\VS\include" -c C:\ComfyUI\SageAttention\csrc\qattn\qk_int_sv_f8_cuda.cu -o C:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/qk_int_sv_f8_cuda.obj -D__CUDA_NO_HALF_OPERATORS_ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr -O3 -std=c++17 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ --use_fast_math --threads=8 -Xptxas=-v -diag-suppress=174 -D_GLIBCXX_USE_CXX11_ABI=0 -gencode arch=compute_86,code=sm_86 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=qattn -D_GLIBCXX_USE_CXX11_ABI=0
qk_int_sv_f8_cuda.cu
cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_OPERATORS_' with '/U__CUDA_NO_HALF_OPERATORS__'
cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_CONVERSIONS__' with '/U__CUDA_NO_HALF_CONVERSIONS__'
qk_int_sv_f8_cuda.cu
C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.42.34433/include\crtdefs.h(10): fatal error C1083: Cannot open include file: 'corecrt.h': No such file or directory
cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_OPERATORS__' with '/U__CUDA_NO_HALF_OPERATORS__'
cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_CONVERSIONS__' with '/U__CUDA_NO_HALF_CONVERSIONS__'
qk_int_sv_f8_cuda.cu
C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.42.34433/include\crtdefs.h(10): fatal error C1083: Cannot open include file: 'corecrt.h': No such file or directory
[4/5] C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\bin\nvcc --generate-dependencies-with-compile --dependency-output C:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/qk_int_sv_f16_cuda.obj.d -std=c++17 --use-local-env -Xcompiler /MD -Xcompiler /wd4819 -Xcompiler /wd4251 -Xcompiler /wd4244 -Xcompiler /wd4267 -Xcompiler /wd4275 -Xcompiler /wd4018 -Xcompiler /wd4190 -Xcompiler /wd4624 -Xcompiler /wd4067 -Xcompiler /wd4068 -Xcompiler /EHsc -Xcudafe --diag_suppress=base_class_has_different_dll_interface -Xcudafe --diag_suppress=field_without_dll_interface -Xcudafe --diag_suppress=dll_interface_conflict_none_assumed -Xcudafe --diag_suppress=dll_interface_conflict_dllexport_assumed -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\torch\csrc\api\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\TH -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\THC "-IC:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\include" -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Include "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\ATLMFC\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Auxiliary\VS\include" -c C:\ComfyUI\SageAttention\csrc\qattn\qk_int_sv_f16_cuda.cu -o C:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/qk_int_sv_f16_cuda.obj -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr -O3 -std=c++17 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ --use_fast_math --threads=8 -Xptxas=-v -diag-suppress=174 -D_GLIBCXX_USE_CXX11_ABI=0 -gencode arch=compute_86,code=sm_86 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=qattn -D_GLIBCXX_USE_CXX11_ABI=0
FAILED: C:/ComfyUI/SageAttention/build/temp.win-amd64-cpython-312/Release/csrc/qattn/qk_int_sv_f16_cuda.obj
C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\bin\nvcc --generate-dependencies-with-compile --dependency-output C:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/qk_int_sv_f16_cuda.obj.d -std=c++17 --use-local-env -Xcompiler /MD -Xcompiler /wd4819 -Xcompiler /wd4251 -Xcompiler /wd4244 -Xcompiler /wd4267 -Xcompiler /wd4275 -Xcompiler /wd4018 -Xcompiler /wd4190 -Xcompiler /wd4624 -Xcompiler /wd4067 -Xcompiler /wd4068 -Xcompiler /EHsc -Xcudafe --diag_suppress=base_class_has_different_dll_interface -Xcudafe --diag_suppress=field_without_dll_interface -Xcudafe --diag_suppress=dll_interface_conflict_none_assumed -Xcudafe --diag_suppress=dll_interface_conflict_dllexport_assumed -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\torch\csrc\api\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\TH -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\THC "-IC:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\include" -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Include "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\ATLMFC\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Auxiliary\VS\include" -c C:\ComfyUI\SageAttention\csrc\qattn\qk_int_sv_f16_cuda.cu -o C:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/qk_int_sv_f16_cuda.obj -D__CUDA_NO_HALF_OPERATORS_ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr -O3 -std=c++17 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ --use_fast_math --threads=8 -Xptxas=-v -diag-suppress=174 -D_GLIBCXX_USE_CXX11_ABI=0 -gencode arch=compute_86,code=sm_86 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=qattn -D_GLIBCXX_USE_CXX11_ABI=0
qk_int_sv_f16_cuda.cu
cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_OPERATORS_' with '/U__CUDA_NO_HALF_OPERATORS__'
cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_CONVERSIONS__' with '/U__CUDA_NO_HALF_CONVERSIONS__'
qk_int_sv_f16_cuda.cu
C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.42.34433/include\crtdefs.h(10): fatal error C1083: Cannot open include file: 'corecrt.h': No such file or directory
cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_OPERATORS__' with '/U__CUDA_NO_HALF_OPERATORS__'
cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_CONVERSIONS__' with '/U__CUDA_NO_HALF_CONVERSIONS__'
qk_int_sv_f16_cuda.cu
C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.42.34433/include\crtdefs.h(10): fatal error C1083: Cannot open include file: 'corecrt.h': No such file or directory
[5/5] C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\bin\nvcc --generate-dependencies-with-compile --dependency-output C:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/qk_int_sv_f8_buffer_cuda.obj.d -std=c++17 --use-local-env -Xcompiler /MD -Xcompiler /wd4819 -Xcompiler /wd4251 -Xcompiler /wd4244 -Xcompiler /wd4267 -Xcompiler /wd4275 -Xcompiler /wd4018 -Xcompiler /wd4190 -Xcompiler /wd4624 -Xcompiler /wd4067 -Xcompiler /wd4068 -Xcompiler /EHsc -Xcudafe --diag_suppress=base_class_has_different_dll_interface -Xcudafe --diag_suppress=field_without_dll_interface -Xcudafe --diag_suppress=dll_interface_conflict_none_assumed -Xcudafe --diag_suppress=dll_interface_conflict_dllexport_assumed -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\torch\csrc\api\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\TH -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\THC "-IC:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\include" -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Include "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\ATLMFC\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Auxiliary\VS\include" -c C:\ComfyUI\SageAttention\csrc\qattn\qk_int_sv_f8_buffer_cuda.cu -o C:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/qk_int_sv_f8_buffer_cuda.obj -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr -O3 -std=c++17 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ --use_fast_math --threads=8 -Xptxas=-v -diag-suppress=174 -D_GLIBCXX_USE_CXX11_ABI=0 -gencode arch=compute_86,code=sm_86 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=qattn -D_GLIBCXX_USE_CXX11_ABI=0
FAILED: C:/ComfyUI/SageAttention/build/temp.win-amd64-cpython-312/Release/csrc/qattn/qk_int_sv_f8_buffer_cuda.obj
C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\bin\nvcc --generate-dependencies-with-compile --dependency-output C:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/qk_int_sv_f8_buffer_cuda.obj.d -std=c++17 --use-local-env -Xcompiler /MD -Xcompiler /wd4819 -Xcompiler /wd4251 -Xcompiler /wd4244 -Xcompiler /wd4267 -Xcompiler /wd4275 -Xcompiler /wd4018 -Xcompiler /wd4190 -Xcompiler /wd4624 -Xcompiler /wd4067 -Xcompiler /wd4068 -Xcompiler /EHsc -Xcudafe --diag_suppress=base_class_has_different_dll_interface -Xcudafe --diag_suppress=field_without_dll_interface -Xcudafe --diag_suppress=dll_interface_conflict_none_assumed -Xcudafe --diag_suppress=dll_interface_conflict_dllexport_assumed -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\torch\csrc\api\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\TH -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\include\THC "-IC:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.4\include" -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\include -IC:\Users\nc17z\AppData\Local\Programs\Python\Python312\Include "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.42.34433\ATLMFC\include" "-IC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Auxiliary\VS\include" -c C:\ComfyUI\SageAttention\csrc\qattn\qk_int_sv_f8_buffer_cuda.cu -o C:\ComfyUI\SageAttention\build\temp.win-amd64-cpython-312\Release\csrc/qattn/qk_int_sv_f8_buffer_cuda.obj -D__CUDA_NO_HALF_OPERATORS_ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr -O3 -std=c++17 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ --use_fast_math --threads=8 -Xptxas=-v -diag-suppress=174 -D_GLIBCXX_USE_CXX11_ABI=0 -gencode arch=compute_86,code=sm_86 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=qattn -D_GLIBCXX_USE_CXX11_ABI=0
qk_int_sv_f8_buffer_cuda.cu
cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_OPERATORS_' with '/U__CUDA_NO_HALF_OPERATORS__'
cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_CONVERSIONS__' with '/U__CUDA_NO_HALF_CONVERSIONS__'
qk_int_sv_f8_buffer_cuda.cu
C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.42.34433/include\crtdefs.h(10): fatal error C1083: Cannot open include file: 'corecrt.h': No such file or directory
cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_OPERATORS__' with '/U__CUDA_NO_HALF_OPERATORS__'
cl : Command line warning D9025 : overriding '/D__CUDA_NO_HALF_CONVERSIONS__' with '/U__CUDA_NO_HALF_CONVERSIONS__'
qk_int_sv_f8_buffer_cuda.cu
C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.42.34433/include\crtdefs.h(10): fatal error C1083: Cannot open include file: 'corecrt.h': No such file or directory
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\utils\cpp_extension.py", line 2104, in _run_ninja_build
subprocess.run(
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "C:\ComfyUI\SageAttention\setup.py", line 162, in
setup(
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_init_.py", line 103, in setup
return distutils.core.setup(**attrs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_distutils\core.py", line 184, in setup
return run_commands(dist)
^^^^^^^^^^^^^^^^^^
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_distutils\core.py", line 200, in run_commands
dist.run_commands()
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_distutils\dist.py", line 970, in run_commands
self.run_command(cmd)
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools\dist.py", line 974, in run_command
super().run_command(command)
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_distutils\dist.py", line 989, in run_command
cmd_obj.run()
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools\command\install.py", line 87, in run
self.do_egg_install()
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools\command\install.py", line 139, in do_egg_install
self.run_command('bdist_egg')
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_distutils\cmd.py", line 316, in run_command
self.distribution.run_command(command)
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools\dist.py", line 974, in run_command
super().run_command(command)
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_distutils\dist.py", line 989, in run_command
cmd_obj.run()
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools\command\bdist_egg.py", line 167, in run
cmd = self.call_command('install_lib', warn_dir=False)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools\command\bdist_egg.py", line 153, in call_command
self.run_command(cmdname)
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_distutils\cmd.py", line 316, in run_command
self.distribution.run_command(command)
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools\dist.py", line 974, in run_command
super().run_command(command)
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_distutils\dist.py", line 989, in run_command
cmd_obj.run()
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools\command\install_lib.py", line 12, in run
self.build()
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_distutils\command\install_lib.py", line 110, in build
self.run_command('build_ext')
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_distutils\cmd.py", line 316, in run_command
self.distribution.run_command(command)
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools\dist.py", line 974, in run_command
super().run_command(command)
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_distutils\dist.py", line 989, in run_command
cmd_obj.run()
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools\command\build_ext.py", line 93, in run
_build_ext.run(self)
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_distutils\command\build_ext.py", line 359, in run
self.build_extensions()
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\utils\cpp_extension.py", line 868, in build_extensions
build_ext.build_extensions(self)
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_distutils\command\build_ext.py", line 479, in build_extensions
self._build_extensions_serial()
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_distutils\command\build_ext.py", line 505, in _build_extensions_serial
self.build_extension(ext)
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools\command\build_ext.py", line 254, in build_extension
_build_ext.build_extension(self, ext)
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\Cython\Distutils\build_ext.py", line 135, in build_extension
super(build_ext, self).build_extension(ext)
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\setuptools_distutils\command\build_ext.py", line 560, in build_extension
objects = self.compiler.compile(
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\utils\cpp_extension.py", line 840, in win_wrap_ninja_compile
_write_ninja_file_and_compile_objects(
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\utils\cpp_extension.py", line 1784, in _write_ninja_file_and_compile_objects
_run_ninja_build(
File "C:\Users\nc17z\AppData\Local\Programs\Python\Python312\Lib\site-packages\torch\utils\cpp_extension.py", line 2120, in _run_ninja_build
raise RuntimeError(message) from e
RuntimeError: Error compiling objects for extension

C:\ComfyUI\SageAttention>
@extra2AB
Copy link

LykosAI/StabilityMatrix#954

follow this

and if you have done this already, instead of

set SETUPTOOLS_USE_DISTUTILS=stdlib

try using

set SETUPTOOLS_USE_DISTUTILS=setuptools

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@extra2AB @NC17z