Conversation
Notices
-
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Friday, 15-Sep-2023 15:21:30 JST verita84 :Debian_logo: :firefox: :bing: :android: Can anyone on FEDi get AMD GPU's to work with Stable Diffusion? -
Embed this notice
(mint@ryona.agency)'s status on Friday, 15-Sep-2023 15:21:30 JST @verita84 I got it to work, but have to use older pytorch version (1.13.1) since they broke something in newer ones for my card. -
Embed this notice
(mint@ryona.agency)'s status on Friday, 15-Sep-2023 15:33:54 JST @verita84 What card do you use? -
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Friday, 15-Sep-2023 15:33:55 JST verita84 :Debian_logo: :firefox: :bing: :android: @mint
Got a good link? or instructions? I am aon Debian 12 -
Embed this notice
(mint@ryona.agency)'s status on Friday, 15-Sep-2023 21:37:29 JST @verita84 Then latest pytorch should work fine.
https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Install-and-Run-on-AMD-GPUs#running-natively - doesn't even mention installing ROCm, supposedly because the needed binaries are already packaged and redistributed with pytorch. -
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Friday, 15-Sep-2023 21:37:31 JST verita84 :Debian_logo: :firefox: :bing: :android: @mint
Radeon 65000 RTXIn conversation permalink -
Embed this notice
(mint@ryona.agency)'s status on Friday, 15-Sep-2023 21:41:48 JST @verita84 Are you making a docker container from scratch or running some unofficial one? It needs the DRI device to be passed through from host.
docker run -it --device=/dev/kfd --device=/dev/dri --security-opt seccomp=unconfined --group-add videoIn conversation permalink -
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Friday, 15-Sep-2023 21:41:49 JST verita84 :Debian_logo: :firefox: :bing: :android: @mint
wait, this is the docker setup that says no GPU foundIn conversation permalink -
Embed this notice
(mint@ryona.agency)'s status on Friday, 15-Sep-2023 21:43:35 JST @verita84 Ignore the TORCH_COMMAND lines since they still refer to older ROCm version; newer webui should automatically select the correct one. In conversation permalink -
Embed this notice
(mint@ryona.agency)'s status on Friday, 15-Sep-2023 21:47:49 JST @verita84 Maybe it's using some additional virtualization layer, idk, I hate Docker and haven't used it since 2021. Try running it natively on the host system. In conversation permalink -
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Friday, 15-Sep-2023 21:47:50 JST verita84 :Debian_logo: :firefox: :bing: :android: @mint
I ran it just like thatIn conversation permalink -
Embed this notice
(mint@ryona.agency)'s status on Friday, 15-Sep-2023 21:57:39 JST @verita84 Yes, but not in Docker. Here, generated a Tomoko just now.
00000-2969430554-_lora_tomokoKu…In conversation permalink Attachments
-
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Friday, 15-Sep-2023 21:57:40 JST verita84 :Debian_logo: :firefox: :bing: :android: @mint
Docker is downloading the images now. Did you actually get it working?In conversation permalink -
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Friday, 15-Sep-2023 21:58:20 JST verita84 :Debian_logo: :firefox: :bing: :android: @mint
Docker fails with thisIn conversation permalink Attachments
likes this. -
Embed this notice
(mint@ryona.agency)'s status on Friday, 15-Sep-2023 21:59:12 JST @verita84 Looks like it’s picking a wrong Torch version. Try removing the venv directory, adding export TORCH_COMMAND="pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/rocm5.4.2" to webui-user.sh and restarting the webui.
In conversation permalink Attachments
-
Embed this notice
(mint@ryona.agency)'s status on Friday, 15-Sep-2023 22:20:36 JST @verita84 In the stable-diffusion-webui directory you cloned from git. In conversation permalink -
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Friday, 15-Sep-2023 22:20:38 JST verita84 :Debian_logo: :firefox: :bing: :android: @mint
how do you remove the venv dir? where is itIn conversation permalink -
Embed this notice
(mint@ryona.agency)'s status on Friday, 15-Sep-2023 22:21:17 JST @verita84 Also remove --precision=full --no-half, since 6xxx series cards support fp16 just fine. In conversation permalink -
Embed this notice
(mint@ryona.agency)'s status on Friday, 15-Sep-2023 22:33:52 JST @verita84 It's downloading the CUDA version. In conversation permalink -
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Friday, 15-Sep-2023 22:33:53 JST verita84 :Debian_logo: :firefox: :bing: :android: @mint
Followed the instructions to upgrade python...maybe it will work nowIn conversation permalink Attachments
-
Embed this notice
(mint@ryona.agency)'s status on Friday, 15-Sep-2023 22:34:47 JST @verita84 Might be a hidden dir (.venv), check if it's there. In conversation permalink -
Embed this notice
(mint@ryona.agency)'s status on Friday, 15-Sep-2023 22:36:58 JST @verita84 You're supposed to start it with ./webui.sh. In conversation permalink -
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Friday, 15-Sep-2023 22:36:59 JST verita84 :Debian_logo: :firefox: :bing: :android: @mint
are you supposed to start it with
export TORCH_COMMAND="pip install torch==2.0.1+rocm5.4.2 torchvision==0.15.2+rocm5.4.2 --index-url https://download.pytorch.org/whl/rocm5.4.2";
or like the doc says
REQS_FILE='requirements.txt' python launch.py --precision full --no-halfIn conversation permalink Attachments
-
Embed this notice
(mint@ryona.agency)'s status on Friday, 15-Sep-2023 22:41:51 JST @verita84 Then don't launch it as root, or at least delete the lines 94 to 104 in webui.sh if you really want to run it as root. In conversation permalink Attachments
-
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Friday, 15-Sep-2023 22:41:52 JST verita84 :Debian_logo: :firefox: :bing: :android: @mint
in docker? not according to instructions, You get this error:
ERROR: This script must not be launched as root, aborting...In conversation permalink -
Embed this notice
(mint@ryona.agency)'s status on Friday, 15-Sep-2023 22:52:31 JST @verita84 Again? Do rm -rf .venv venv, then try running python3 -m venv venv, source venv/bin/activate and then finally pip install torch==2.0.1+rocm5.4.2 torchvision==0.15.2+rocm5.4.2 --index-url https://download.pytorch.org/whl/rocm5.4.2.
In conversation permalink Attachments
-
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Friday, 15-Sep-2023 22:52:33 JST verita84 :Debian_logo: :firefox: :bing: :android: @mint
it installs torch 2.0.2 in venv but then this h appens when starting webui:In conversation permalink Attachments
-
Embed this notice
(mint@ryona.agency)'s status on Saturday, 16-Sep-2023 04:26:48 JST @verita84 What happens when you run python3 and type import torch, then torch.cuda.is_available()?
In conversation permalink -
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Saturday, 16-Sep-2023 04:26:49 JST verita84 :Debian_logo: :firefox: :bing: :android: Same
################################################################ Cannot locate TCMalloc (improves CPU memory usage) Python 3.8.16 (default, Jun 12 2023, 18:09:05) [GCC 11.2.0] Version: v1.6.0 Commit hash: 5ef669de080814067961f28357256e8fe27544f4 Traceback (most recent call last): File "launch.py", line 48, in <module> main() File "launch.py", line 39, in main prepare_environment() File "/dockerx/stable-diffusion-webui/modules/launch_utils.py", line 356, in prepare_environment raise RuntimeError( RuntimeError: Torch is not able to use GPU; add --skip-torch-cuda-test to COMMANDLINE_ARGS variable to disable this checkIn conversation permalink Attachments
-
Embed this notice
(mint@ryona.agency)'s status on Saturday, 16-Sep-2023 04:33:45 JST @verita84 Weird. Try updaing Python to 3.10, since that's what webui was tested on. In conversation permalink -
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Saturday, 16-Sep-2023 04:33:46 JST verita84 :Debian_logo: :firefox: :bing: :android: (venv) root@nexus:/dockerx/stable-diffusion-webui# python3 Python 3.8.16 (default, Jun 12 2023, 18:09:05) [GCC 11.2.0] :: Anaconda, Inc. on linux Type "help", "copyright", "credits" or "license" for more information. >>> import torch terminate called after throwing an instance of 'std::bad_alloc' what(): std::bad_alloc Aborted (core dumped) In conversation permalink -
Embed this notice
(mint@ryona.agency)'s status on Saturday, 16-Sep-2023 04:44:16 JST @verita84 What if you add export HSA_OVERRIDE_GFX_VERSION=10.3.0 to webui-user.sh?
In conversation permalink Attachments
-
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Saturday, 16-Sep-2023 04:44:17 JST verita84 :Debian_logo: :firefox: :bing: :android: @mint
It comes with 3,3.8,3.9
no updates availble for new oneIn conversation permalink -
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Saturday, 16-Sep-2023 04:52:19 JST verita84 :Debian_logo: :firefox: :bing: :android: Cannot locate TCMalloc (improves CPU memory usage) Python 3.8.16 (default, Jun 12 2023, 18:09:05) [GCC 11.2.0] Version: v1.6.0 Commit hash: 5ef669de080814067961f28357256e8fe27544f4 Traceback (most recent call last): File "launch.py", line 48, in <module> main() File "launch.py", line 39, in main prepare_environment() File "/dockerx/stable-diffusion-webui/modules/launch_utils.py", line 356, in prepare_environment raise RuntimeError( RuntimeError: Torch is not able to use GPU; add --skip-torch-cuda-test to COMMANDLINE_ARGS variable to disable this check In conversation permalink Attachments
-
Embed this notice
(mint@ryona.agency)'s status on Saturday, 16-Sep-2023 04:52:19 JST @verita84 What Torch version shows up in pip list when running in venv (source venv/bin/activate)?
In conversation permalink -
Embed this notice
(mint@ryona.agency)'s status on Saturday, 16-Sep-2023 04:58:18 JST @verita84 Looks fine, not sure why it wouldn't pick up your card. Can you install rocminfo? It might be already packaged for Debian unless it's still stuck in sid. In conversation permalink -
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Saturday, 16-Sep-2023 04:58:19 JST verita84 :Debian_logo: :firefox: :bing: :android: (venv) root@nexus:/dockerx/stable-diffusion-webui# pip list Package Version ------------------- ---------------- certifi 2022.12.7 charset-normalizer 2.1.1 cmake 3.25.0 filelock 3.9.0 idna 3.4 Jinja2 3.1.2 lit 15.0.7 MarkupSafe 2.1.2 mpmath 1.2.1 networkx 3.0 numpy 1.24.1 Pillow 9.3.0 pip 22.0.4 pytorch-triton-rocm 2.0.1 requests 2.28.1 setuptools 56.0.0 sympy 1.11.1 torch 2.0.1+rocm5.4.2 torchvision 0.15.2+rocm5.4.2 typing_extensions 4.4.0 urllib3 1.26.13 WARNING: You are using pip version 22.0.4; however, version 23.2.1 is available. You should consider upgrading via the '/dockerx/stable-diffusion-webui/venv/bin/python3 -m pip install --upgrade pip' command. In conversation permalink -
Embed this notice
(mint@ryona.agency)'s status on Saturday, 16-Sep-2023 05:03:03 JST @verita84 I'll try to help further tomorrow, since it's getting pretty late. In conversation permalink -
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Saturday, 16-Sep-2023 13:19:58 JST verita84 :Debian_logo: :firefox: :bing: :android: @mint
ok it was working fine, GPU was making lots of image. Then I decided to try and run it as a regular user and then started from scratch and everything fucked up again. No ideaIn conversation permalink likes this. -
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Saturday, 16-Sep-2023 13:19:58 JST verita84 :Debian_logo: :firefox: :bing: :android: @mint
Update, needed to install python 10.6, works =)In conversation permalink likes this. -
Embed this notice
verita84 :Debian_logo: :firefox: :bing: :android: (verita84@poster.place)'s status on Saturday, 16-Sep-2023 13:20:00 JST verita84 :Debian_logo: :firefox: :bing: :android: @mint
Thanks for all the help, it works! I started from scratch using Debian's Native Python 3.11In conversation permalink Attachments
-
Embed this notice