Rant: the fact that it needs ~27gb and the 4090 has 24gb is really annoying
#13
by
badjano
- opened
had to resort to the nf4 version
The first time that buying an RTX 5090 was worth it for me. ;-)
I had something similar in the past with my 4090 when a model needed....25(!) GB of vram. Strange...
The first time that buying an RTX 5090 was worth it for me. ;-)
I had something similar in the past with my 4090 when a model needed....25(!) GB of vram. Strange...
Hi. What about dual-4090? Do you think it's possible to run this model? Thanks.
you can run it in fp8 in ComfyUI using barely less than 24GB VRAM at 1024x1024. you do need a lot of system ram for offloading