Using gradio demo, running out of memory.
#3
by
alexnvo
- opened
How much memory does one need to generate images? Running out of memory on a a6000! Yikes.
@alexnvo Without offloading and quantization, approximately 60GB of GPU memory is required. Solutions for reducing this are being explored (see issues https://github.com/HiDream-ai/HiDream-I1/issues/3 and [https://github.com/HiDream-ai/HiDream-I1/issues/7]), and we will update the inference code to use less GPU memory.