Spaces:

moonshotai
/

Kimi-VL-A3B-Thinking

Running on Zero

teowu commited on 9 days ago

Commit

84e1d56

verified ·

1 Parent(s): e52d2ff

Update kimi_vl/serve/inference.py

Files changed (1) hide show

kimi_vl/serve/inference.py CHANGED Viewed

@@ -153,7 +153,8 @@ def preprocess(
     return inputs
 def kimi_vl_generate(
     model: torch.nn.Module,
     processor: AutoProcessor,

     return inputs
+@torch.no_grad()
+@torch.inference_mode()
 def kimi_vl_generate(
     model: torch.nn.Module,
     processor: AutoProcessor,