ValueError: Model architectures ['Qwen2_5_VLForConditionalGeneration'] failed to be inspected
#8
by
jedi2454
- opened
Hi,
Thank RolmOCR, I try to use vllm to run the model.
But I got this error, when I excuting "vllm serve reducto/RolmOCR "
ValueError: Model architectures ['Qwen2_5_VLForConditionalGeneration'] failed to be inspected. Please check the logs for more details.
My vllm version is 0.8.3
I also meet it , maybe you can try update transformers==4.50.0