bad performance
#110
by
sipie800
- opened
Quite noticable hallucination, compared to qwen2.5 vl 7b or qwen 2 vl or molmo or minicpm.
Have no idea how badly the benchmark cheats.
Meta have tons of data in social media for sure. But it's even more true that quality is far more important than the junk texts in social media.
A 10000B model will just not fix that but get worse.
It's hurting me that I'm using such expensive GPUs and download such huge checkopoints which is trained in such expensive GPU farm,
and get such simple and stupid hallucinations.
We're not being reasonable human right now.