PRIMA.CPP: Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday Home Clusters
Paper
•
2504.08791
•
Published
•
131
cgus
cgus
AI & ML interests
Small general-purpose LLMs for text-translation/summarization/limited scenario generation.
Image-generation, mainly lightweight models such as SD1.5.
Occasionally making exl2/GGUF quants on my personal hardware (up to 14B).
Recent Activity
liked
a model
1 day ago
wsbagnsv1/ltxv-13b-0.9.7-distilled-GGUF
liked
a model
1 day ago
Wan-AI/Wan2.1-VACE-1.3B
liked
a model
1 day ago
Wan-AI/Wan2.1-VACE-14B
Organizations
None yet
cgus's activity
upvoted
a
paper
about 1 month ago
upvoted
a
collection
about 1 month ago
upvoted
an
article
4 months ago
Article
Merge Large Language Models with mergekit
By
•
•
117