---
base_model:
- meta-llama/Llama-3.2-3B-Instruct
- meta-llama/Llama-3.1-8B-Instruct
- meta-llama/Llama-3.1-70B-Instruct
- openai/clip-vit-large-patch14
library_name: transformers
license: cc
pipeline_tag: image-text-to-text
tags:
- pytorch
- llama-3
- zero-shot-vision-encoder-grafting
---

## Zero-Shot Vision Encoder Grafting via LLM Surrogates

This repository contains vision encoders and surrogate models, which are described in [Zero-Shot Vision Encoder Grafting via LLM Surrogates](https://huggingface.co/papers/2505.22664).

<p align="left" style="display: flex; gap: 8px; align-items: center;">
  <a href="https://arxiv.org/abs/2505.22664"><img src="https://img.shields.io/badge/arXiv%20-paper-b31b1b.svg?style=flat-square" /></a>
  <a href="https://github.com/facebookresearch/zero"><img src="https://img.shields.io/badge/GitHub%20-facebookresearch/zero-0081fb.svg?style=flat-square" /></a>
  <a href="https://github.com/facebookresearch/zero/blob/main/LICENSE"><img src="https://img.shields.io/badge/License-CC--BY--NC%204.0-black.svg?style=flat-square" /></a>
</p>