OpenGVLab/clip-vit-large-patch14to16-336

This repository contains the clip-vit-large-patch14to16-336 model, which is modified from https://huggingface.co/openai/clip-vit-large-patch14-336 by resizing the position embedding and patch embeding to the patch size of 16.

Please refer to our paper and GitHub repository for introduction and usage.

Citation

If you find this project useful in your research, please consider citing:

@article{piip,
  title={Parameter-Inverted Image Pyramid Networks},
  author={Zhu, Xizhou and Yang, Xue and Wang, Zhaokai and Li, Hao and Dou, Wenhan and Ge, Junqi and Lu, Lewei and Qiao, Yu and Dai, Jifeng},
  journal={arXiv preprint arXiv:2406.04330},
  year={2024}
}

@article{piip_v2,
  title={Parameter-Inverted Image Pyramid Networks for Visual Perception and Multimodal Understanding},
  author={Wang, Zhaokai and Zhu, Xizhou and Yang, Xue and Luo, Gen and Li, Hao and Tian, Changyao and Dou, Wenhan and Ge, Junqi and Lu, Lewei and Qiao, Yu and Dai, Jifeng},
  journal={arXiv preprint arXiv:2501.07783},
  year={2025}
}