Moca Multimodal Embeddings

Transform pre-trained vision-language models into powerful bidirectional multimodal embeddings through modality-aware continual pre-training and heterogeneous contrastive fine-tuning. 3B model matches 7B baselines.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit aa644d64fb

Frequently asked questions

npx get-skill add adu2021/moca-multimodal-embeddings