#Multi-modal-learning

Showing 10 of 10 repositories tagged #multi-modal-learning, ranked by stars

mlfoundations
mlfoundations
open_clip

An open source implementation of CLIP.

Score
100
★ 14.0k ⑂ 1.3k +7/day
Python
OFA-Sys
OFA-Sys
Chinese-CLIP

Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.

Score
100
★ 6.0k ⑂ 548 +7/day
Jupyter Notebook
lyuchenyang
lyuchenyang
Macaw-LLM

Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration

Score
83
★ 1.6k ⑂ 131
Python
lucidrains
lucidrains
x-clip

A concise but complete implementation of CLIP with various experimental improvements from recent papers

Score
67
★ 724 ⑂ 49
Python
InternRobotics
InternRobotics
EmbodiedScan

[CVPR 2024 & NeurIPS 2024] EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AI

Score
50
★ 671 ⑂ 51
Python
DmitryRyumin
DmitryRyumin
CVPR-2023-24-Papers

CVPR 2023-2024 Papers: Dive into advanced research presented at the leading computer vision conference. Keep up to date with the latest developments in computer vision and deep learning. Code included. ⭐ support visual intelligence development!

Score
33
★ 452 ⑂ 28 +1/day
Python
likyoo
likyoo
Multimodal-Remote-Sensing-Toolkit

A python tool to perform deep learning experiments on multimodal remote sensing data.

Score
0
★ 99 ⑂ 12
Python
RAIVNLab
RAIVNLab
sugar-crepe

[NeurIPS 2023] A faithful benchmark for vision-language compositionality

Score
17
★ 93 ⑂ 11
Python
vishalned
vishalned
MMEarth-data

This repository contains code to download data for the preprint "MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learning"

Score
0
★ 84 ⑂ 6
Python
rentainhe
rentainhe
TRAR-VQA

[ICCV 2021] Official implementation of the paper "TRAR: Routing the Attention Spans in Transformers for Visual Question Answering"

Score
0
★ 68 ⑂ 18
Python
Related Topics
#deep-learning#computer-vision#pytorch#contrastive-loss#language-model#pretrained-models#multi-modal#remote-sensing#vision-and-language#zero-shot-classification#chinese#clip

© 2026 GitRepoTrend · GitHub repositories by topic · Updated weekly