#Visual-language-learning

haotian-liu

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

NExT-GPT

NExT-GPT

Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model

EvolvingLMMs-Lab

Otter

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

InternLM

InternLM-XComposer

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

xiaoachen98

Open-LLaVA-NeXT

An open-source implementation for training LLaVA-NeXT.

AdrianBZG

llama-multimodal-vqa

Multimodal Instruction Tuning for Llama 3