#Large-multimodal-models
Showing 17 of 17 repositories tagged #large-multimodal-models, ranked by stars
[NeurIPS 2024] An official implementation of "ShareGPT4Video: Improving Video Understanding and Generation with Better Captions"
A Framework of Small-scale Large Multimodal Models
This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"
An open-source implementation for training LLaVA-NeXT.
[CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocation
Stream-Omni is a GPT-4o-like language-vision-speech chatbot that simultaneously supports interaction across various modality combinations.
A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision, llama-3.2-vision, qwen-vl, qwen2-vl, phi3-v etc.
A curated list of awesome Multimodal studies.
[ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions
The official evaluation suite and dynamic data release for MixEval.
a comprehensive and critical synthesis of the emerging role of GenAI across the full autonomous driving stack
(NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Real-Time Self-Aware Emotional Speech Synthesis
[ICLR 2025] A Comprehensive Framework for Developing and Evaluating Multimodal Role-Playing Agents
[ICLR'26] Grasp Any Region: Towards Precise, Contextual Pixel Understanding for Multimodal LLMs
An open source tool for large-scale EEG datasets processing
Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
The official github repo for MixEval-X, the first any-to-any, real-world benchmark.