#Multimodal-large-language-models
Showing 48 of 48 repositories tagged #multimodal-large-language-models, ranked by stars
Mobile-Agent: The Powerful GUI Agent Family
StarVector is a foundation model for SVG generation that transforms vectorization into a code generation task. Using a vision-language modeling architecture, StarVector processes both visual and textual inputs to produce high-quality SVG code with remarkable precision.
A cross-platform video structuring (video analysis) framework. If you find it helpful, please give it a star: ) 跨平台的视频结构化（视频分析）框架，觉得有帮助的请给个星星 : )
Cambrian-1 is a family of multimodal LLMs with a vision-centric design.
Seed1.5-VL, a vision-language foundation model designed to advance general-purpose multimodal understanding and reasoning, achieving state-of-the-art performance on 38 out of 60 public benchmarks.
A family of lightweight multimodal models.
A Framework for Speech, Language, Audio, Music Processing with Large Language Model
[CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding
OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.
✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models
(Accepted by IJCV) Liquid: Language Models are Scalable and Unified Multi-modal Generators
Cambrian-S: Towards Spatial Supersensing in Video
🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).
[NeurIPS 2025 Spotlight] Official implementation of Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligence
The Paper List of Large Multi-Modality Model (Perception, Generation, Unification), Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insight.
🌐 Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future
A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision, llama-3.2-vision, qwen-vl, qwen2-vl, phi3-v etc.
EVE Series: Encoder-Free Vision-Language Models from BAAI
[NeurIPS 2025] NAUTILUS: A Large Multimodal Model for Underwater Scene Understanding
Research Trends in LLM-guided Multimodal Learning.
A curated list of awesome Multimodal studies.
From scratch implementation of a vision language model in pure PyTorch
🔥An open-source survey of the latest video reasoning tasks, paradigms, and benchmarks.
Awesome music generation model——MG²
Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities
(NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Real-Time Self-Aware Emotional Speech Synthesis
[ICLR'26] Grasp Any Region: Towards Precise, Contextual Pixel Understanding for Multimodal LLMs
mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating
Your SDK solves all of this. One interface. Unified logic. Local + hosted models. Fine-tuning. Agent tools. Enterprise-ready. Hybrid RAG.Star 🌟 if you like it!
[CVPR 2025] DivPrune: Diversity-based Visual Token Pruning for Large Multimodal Models
Video Generation Benchmark
Reading list for Multimodal Large Language Models
FreeVA: Offline MLLM as Training-Free Video Assistant
Sample Spring AI Application with several use cases
Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
[NeurIPS 2025] Deep Memory Backtracking for Long Video Understanding
[ICLR 2025] Mitigating Modality Prior-Induced Hallucinations in Multimodal Large Language Models via Deciphering Attention Causality
Hub for researchers exploring VLMs and Multimodal Learning:)
Fact-checking system for textual and visual inputs.
Awesome Large Vision-Language Model: A Curated List of Large Vision-Language Model
A Unified Framework for Benchmarking Generative Electrocardiogram-Language Models (ELMs)
[ACL 2024] An Easy-to-use Hallucination Detection Framework for LLMs.
[MLHC 2025] ECG-Byte: A Tokenizer for End-to-End Generative Electrocardiogram Language Modeling
A Multi-Modal AI Copilot for Single-Cell Analysis with Instruction Following
Prism: A Plug-in Reproducible Infrastructure for Scalable Multimodal Continual Instruction Tuning
[COLING 2025🔥] Evolver: Chain-of-Evolution Prompting to Boost Large Multimodal Models for Hateful Meme Detection
A research-oriented training and evaluation framework for ECG-Language Models (ELMs)
[ICCV 2025 CVAMD] The official implementation of the paper "Prompt4Trust: A Reinforcement Learning Prompt Augmentation Framework for Clinically-Aligned Confidence Calibration in Multimodal Large Language Models".