#Vision-language
Showing 21 of 21 repositories tagged #vision-language, ranked by stars
[ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.
日本語LLMまとめ - Overview of Japanese LLMs
[ECCV 2024 Oral] DriveLM: Driving with Graph Visual Question Answering
A Framework of Small-scale Large Multimodal Models
CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks
Pix2Seq codebase: multi-tasks with generative modeling (autoregressive and diffusion)
[CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want
🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)
[ICLR 2024] Controlling Vision-Language Models for Universal Image Restoration. 5th place in the NTIRE 2024 Restore Any Image Model in the Wild Challenge.
CLIPort: What and Where Pathways for Robotic Manipulation
多模态中文LLaMA&Alpaca大语言模型（VisualCLA）
🌐 Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future
A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision, llama-3.2-vision, qwen-vl, qwen2-vl, phi3-v etc.
Tools for movie and video research
[IGARSS 2024 ORAL] Official implementation of "Composed Image Retrieval for Remote Sensing".
Hierarchical Universal Language Conditioned Policies
Hub for researchers exploring VLMs and Multimodal Learning:)
Official code of the paper ORacle: Large Vision-Language Models for Knowledge-Guided Holistic OR Domain Modeling accepted at MICCAI 2024.
[ICLR 2025] Official implementation of the paper "LLM-wrapper: Black-Box Semantic-Aware Adaptation of Vision-Language Models for Referring Expression Comprehension"