#Clip
Showing 58 of 58 repositories tagged #clip, ranked by stars
Effortless data labeling with AI support from Segment Anything and other awesome models.
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
OpenMMLab Pre-training Toolbox and Benchmark
Collection of AWESOME vision-language models for vision tasks
Easily compute clip embeddings and build a clip retrieval system with them
🥂 Gracefully face hCaptcha challenge with multimodal large language model.
Cambrian-1 is a family of multimodal LLMs with a vision-centric design.
Must-have resource for anyone who wants to experiment with and build on the OpenAI vision API 🔥
Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and 🔜 video, up to 5x faster than OpenAI CLIP and LLaVA 🖼️ & 🖋️
This series will take you on a journey from the fundamentals of NLP and Computer Vision to the cutting edge of Vision-Language Models.
Search photos on Unsplash using natural language
Search inside YouTube videos using natural language
[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.
🔥🔥🔥Java免费离线AI算法工具箱，支持人脸识别，活体检测，表情识别、目标检测、实例分割、行人检测、OCR文字识别、车牌识别、表格识别、ASR+TTS、机器翻译等功能，Maven引用即可使用。支持PyTorch、Tensorflow，已集成 Mtcnn、InsightFace、SeetaFace6、YOLOv8~v12、PaddleOCR(PPOCRv5)、Whisper等主流模型
[CVPR'23] OpenScene: 3D Scene Understanding with Open Vocabularies
基于Stable Diffusion优化的AI绘画模型。支持输入中英文文本，可生成多种现代艺术风格的高质量图像。| An optimized text-to-image model based on Stable Diffusion. Both Chinese and English text inputs are available to generate images. The model can generate high-quality images in several modern art styles.
👁️ + 💬 + 🎧 = 🤖 Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]
React component for truncating multi-line spans and adding an ellipsis.
Offline semantic Text-to-Image and Image-to-Image search on Android powered by quantized state-of-the-art vision-language pretrained CLIP model and ONNX Runtime inference engine
CLIPort: What and Where Pathways for Robotic Manipulation
OpenClip - AI-powered highlight extraction for long videos (AI 驱动的长视频精彩时刻提取工具)
Transformers 3rd Edition
Diffusion Explainer: Visual Explanation for Text-to-image Stable Diffusion
Pathology Language and Image Pre-Training (PLIP) is the first vision and language foundation model for Pathology AI (Nature Medicine). PLIP is a large-scale pre-trained model that can be used to extract visual and language features from pathology images and text description. The model is a fine-tuned version of the original CLIP model.
Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model
EVE Series: Encoder-Free Vision-Language Models from BAAI
Free tool to create viral videos from YouTube, generating clips optimized for TikTok and Instagram with automatic transcription and 9:16 editing.
AutoCut Client
This repository provides a comprehensive step-by-step guide to building AI projects using the Raspberry Pi AI Kit.
A Simple, Lightweight, and Extensible Serving Framework for X-AnyLabeling
This is the repository for the BioCLIP model and the TreeOfLife-10M dataset [CVPR'24 Oral, Best Student Paper].
It is a simple library to speed up CLIP inference up to 3x (K80 GPU)
Give a custom shape to any flutter widget, Material Design 2 ready
MARCELO: an AI powered bot to automate the editing and thumbnail creation for your Youtube clips channel
Local-first AI photo culling for professional photographers — 6-axis rubric, XMP/IPTC export, Lightroom & Capture One ready.
Local image generation using VQGAN-CLIP or CLIP guided diffusion
Medical image captioning using OpenAI's CLIP
Download Twitch VODs and Clips
[ICCV 2023] Multi3DRefer: Grounding Text Description to Multiple 3D Objects
Design a growing artistic exhibit of your own making, with semantic search powered by OpenAI CLIP
CLIP-Finder enables semantic offline searches of images from gallery photos using natural language descriptions or the camera. Built on Apple's MobileCLIP-S0 architecture, it ensures optimal performance and accurate media retrieval.
Repository for the BioCLIP 2 model project. [NeurIPS'25 Spotlight] BioCLIP 2 is a biological foundation model trained on TreeOfLife-200M. Despite the narrow training objective, BioCLIP 2 yields extraordinary accuracy when applied to various biological visual tasks such as habitat classification and trait prediction.
[ICLR 2026] The implementation of the paper Foundation Visual Encoders Are Secretly Few-Shot Anomaly Detectors
(Experimental) Go library for multi-platform clipboard.
Command-line tool for extracting DINO, CLIP, SigLIP2, TIPSv2, RADIO, features for images and videos
Text Encoders finally matter 🤖🎥 - scale CLIP & LLM influence! + a Nerdy Transformer Shuffle node
CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search
[SOICT 2024] LLM-Powered Video Search: A Comprehensive Multimedia Retrieval System
Official repo of Text-Free Learning of a Natural Language Interface for Pretrained Face Generators
World's fastest and most compact embedded vector database: exact by default, multimodal, local-first, and GPU-accelerated
[WACV 2024] - Reference-based Restoration of Digitized Analog Videotapes
Detail-Oriented CLIP for Fine-Grained Tasks (ICLR SSI-FM 2025)
OpenAI CLIP converted to Tensorflow 2/Keras
Create music videos using CLIP with BigGAN, DALL-E and StyleGAN
Multimodal RAG system with CLIP/text embeddings, rank-fusion reranking, FastAPI serving, and Recall@5 evaluation.
ContextCore: An MCP server for Claude (or any AI tool) that enables massive token saving through hybrid search (BM25 + Embeddings)
Stop letting your rosbag data rot. Pandas-like analysis for robotics bag files with health checks, sync, ML export, semantic search, and WebSocket bridge.