#Multimodal-deep-learning
Showing 35 of 35 repositories tagged #multimodal-deep-learning, ranked by stars
LAVIS - A One-stop Library for Language-Vision Intelligence
FinRobot: An Open-Source AI Agent Platform for Financial Analysis using LLMs ๐ ๐ ๐
[ICLR 2024] Official implementation of " ๐ฆ Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"
Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch
A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.
A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch
ๆถ้ CVPR ๆๆฐ็ๆๆ๏ผๅ ๆฌ่ฎบๆใไปฃ็ ๅdemo่ง้ข็ญ๏ผๆฌข่ฟๅคงๅฎถๆจ่๏ผCollect the latest CVPR (Conference on Computer Vision and Pattern Recognition) results, including papers, code, and demo videos, etc., and welcome recommendations from everyone!
awesome grounding: A curated list of research papers in visual grounding
Official implementation for "Blended Latent Diffusion" [SIGGRAPH 2023]
This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"
[ICML 2026] ByteDance's All-in-One Video Generation Model for Human-Object Interaction Video Generation
A collection of parameter-efficient transfer learning papers focusing on computer vision and multimodal domains.
Paper List of Pre-trained Foundation Recommender Models
A curated list of awesome Multimodal studies.
Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".
ๆถ้ ECCV ๆๆฐ็ๆๆ๏ผๅ ๆฌ่ฎบๆใไปฃ็ ๅdemo่ง้ข็ญ๏ผๆฌข่ฟๅคงๅฎถๆจ่๏ผ
Implementation of CVPR 2023 paper "Prompting Large Language Models with Answer Heuristics for Knowledge-based Visual Question Answering".
End-to-end Training for Multimodal Recommendation Systems
Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch ๐
Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!
3DCoMPaT++: An improved large-scale 3D vision dataset for compositional recognition
Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"
Your SDK solves all of this. One interface. Unified logic. Local + hosted models. Fine-tuning. Agent tools. Enterprise-ready. Hybrid RAG.Star ๐ if you like it!
Robust multimodal integration method implemented in PyTorch and TensorFlow
Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
Hub for researchers exploring VLMs and Multimodal Learning:)
A Unified Framework for Benchmarking Generative Electrocardiogram-Language Models (ELMs)
Multimodal generative AI resources : talking heads, STT, TTS, image & video generation, and AI Agent
[MLHC 2025] ECG-Byte: A Tokenizer for End-to-End Generative Electrocardiogram Language Modeling
Target-aware Variational Auto-encoders for Ligand Generation with Multimodal Protein Representation Learning
[ICLR 25 Spotlight] A testbed for agents and environments that can automatically improve models through data generation.
A set of jupyter notebooks
Implementation of the winning solution for the Media Analytics Challenge 2023.
[AAAI 2025] Official Implementation for "Click2Mask: Local Editing with Dynamic Mask Generation" Paper.
A research-oriented training and evaluation framework for ECG-Language Models (ELMs)