#Multimodality
Showing 16 of 16 repositories tagged #multimodality, ranked by stars
A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was originally created by https://twitter.com/advadnoun
The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements.
Collecting awesome papers of RAG for AIGC. We propose a taxonomy of RAG foundations, enhancements, and applications in paper "Retrieval-Augmented Generation for AI-Generated Content: A Survey".
Automated modeling and machine learning framework FEDOT
✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models
This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"
(ECCVW 2025)GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest
🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).
A CLI tool/python module for generating images from text using guided diffusion and CLIP from OpenAI.
DANCE: a deep learning library and benchmark platform for single-cell analysis
Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊
This repository is used to collect papers and code in the field of AI.
Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"
Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch
Sample Spring AI Application with several use cases
Fact-checking system for textual and visual inputs.