#Information-retrieval
Showing 60 of 136 repositories tagged #information-retrieval, ranked by stars
📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG
Open Source AI Platform - AI Chat with advanced features that works with every LLM
Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.
Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database.
Topic Modelling for Humans
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
Retrieval and Retrieval-augmented LLMs
Open-source context retrieval layer for AI agents
AdalFlow: The library to build & auto-optimize LLM applications.
Harness LLMs with Multi-Agent Programming
Accelerated deep learning R&D
Learning to Rank in TensorFlow
Deep neural network to extract intelligent information from invoice documents.
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
Open-source inference server and production cluster for all the models your agent needs.
Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
Comprehensive and timely academic information on federated learning (papers, frameworks, datasets, tutorials, workshops)
SIMD-accelerated distances, dot products, matrix ops, geospatial & geometric kernels for 16 numeric types — from 6-bit floats to 64-bit complex — across x86, Arm, RISC-V, and WASM, with bindings for Python, Rust, C, C++, Swift, JS, and Go 📐
Efficient Retrieval Augmentation and Generation Framework
WFGY is heading toward WFGY 5.0 Polaris Protocol, a major open-source release for AI reasoning, RAG, agents, and real-world workflows. Includes Problem Map, Global Debug Card, WFGY 4.0, and the CFV Easter Egg.
Fast BM25 search in Python, powered by Numpy and Numba
telegram group scraper tool. fetch all information about group members
Information Gathering Instagram.
List of software that allows searching the web with the assistance of AI: https://hf.co/spaces/felladrin/awesome-ai-web-search
Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
Information Gathering tool - DNS / Subdomains / Ports / Directories enumeration
RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.
Open CLI for integrating AI search, recommendation, and conversational retrieval into agent systems and business systems
SPLADE: sparse neural search (SIGIR21, SIGIR22)
RAG-Fusion: multi-query generation + Reciprocal Rank Fusion for better retrieval-augmented generation. Includes evaluation harness with NFCorpus/BEIR.
Learn about Machine Learning and Artificial Intelligence
Search for the agentic web.
Late Interaction Models Training & Retrieval
[EMNLP'25] s3 - ⚡ Efficient & Effective Search Agent Training via RL for RAG (RLVR for Search with Minimal Data)
cuVS - a library for vector search and clustering on the GPU
A curated list of papers dedicated to neural text (semantic) matching.
Framework for enhancing LLMs for RAG tasks using fine-tuning.
Straightforward fuzzy matching, information retrieval and NLP building blocks for JavaScript.
Open-Source Information Retrieval Courses @ TU Wien
Generative Representational Instruction Tuning
🔥 Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generation 🔥. Our toolkit integrates 40 pre-retrieved benchmark datasets and supports 7+ retrieval techniques, 24+ state-of-the-art Reranking models, and multiple RAG methods.
AI-first Search & Answer Engine for work. Open-source alternative to Glean.
Is ChatGPT Good at Search? LLMs as Re-Ranking Agent [EMNLP 2023 Outstanding Paper Award]
⛔ [NOT MAINTAINED] An End-To-End Closed Domain Question Answering System.
🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.
Language model search engine built on a vector database and an anything key/value store.
Minimalist web-searching platform with an AI assistant that runs directly from your browser. Demo: https://felladrin-minisearch.hf.space
Links to conference/journal publications in automated fact-checking (resources for the TACL22/EMNLP23 paper).
Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard
AgentSearch is a framework for powering search agents and enabling customizable local search.
🔎 SimilaritySearchKit is a Swift package providing on-device text embeddings and semantic search functionality for iOS and macOS applications.
My Keras implementation of the Deep Semantic Similarity Model (DSSM)/Convolutional Latent Semantic Model (CLSM) described here: http://research.microsoft.com/pubs/226585/cikm2014_cdssm_final.pdf.
Data-Driven Evaluation for LLM-Powered Applications
Discover new target domains using Content Security Policy
Dataset and benchmark for RAG on company internal documents.
