Context engineering for AI agents. ~80% fewer tokens. Fix tool overload. Skills and memory with in-process BM25 retrieval. No vector DB. No embeddings.
Ratel
Your AI agent is paying for tools it never uses. Ratel fixes that.
Introduction
The context engineering layer for AI agents. Selects only the tools and skills relevant to each turn, recovering accuracy lost to tool overload and cutting what you pay per call. No vector DB, no infra.
Why
- Cost: Every tool schema sent to the model is tokens you pay for. Fewer tools in context means lower spend on every call.
- Accuracy: Models get worse as tool lists grow. Some drop from 77% to 8% accuracy just from having too many options.
- Ratel fixes both: by indexing your full catalog and injecting only the tools that match the current task, keeping the rest out of context entirely.
Install
Building an agent in TypeScript or Python? Add the SDK:
pnpm add @ratel-ai/sdk
pip install ratel-ai
TypeScript example
import { ToolCatalog, searchCapabilitiesTool, invokeToolTool } from "@ratel-ai/sdk";
const catalog = new ToolCatalog(); catalog.register({ id: "read_file", name: "read_file", description: "Read a file from local disk.", inputSchema: { properties: { path: { type: "string" } } }, execute: async ({ path }) => ({ contents: await fs.readFile(path, "utf8") }), });
const search = searchCapabilitiesTool(catalog); const invoke = invokeToolTool(catalog);
Python example
from ratelai import ToolCatalog, ExecutableTool, searchcapabilitiestool, invoketool_tool
catalog = ToolCatalog() catalog.register(ExecutableTool( id="read_file", name="read_file", description="Read a file from local disk.", input_schema={"properties": {"path": {"type": "string"}}}, execute=lambda args: {"contents": open(args["path"]).read()}, ))
search = searchcapabilitiestool(catalog) invoke = invoketooltool(catalog)
Examples: Vercel AI SDK ยท Pydantic AI
Using Claude Code, Cursor, or ChatGPT with MCP servers? Drop Ratel in front of your existing setup with no code changes:
npx -y @ratel-ai/mcp-server mcp import
Full docs: ratel-ai/ratel-mcp
How it works
When your agent needs to act, it calls search_capabilities. Ratel searches its internal index and returns only the most relevant tools. The model sees a short, focused list and picks correctly far more often.
The index uses BM25 by default, the same algorithm behind most search engines, applied to each tool's name and description. It is fast, deterministic, and adds no latency to your agent loop. Semantic and hybrid ranking are opt-in per catalog or per call, running a local embedding model in the same process.
The Ratel project
Ratel scales from an in-process library to a managed service โ one engine, one catalog contract, all the way up:
| | Repo | What it is | |---|---|---| | Engine + platform | ratel-ai/ratel (this one) | The ratel-ai-core engine plus TS/Python SDKs, the protocol/ catalog-source contract, and the OTel telemetry helpers. Embed it in your agent process today. | | ratel-local | ratel-ai/ratel-mcp | The local distribution โ Ratel in front of your MCP setup, today shipped as ratel-mcp / @ratel-ai/mcp-server. | | ratel-cloud | coming | Managed Ratel: the first hosted catalog source plus intelligence. SDKs reach it via RATEL_URL over the catalog-source contract. | | ratel-bench | ratel-ai/ratel-bench | The benchmark harness behind benchmark.ratel.sh. |
The hosted cloud is decided direction (ADR-0002), not yet public; a standalone server is deferred (ADR-0003).
Repo layout
src/
โโโ core/ # ratel-ai-core โ Rust BM25 engine
โโโ sdk/ts/ # @ratel-ai/sdk โ TypeScript SDK (NAPI-bound)
โโโ sdk/python/ # ratel-ai โ Python SDK (PyO3-bound)
โโโ telemetry/ # OTel conventions + helper packages
protocol/ # catalog-source wire contract
examples/ # End-to-end SDK examples
docs/ # ADRs
Build & test
Prerequisites: Rust stable, Node 24+, pnpm 10.28+. Python SDK: Python 3.9+ and uv.
cargo build --workspace && cargo test --workspace # Rust
pnpm install && pnpm -r build && pnpm -r test # TypeScript
Python: see src/sdk/python/README.md
Contributing
- CONTRIBUTING.md
- AGENTS.md โ for coding agents working in this repo
License
The ratel-ai-core engine is licensed under Apache-2.0 โ an explicit patent grant for the engine others embed. Everything else (SDKs, telemetry helpers, examples) is MIT. See ADR-0009 for the rationale.