#Ai-alignment
Showing 8 of 8 repositories tagged #ai-alignment, ranked by stars
Build reliable customer-facing AI agents with Parlant: an interaction control harness optimized for controlled, consistent, and predictable LLM interactions.
Catch your AI's mistakes and blind spots before your customers or regulators do. iFixAi runs 45 inspections, 32 graded core plus 13 extended for frontier risks like sabotage, sandbagging, and oversight evasion. It returns a letter grade in under 5 minutes. Industry and model agnostic.
PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. ๐ Best Paper Awards @ NeurIPS ML Safety Workshop 2022
A curated list of trustworthy deep learning papers. Continually updating...
๐ A curated list of papers & technical articles on AI Quality & Safety
How to Make Safe AI? Let's Discuss! ๐ก|๐ฌ|๐|๐
LLM alignment jailbreak; a set of instructions for auditing their internal reasoning and uncovering biases
Educational analysis of LLM alignment, safety behavior, and framing-sensitive response patterns.