#Llm-safety
Showing 7 of 7 repositories tagged #llm-safety, ranked by stars
NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection
A resource repository for machine unlearning in large language models
Alignment-research scaffold (autoresearch-style) for LLM guardrails: search over a single policy.md surface
Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"
AISecOps (AI Security Operations) framework for deterministic verification of AI systems. QWED verifies LLM outputs using math, logic, and symbolic execution — creating an auditable trust boundary for agentic AI systems. Not generation. Verification.
lintlang is a static linter for AI agent configs, tool descriptions, and system prompts that runs zero-LLM quality gating in CI. Catches language-level failures (vague tool descriptions, missing stop conditions, schema gaps) before they reach runtime, with deterministic regex + structural detectors and no model calls.