#Trustworthy-ai
Showing 24 of 24 repositories tagged #trustworthy-ai, ranked by stars
Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams
🐢 Open-Source Evaluation & Testing library for LLM Agents
[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.
[EMNLP 2024 Demo] MarkLLM: An Open-Source Toolkit for LLM Watermarking
[ICML 2024] TrustLLM: Trustworthiness in Large Language Models
Deliver safe & effective language models
The testing platform for AI teams. Bring engineers, PMs, and domain experts together to generate tests, simulate (adversarial) conversations, and trace every failure to its root cause.
Proof of thought : LLM-based reasoning using Z3 theorem proving with multiple backend support (SMT2 and JSON DSL)
[USENIX Security 2025] PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models
[NeurIPS-2023] Annual Conference on Neural Information Processing Systems
Neural Network Verification Software Tool https://www.verivital.com Documentation:
[ICLR'26, NAACL'25 Demo] Toolkit & Benchmark for evaluating the trustworthiness of generative foundation models.
[ICLR 2025] Code and Data Repo for Paper "Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluation"
The official implementation for ICLR23 paper "GNNSafe: Energy-based Out-of-Distribution Detection for Graph Neural Networks"
A project to add scalable state-of-the-art out-of-distribution detection (open set recognition) support by changing two lines of code! Perform efficient inferences (i.e., do not increase inference time) and detection without classification accuracy drop, hyperparameter tuning, or collecting additional data.
Curated tools, official sources, OSS, templates, and guides for EU AI Act compliance.
A curated list of valuable resources from our studies at the University of Tehran (UT), School of Electrical and Computer Engineering (ECE)
When the stakes are high, intelligence is only half the equation - reliability is the other ⚠️
SyReNN: Symbolic Representations for Neural Networks
Lightweight RAG provenance middleware. Verifies every claim in an LLM response is grounded in a retrieved source - without an LLM call.
[ICLR26] Unlearning Isn't Invisible: Detecting Unlearning Traces in LLMs from Model Outputs
NeurIPS 2024 - Erasing Undesirable Concepts in Diffusion Models with Adversarial Preservation
PISanitizer: Preventing Prompt Injection to Long-Context LLMs via Prompt Sanitization
[ICCV 2025 CVAMD] The official implementation of the paper "Prompt4Trust: A Reinforcement Learning Prompt Augmentation Framework for Clinically-Aligned Confidence Calibration in Multimodal Large Language Models".