AI observability and evaluation platform for ML models, LLM apps, and agents
Observability & MonitoringSOC 2HIPAAGDPROpen-source
Best open-source AI governance tools
15 tools · last reviewed 2026-07
Open-source options let teams start governing AI without a procurement cycle, and they are often the fastest way to prove a control works before buying the managed version. The trade-off is that you own the operational burden — upgrades, tuning and the policy content itself — and most open cores deliberately reserve collaboration, reporting and support for a paid tier.
How to choose
Check licence terms, real commit activity rather than star counts, and how much of the useful policy content sits behind the commercial edition.
The shortlist
AI performance, evaluation, and governance platform for ML, generative, and agentic systems
Observability & MonitoringNIST AI RMFEU AI ActSOC 2Open-source
Open-source and cloud observability for evaluating, testing, and monitoring ML and LLM systems
Observability & MonitoringOpen-source
AI quality, testing, and monitoring platform for evaluating and safeguarding models in production
Observability & MonitoringISO/IEC 42001GDPRHIPAAOpen-source
European responsible-AI platform unifying MLOps, model registry, and enterprise AI governance
Policy, Compliance & GRCEU AI ActGDPRNIST AI RMFOpen-source
Open-source-led testing, evaluation and monitoring for ML models and LLM applications
Observability & MonitoringSOC 2GDPRHIPAAOpen-source
Open-source tool for evaluating and red-teaming LLM apps, agents, and RAG systems
Red-Teaming & AI SecurityOpen-source
Open-source enterprise AI gateway with inline guardrails across 1,000+ models
Runtime Enforcement & GuardrailsOpen-source
Open-source and enterprise platform for testing and red-teaming LLM agents
Red-Teaming & AI SecurityEU AI ActNIST AI RMFOpen-source
End-to-end security for the AI and machine-learning supply chain
Red-Teaming & AI SecurityNIST AI RMFSOC 2Open-source
Open-source framework for validating and correcting LLM inputs and outputs
Runtime Enforcement & GuardrailsOpen-source
Open-source toolkit for adding programmable rails to conversational LLM systems
Runtime Enforcement & GuardrailsOpen-source
AI observability and model quality platform, now part of Snowflake
Observability & MonitoringOpen-source
End-to-end security for AI with automated red teaming and runtime protection for agentic systems
Red-Teaming & AI SecurityOpen-source
Privacy-preserving AI observability via open-source whylogs and LangKit (acquired by Apple)
Observability & MonitoringOpen-source
Ordering reflects how thoroughly each tool is publicly documented, not a quality score. Nobody pays to appear on this list. See our methodology.
AI Governance Tool Selection Kit
A vendor-comparison worksheet plus EU AI Act, NIST AI RMF and ISO/IEC 42001 requirement checklists — so you can shortlist tools against the obligations that actually apply to you.
Free. No spam — unsubscribe anytime.