AIAI Governance StackFree kit

Observability & Monitoring

14 tools tracked

Observability tools answer the question governance documentation cannot: is the model actually behaving in production the way it was approved to behave? They track drift, data quality, bias and performance degradation over time, and increasingly extend to LLM-specific concerns like hallucination rates, prompt/response logging and token-level tracing. Their output is the empirical evidence that feeds a governance program's monitoring obligations.

Buy here when you already know which models you run and need continuous proof they still work as intended.

AI observability and evaluation platform for ML models, LLM apps, and agents

SOC 2HIPAAGDPROpen-source

AI performance, evaluation, and governance platform for ML, generative, and agentic systems

NIST AI RMFEU AI ActSOC 2Open-source

Open-source and cloud observability for evaluating, testing, and monitoring ML and LLM systems

Open-source

Enterprise AI observability, security, and governance control plane for models and agents

EU AI ActNIST AI RMFGDPR

AI quality, testing, and monitoring platform for evaluating and safeguarding models in production

ISO/IEC 42001GDPRHIPAAOpen-source

AI control platform combining ML observability with real-time guardrails for GenAI

SOC 2GDPRHIPAA

AI model testing roots now applied to document workflow automation for regulated industries

SOC 2HIPAA

Open-source-led testing, evaluation and monitoring for ML models and LLM applications

SOC 2GDPRHIPAAOpen-source

Agentic Management Platform for building, monitoring, and governing AI at scale

Enterprise MLOps platform for deploying, monitoring, and governing AI/ML models in production

AI observability and model quality platform, now part of Snowflake

Open-source

Operational AI and model management platform, now part of Cloudera

Privacy-preserving AI observability via open-source whylogs and LangKit (acquired by Apple)

Open-source

AI observability platform for automated monitoring, explainability, and troubleshooting of ML models

AI Governance Tool Selection Kit

A vendor-comparison worksheet plus EU AI Act, NIST AI RMF and ISO/IEC 42001 requirement checklists — so you can shortlist tools against the obligations that actually apply to you.

Free. No spam — unsubscribe anytime.