Promptfoo vs Giskard

Both compete in Red-Teaming & AI Security. Promptfoo positions itself as “Open-source tool for evaluating and red-teaming LLM apps, agents, and RAG systems”, while Giskardleads with “Open-source and enterprise platform for testing and red-teaming LLM agents”. The table below compares what each publishes.

Where Promptfoo pulls ahead

Developer teams wanting free, open-source, CI/CD-integrated evaluation and red teaming of LLM apps

Where Giskard pulls ahead

Publishes support for EU AI Act, NIST AI RMF, which Promptfoo does not. ML, quality, and risk teams wanting open-source-first, framework-aligned LLM testing and continuous red teaming

	Promptfoo	Giskard
Positioning	Open-source tool for evaluating and red-teaming LLM apps, agents, and RAG systems	Open-source and enterprise platform for testing and red-teaming LLM agents
Category	Red-Teaming & AI Security	Red-Teaming & AI Security
Frameworks	None published	EU AI Act, NIST AI RMF
Deployment	Open-source, SaaS, API	Open-source, SaaS, On-prem, API
Built for	Data Science / ML, Security	Data Science / ML, Risk, Compliance
Founded	2023	2021
Headquarters	USA	Paris, France
Ownership	Acquired by OpenAI (2026); previously VC-backed	Independent, venture-backed (Y Combinator alumnus)
Funding	~$23.4M raised prior to acquisition; $5M seed (a16z, 2024) and $18.4M Series A led by Insight Partners (2025)	Seed funding (reported ~$2-3M+); investors include Y Combinator, Elaia, and others
Pricing	Open-source (MIT license), free; paid enterprise platform	Open-source library (free); Giskard Hub commercial enterprise subscription
Key capabilities	LLM evaluation and benchmarking Automated red teaming and vulnerability scanning Declarative test configs Prompt and model comparison CI/CD integration Local/self-hosted execution	Open-source LLM/model vulnerability scanning Automated test-suite generation Continuous red teaming Hallucination and prompt-injection testing Robustness and bias evaluation Business-domain test management (Giskard Hub)
Integrations	OpenAI, Anthropic, Google Gemini, DeepSeek, CI/CD pipelines, GitHub	Hugging Face, LangChain, MLflow, Common ML frameworks, Major LLM providers via API
Notable customers	OpenAI, Anthropic, Fortune 500 enterprises	None published
Best for	Developer teams wanting free, open-source, CI/CD-integrated evaluation and red teaming of LLM apps	ML, quality, and risk teams wanting open-source-first, framework-aligned LLM testing and continuous red teaming
Limitations	Developer-oriented and requires engineering effort to configure; broader governance/compliance features live in the paid enterprise tier.	Testing/evaluation focus rather than inline runtime enforcement; smaller company and funding base; enterprise features concentrated in the paid Hub tier

Which should you shortlist?

Choose Promptfoo if developer teams wanting free, open-source, CI/CD-integrated evaluation and red teaming of LLM apps

Choose Giskard if mL, quality, and risk teams wanting open-source-first, framework-aligned LLM testing and continuous red teaming

Neither is a substitute for a governance program. Whichever you pick, you still need people who can define the policies the tool enforces.

Full Promptfoo profile →Full Giskard profile →

AI Governance Tool Selection Kit

A vendor-comparison worksheet plus EU AI Act, NIST AI RMF and ISO/IEC 42001 requirement checklists — so you can shortlist tools against the obligations that actually apply to you.

Free. No spam — unsubscribe anytime.