AIAI Governance StackFree kit

Promptfoo vs TrojAI

Both compete in Red-Teaming & AI Security. Promptfoo positions itself as “Open-source tool for evaluating and red-teaming LLM apps, agents, and RAG systems”, while TrojAIleads with “Enterprise AI security combining automated red teaming with real-time application protection”. The table below compares what each publishes.

Where Promptfoo pulls ahead

Developer teams wanting free, open-source, CI/CD-integrated evaluation and red teaming of LLM apps

Where TrojAI pulls ahead

Enterprises wanting combined pre-deployment red teaming and runtime AI application protection

Promptfoo
TrojAI
PositioningOpen-source tool for evaluating and red-teaming LLM apps, agents, and RAG systemsEnterprise AI security combining automated red teaming with real-time application protection
CategoryRed-Teaming & AI SecurityRed-Teaming & AI Security
FrameworksNone publishedNone published
DeploymentOpen-source, SaaS, APISaaS, Cloud, API
Built forData Science / ML, SecuritySecurity, Data Science / ML, Risk
Founded20232020
HeadquartersUSASaint John, New Brunswick, Canada (with Boston office)
OwnershipAcquired by OpenAI (2026); previously VC-backedAcquired by A10 Networks (2026)
Funding~$23.4M raised prior to acquisition; $5M seed (a16z, 2024) and $18.4M Series A led by Insight Partners (2025)~$11.4M total; $5.75M seed in April 2024 led by Flying Fish Partners
PricingOpen-source (MIT license), free; paid enterprise platformNot published
Key capabilities
  • LLM evaluation and benchmarking
  • Automated red teaming and vulnerability scanning
  • Declarative test configs
  • Prompt and model comparison
  • CI/CD integration
  • Local/self-hosted execution
  • Automated model red teaming (TrojAI Detect)
  • Real-time AI firewall (TrojAI Defend)
  • Prompt injection and data leakage protection
  • Model poisoning defense
  • Vulnerability remediation
IntegrationsOpenAI, Anthropic, Google Gemini, DeepSeek, CI/CD pipelines, GitHubNot published
Notable customersOpenAI, Anthropic, Fortune 500 enterprisesNone published
Best forDeveloper teams wanting free, open-source, CI/CD-integrated evaluation and red teaming of LLM appsEnterprises wanting combined pre-deployment red teaming and runtime AI application protection
LimitationsDeveloper-oriented and requires engineering effort to configure; broader governance/compliance features live in the paid enterprise tier.Now part of A10 Networks, so future roadmap is tied to the acquirer; standalone framework/compliance mapping is limited publicly.

Which should you shortlist?

Choose Promptfoo if developer teams wanting free, open-source, CI/CD-integrated evaluation and red teaming of LLM apps

Choose TrojAI if enterprises wanting combined pre-deployment red teaming and runtime AI application protection

Neither is a substitute for a governance program. Whichever you pick, you still need people who can define the policies the tool enforces.

Full Promptfoo profile →Full TrojAI profile →

AI Governance Tool Selection Kit

A vendor-comparison worksheet plus EU AI Act, NIST AI RMF and ISO/IEC 42001 requirement checklists — so you can shortlist tools against the obligations that actually apply to you.

Free. No spam — unsubscribe anytime.