CISO Tribune

Vendor comparison · 2 companies

Promptfoo vs Wallarm

Promptfoo builds open-source tools for secure, reliable AI applications. Wallarm is an AI security and API security platform that discovers AI workloads, monitors runtime behavior, enforces policy inline, and generates continuous compliance evidence. CISO Tribune files both under AI model and agent security. This page sets the two records side by side: what each sells, where it is based, who owns and funds it, the customers it names and its recent news, each fact numbered to its source.

Change the companies

Up to four companies side by side.

  • Promptfoo
  • Wallarm
Promptfoo vs Wallarm: Products, Customers and Funding Compared
PromptfooPromptfoo builds open-source tools for secure, reliable AI applications.promptfoo.devWallarmWallarm is an AI security and API security platform that discovers AI workloads, monitors runtime behavior, enforces policy inline, and generates continuous compliance evidence.wallarm.com
What it sells
  • Red Teaming[2][4][5]Simulates real users to uncover application-specific vulnerabilities.
  • Evaluations[2][5]LLM evaluation of prompts and models that can run inside CI workflows.
  • AI Hypervisor[2][7][9]Provides kernel-level runtime enforcement for AI.
Categories
Headquarters
San Francisco, United States[1][3]Austin, United States[1]
Founded
2024[1][12]Not stated on its pages
Ownership and funding
Owned by OpenAI[12]Privately held[4][5][11]
Named customers
Not stated on its pagesNot stated on its pages
Recent news
  • March 9, 2026OpenAI agreed to buy Promptfoo, a startup helping businesses find and fix security issues in AI models during development.[13]
  • March 9, 2026OpenAI announced it has acquired Promptfoo, an AI security startup founded in 2024 to protect LLMs from adversarial attacks.[12]
  • June 4, 2026Wallarm announced general availability of its AI Control Platform, which is available on AWS Marketplace.[17]
  • February 17, 2026Wallarm released its 2026 API ThreatStats Report, an analysis of API attack telemetry, published vulnerabilities, and API-related breaches disclosed in 2025.[18]
G2 and Gartner Peer Insights
  • G2: Not stated on its pages
  • Gartner Peer Insights: Not stated on its pages
  • G2: listed, seen November 4, 2026[4]
  • Gartner Peer Insights: listed, seen November 4, 2026[5]
Who it fits
Not written yetNot written yet
Last verified
November 4, 2026September 27, 2026

Where they overlap

  • Promptfoo and Wallarm are both filed under AI model and agent security.
  • Both are headquartered in the United States.

Where they differ, field by field

  • Promptfoo's primary category is AI model and agent security; Wallarm's is API security.
  • Promptfoo is also filed under AI firewalls and guardrails, Static application security testing and Breach simulation and automated pen-testing. Wallarm is also filed under WAF and WAAP.
  • Promptfoo lists Red Teaming and Evaluations. Wallarm lists AI Hypervisor.
  • Promptfoo is headquartered in San Francisco, United States. Wallarm is headquartered in Austin, United States.
  • Promptfoo was founded in 2024.
  • Promptfoo is owned by OpenAI. Wallarm is privately held.

What it sells: Promptfoo

What Red Teaming does[2][4][5]
Promptfoo creates thousands of context-aware attacks tailored to the customer's application. The open-source Community version includes up to 10k probes per month at no charge.
What Evaluations does[2][5]
Promptfoo's LLM evaluation can be integrated into a CircleCI pipeline. Promptfoo can be integrated with test frameworks like Jest and Vitest to evaluate prompts as part of existing testing and CI workflows. Promptfoo provides real-time alerts and automated evaluations to show LLM security status across all projects.

What it sells: Wallarm

What AI Hypervisor does[2][7][9]
AI Hypervisor is the runtime enforcement layer for enterprise AI agents. AI Hypervisor deploys as a Kubernetes DaemonSet on EKS and instruments every labeled pod at the kernel using eBPF analysis. AI Hypervisor finds every model provider, MCP tool and agent framework running in a cluster, including ones nobody approved.

Questions about Promptfoo and Wallarm

What do Promptfoo and Wallarm sell?
Promptfoo sells Red Teaming and Evaluations. Wallarm sells AI Hypervisor.
Are Promptfoo and Wallarm in the same category?
They share AI model and agent security. Promptfoo's primary category is AI model and agent security and Wallarm's is API security.
Where are Promptfoo and Wallarm headquartered?
Promptfoo is headquartered in San Francisco, United States. Wallarm is headquartered in Austin, United States.
When were Promptfoo and Wallarm founded?
Promptfoo was founded in 2024.
Who owns Promptfoo and Wallarm?
Promptfoo is owned by OpenAI. Wallarm is privately held.
What have Promptfoo and Wallarm announced recently?
March 9, 2026: OpenAI agreed to buy Promptfoo, a startup helping businesses find and fix security issues in AI models during development. June 4, 2026: Wallarm announced general availability of its AI Control Platform, which is available on AWS Marketplace.

About Promptfoo

Promptfoo builds open-source tools for secure, reliable AI applications. Promptfoo is based in San Francisco, California, and is now part of OpenAI. Investors and operators backed Promptfoo early, and Promptfoo builds open-source, application-focused AI security.

Promptfoo's red teaming simulates real users to uncover application-specific vulnerabilities. Promptfoo creates thousands of context-aware attacks tailored to the customer's application. Promptfoo says its tests understand business logic, RAG, agents and integrations, and cover 50+ vulnerability types from injection to jailbreaks.[4]

Promptfoo connects to AI apps, agents, and workflows. Promptfoo provides remediation guidance directly in pull requests and developer workflows. Promptfoo lets teams track remediation progress and get suggested steps for each issue.[4][5]

The Community version includes all core features for local testing, evaluation, and vulnerability scanning. The open-source Community version includes up to 10k probes per month at no charge. Enterprise customers can purchase additional probes for larger scale testing. Enterprise pricing is customized based on a team's size and needs.[5]

Promptfoo lets customers manage LLM applications with teams-based access control and SSO, granular permission profiles, and customizable API access. Promptfoo provides real-time alerts and automated evaluations to show LLM security status across all projects. Promptfoo supports customizable plugin collections, scan configurations, and target settings that can be shared among colleagues.[5]

Promptfoo's LLM evaluation can be integrated into a CircleCI pipeline. Promptfoo can be integrated with test frameworks like Jest and Vitest to evaluate prompts as part of existing testing and CI workflows. Promptfoo's application-level jailbreak creation can be integrated with Burp Suite's Intruder feature for security testing of LLM-powered applications. Promptfoo can import eval test cases directly from Microsoft SharePoint CSV files using certificate-based authentication with Azure AD. Promptfoo configurations can reference prompts managed in Langfuse.[6][7][8][9][10]

Promptfoo offers real estate plugins that test every AI touchpoint, from property search to lending to advertising, across all 7 federally protected classes. Promptfoo tests AVM and appraisal AI for demographic correlation in valuations. Promptfoo's real estate testing covers home search assistants, neighborhood recommendation engines, property matching tools, and school district comparison features. Promptfoo's real estate testing can run entirely within a customer's infrastructure, with no applicant or transaction data leaving the environment. Promptfoo integrates with CI/CD pipelines to catch fair housing regressions before deployment. Promptfoo generates structured reports that map directly to Fair Housing Act and ECOA requirements.[11]

Promptfoo says its contributors are from companies like OpenAI, Google, Microsoft, and Amazon.[2][4][5][6][11]

Promptfoo on the record

Sources

Promptfoo full record

  1. [1]PressPromptfoo · promptfoo.dev · undated page, accessed November 4, 2026 · Tier A
  2. [2]promptfoo.devPromptfoo · promptfoo.dev · undated page, accessed November 4, 2026 · Tier A
  3. [3]About Promptfoo | AI Security Experts | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  4. [4]Build Secure AI Applications | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  5. [5]Pricing | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  6. [6]Setting up Promptfoo with CircleCI | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  7. [7]Testing prompts with Jest and Vitest | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  8. [8]Finding LLM Jailbreaks with Burp Suite | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  9. [9]SharePoint Integration | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  10. [10]Langfuse integration | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  11. [11]AI Security for Real Estate | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  12. [12]OpenAI acquires Promptfoo to secure its AI agents | TechCrunchTechCrunch · published March 9, 2026 · Tier B
  13. [13]OpenAI Buying AI Security Startup Promptfoo to Safeguard AI Agents - BloombergBloomberg · published March 9, 2026 · Tier B

Wallarm full record

  1. [1]CompanyWallarm · wallarm.com · undated page, accessed September 27, 2026 · Tier A
  2. [2]wallarm.comWallarm · wallarm.com · undated page, accessed September 27, 2026 · Tier A
  3. [3]Wallarm announces 55 million in series c to transform api security for the ai era 302516432Wallarm via PR Newswire · prnewswire.com · published July 31, 2025 · Tier A
  4. [4]Wallarm API Security Platform Reviews & Product Details - G2G2 · undated page, accessed October 30, 2026 · Tier C
  5. [5]Wallarm Reviews, Ratings & Features 2026 | Gartner Peer InsightsGartner Peer Insights · undated page, accessed October 30, 2026 · Tier C
  6. [6]Wallarm | IntegrationsWallarm · undated page, accessed November 4, 2026 · Tier A
  7. [7]Wallarm | Unified WAAP Platform for APIs, AI, and Web AppsWallarm · undated page, accessed November 4, 2026 · Tier A
  8. [8]AI Control Platform | Wallarm — AI Security for AWSWallarm · undated page, accessed November 4, 2026 · Tier A
  9. [9]AI Hypervisor | Wallarm — Kernel-Level AI EnforcementWallarm · undated page, accessed November 4, 2026 · Tier A
  10. [10]Infrastructure Discovery | Wallarm — AWS AI Asset DiscoveryWallarm · undated page, accessed November 4, 2026 · Tier A
  11. [11]Kubernetes API Security: Ingress, Sidecar & eBPF | WallarmWallarm · undated page, accessed November 4, 2026 · Tier A
  12. [12]API Security for Google Cloud (GCP) | WallarmWallarm · undated page, accessed November 4, 2026 · Tier A
  13. [13]Wallarm | Protect all your Azure assetsWallarm · undated page, accessed November 4, 2026 · Tier A
  14. [14]API Security and management with Wallarm and KongWallarm · undated page, accessed November 4, 2026 · Tier A
  15. [15]Wallarm For MuleSoftWallarm · undated page, accessed November 4, 2026 · Tier A
  16. [16]Protect Agentic AIWallarm · undated page, accessed November 4, 2026 · Tier A
  17. [17]Wallarm Launches AI Control Platform Bringing Runtime Visibility and Enforcement to Enterprise AIWallarm · published June 4, 2026 · Tier A
  18. [18]New Research Reveals APIs are the Single Most Exploited Attack SurfaceBusiness Wire · published February 17, 2026 · Tier A

Spot a factual error? Request a correction.