CISO Tribune

Vendor comparison · 2 companies

Promptfoo vs XM Cyber

Promptfoo builds open-source tools for secure, reliable AI applications. XM Cyber sells a platform that continuously surfaces every validated exposure that forms real attack paths. CISO Tribune files both under Breach simulation and automated pen-testing. This page sets the two records side by side: what each sells, where it is based, who owns and funds it, the customers it names and its recent news, each fact numbered to its source.

Change the companies

Up to four companies side by side.

  • Promptfoo
  • XM Cyber
Promptfoo vs XM Cyber: Products, Customers and Funding Compared
PromptfooPromptfoo builds open-source tools for secure, reliable AI applications.promptfoo.devXM CyberXM Cyber sells a platform that continuously surfaces every validated exposure that forms real attack paths.xmcyber.com
What it sells
  • Red Teaming[2][4][5]Simulates real users to uncover application-specific vulnerabilities.
  • Evaluations[2][5]LLM evaluation of prompts and models that can run inside CI workflows.
  • Continuous Exposure Management Platform[4][5]Surfaces validated exposures that form real attack paths.
  • XM Attack Graph Analysis™Maps viable exposures into attack paths that lead to business-critical assets.
Categories
Headquarters
San Francisco, United States[1][3]Herzliya, Israel[3]
Founded
2024[1][12]Not stated on its pages
Ownership and funding
Owned by OpenAI[12]Owned by Schwarz Group since 2021[2][4][15]
Named customers
Not stated on its pagesNot stated on its pages
Recent news
  • March 9, 2026OpenAI agreed to buy Promptfoo, a startup helping businesses find and fix security issues in AI models during development.[13]
  • March 9, 2026OpenAI announced it has acquired Promptfoo, an AI security startup founded in 2024 to protect LLMs from adversarial attacks.[12]
Not stated on its pages
G2 and Gartner Peer Insights
  • G2: Not stated on its pages
  • Gartner Peer Insights: Not stated on its pages
  • G2: listed, seen November 10, 2026[15]
  • Gartner Peer Insights: Not stated on its pages
Who it fits
Not written yetFrom its own pages, XM Cyber does not state organisation size, industries or deployment models it targets. Its business initiatives menu names Operational Technology (OT), Mergers and Acquisitions, Ransomware Readiness and Executive Risk Reporting, but the pages do not describe these as customer segments or buyer roles. This is our reading of the pages, not a recommendation.
Last verified
November 4, 2026November 2, 2026

Where they overlap

  • Promptfoo and XM Cyber are both filed under Breach simulation and automated pen-testing.

Where they differ, field by field

  • Promptfoo's primary category is AI model and agent security; XM Cyber's is Exposure prioritisation and CTEM.
  • Promptfoo is also filed under AI firewalls and guardrails and Static application security testing.
  • Promptfoo lists Red Teaming and Evaluations. XM Cyber lists Continuous Exposure Management Platform and XM Attack Graph Analysis™.
  • Promptfoo is headquartered in San Francisco, United States. XM Cyber is headquartered in Herzliya, Israel.
  • Promptfoo was founded in 2024.
  • Promptfoo is owned by OpenAI. XM Cyber is owned by Schwarz Group, since 2021.

What it sells: Promptfoo

What Red Teaming does[2][4][5]
Promptfoo creates thousands of context-aware attacks tailored to the customer's application. The open-source Community version includes up to 10k probes per month at no charge.
What Evaluations does[2][5]
Promptfoo's LLM evaluation can be integrated into a CircleCI pipeline. Promptfoo can be integrated with test frameworks like Jest and Vitest to evaluate prompts as part of existing testing and CI workflows. Promptfoo provides real-time alerts and automated evaluations to show LLM security status across all projects.

What it sells: XM Cyber

What XM Attack Graph Analysis™ does
XM Attack Graph Analysis™ maps all viable exposures into attack paths from the external attack surface, across on-prem and cloud, to business-critical assets. The platform takes a digital twin approach to prioritize exposures validated against exploitability and reachability conditions, taking into account compensating security controls.

Questions about Promptfoo and XM Cyber

What do Promptfoo and XM Cyber sell?
Promptfoo sells Red Teaming and Evaluations. XM Cyber sells Continuous Exposure Management Platform and XM Attack Graph Analysis™.
Are Promptfoo and XM Cyber in the same category?
They share Breach simulation and automated pen-testing. Promptfoo's primary category is AI model and agent security and XM Cyber's is Exposure prioritisation and CTEM.
Where are Promptfoo and XM Cyber headquartered?
Promptfoo is headquartered in San Francisco, United States. XM Cyber is headquartered in Herzliya, Israel.
When were Promptfoo and XM Cyber founded?
Promptfoo was founded in 2024.
Who owns Promptfoo and XM Cyber?
Promptfoo is owned by OpenAI. XM Cyber is owned by Schwarz Group, since 2021.
Who are Promptfoo and XM Cyber sold to?
From its own pages, XM Cyber does not state organisation size, industries or deployment models it targets.
What have Promptfoo and XM Cyber announced recently?
March 9, 2026: OpenAI agreed to buy Promptfoo, a startup helping businesses find and fix security issues in AI models during development.

About Promptfoo

Promptfoo builds open-source tools for secure, reliable AI applications. Promptfoo is based in San Francisco, California, and is now part of OpenAI. Investors and operators backed Promptfoo early, and Promptfoo builds open-source, application-focused AI security.

Promptfoo's red teaming simulates real users to uncover application-specific vulnerabilities. Promptfoo creates thousands of context-aware attacks tailored to the customer's application. Promptfoo says its tests understand business logic, RAG, agents and integrations, and cover 50+ vulnerability types from injection to jailbreaks.[4]

Promptfoo connects to AI apps, agents, and workflows. Promptfoo provides remediation guidance directly in pull requests and developer workflows. Promptfoo lets teams track remediation progress and get suggested steps for each issue.[4][5]

The Community version includes all core features for local testing, evaluation, and vulnerability scanning. The open-source Community version includes up to 10k probes per month at no charge. Enterprise customers can purchase additional probes for larger scale testing. Enterprise pricing is customized based on a team's size and needs.[5]

Promptfoo lets customers manage LLM applications with teams-based access control and SSO, granular permission profiles, and customizable API access. Promptfoo provides real-time alerts and automated evaluations to show LLM security status across all projects. Promptfoo supports customizable plugin collections, scan configurations, and target settings that can be shared among colleagues.[5]

Promptfoo's LLM evaluation can be integrated into a CircleCI pipeline. Promptfoo can be integrated with test frameworks like Jest and Vitest to evaluate prompts as part of existing testing and CI workflows. Promptfoo's application-level jailbreak creation can be integrated with Burp Suite's Intruder feature for security testing of LLM-powered applications. Promptfoo can import eval test cases directly from Microsoft SharePoint CSV files using certificate-based authentication with Azure AD. Promptfoo configurations can reference prompts managed in Langfuse.[6][7][8][9][10]

Promptfoo offers real estate plugins that test every AI touchpoint, from property search to lending to advertising, across all 7 federally protected classes. Promptfoo tests AVM and appraisal AI for demographic correlation in valuations. Promptfoo's real estate testing covers home search assistants, neighborhood recommendation engines, property matching tools, and school district comparison features. Promptfoo's real estate testing can run entirely within a customer's infrastructure, with no applicant or transaction data leaving the environment. Promptfoo integrates with CI/CD pipelines to catch fair housing regressions before deployment. Promptfoo generates structured reports that map directly to Fair Housing Act and ECOA requirements.[11]

Promptfoo says its contributors are from companies like OpenAI, Google, Microsoft, and Amazon.[2][4][5][6][11]

Promptfoo on the record

Sources

Promptfoo full record

  1. [1]PressPromptfoo · promptfoo.dev · undated page, accessed November 4, 2026 · Tier A
  2. [2]promptfoo.devPromptfoo · promptfoo.dev · undated page, accessed November 4, 2026 · Tier A
  3. [3]About Promptfoo | AI Security Experts | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  4. [4]Build Secure AI Applications | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  5. [5]Pricing | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  6. [6]Setting up Promptfoo with CircleCI | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  7. [7]Testing prompts with Jest and Vitest | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  8. [8]Finding LLM Jailbreaks with Burp Suite | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  9. [9]SharePoint Integration | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  10. [10]Langfuse integration | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  11. [11]AI Security for Real Estate | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  12. [12]OpenAI acquires Promptfoo to secure its AI agents | TechCrunchTechCrunch · published March 9, 2026 · Tier B
  13. [13]OpenAI Buying AI Security Startup Promptfoo to Safeguard AI Agents - BloombergBloomberg · published March 9, 2026 · Tier B

XM Cyber full record

  1. [1]xmcyber.comXM Cyber · xmcyber.com · undated page, accessed September 27, 2026 · Tier A
  2. [2]Schwarz group acquires israeli hybrid cloud cybersecurity innovator xm cyberXM Cyber · xmcyber.com · published November 22, 2021 · Tier A
  3. [3]0,7340,L 3734737,00Calcalist · calcalistech.com · published March 23, 2018 · Tier B
  4. [4]Continuous Exposure Management | XM CyberXM Cyber · undated page, accessed October 30, 2026 · Tier A
  5. [5]Use case- Audit & ComplianceXM Cyber · undated page, accessed November 10, 2026 · Tier A
  6. [6]Platform | XM CyberXM Cyber · undated page, accessed November 10, 2026 · Tier A
  7. [7]Security Controls MonitoringXM Cyber · undated page, accessed November 10, 2026 · Tier A
  8. [8]Vulnerability Risk ManagementXM Cyber · undated page, accessed November 10, 2026 · Tier A
  9. [9]XM Cyber for Continuous Exposure Prioritization | XM CyberXM Cyber · undated page, accessed November 10, 2026 · Tier A
  10. [10]Safely Adopt AI Without Introducing RiskXM Cyber · undated page, accessed November 10, 2026 · Tier A
  11. [11]Case Studies | XM CyberXM Cyber · undated page, accessed November 10, 2026 · Tier A
  12. [12]Security, Compliance and Privacy | XM CyberXM Cyber · undated page, accessed November 10, 2026 · Tier A
  13. [13]Solution Briefs | XM CyberXM Cyber · undated page, accessed November 10, 2026 · Tier A
  14. [14]XM Cyber Named a Challenger in the Gartner® Magic Quadrant™ for Exposure Assessment Platforms | XM CyberXM Cyber · published November 13, 2025 · Tier A
  15. [15]XM Cyber Exposure Management Platform Reviews 2026G2 · undated page, accessed November 10, 2026 · Tier C

Spot a factual error? Request a correction.