CISO Tribune

Vendor comparison · 2 companies

Promptfoo vs Vonahi Security

Promptfoo builds open-source tools for secure, reliable AI applications. Vonahi Security sells vPenTest, an automated network penetration testing SaaS platform. vPenTest is a scripted network penetration testing platform that runs the exact same steps and processes performed by a security consultant doing a live pentest. vPenTest is a full-scale penetration testing platform that incorporates the knowledge, methodologies, techniques and commonly used tools of multiple consultants into a single platform. vPenTest covers host discovery, service enumeration, vulnerability analysis, exploitation, post-exploitation, privilege escalation and lateral movement, as well as documentation and reporting. CISO Tribune files both under Breach simulation and automated pen-testing. This page sets the two records side by side: what each sells, where it is based, who owns and funds it, the customers it names and its recent news, each fact numbered to its source.

Change the companies

Up to four companies side by side.

  • Promptfoo
  • Vonahi Security
Promptfoo vs Vonahi Security: Products, Customers and Funding Compared
PromptfooPromptfoo builds open-source tools for secure, reliable AI applications.promptfoo.devVonahi SecurityVonahi Security sells vPenTest, an automated network penetration testing SaaS platform. vPenTest is a scripted network penetration testing platform that runs the exact same steps and processes performed by a security consultant doing a live pentest. vPenTest is a full-scale penetration testing platform that incorporates the knowledge, methodologies, techniques and commonly used tools of multiple consultants into a single platform. vPenTest covers host discovery, service enumeration, vulnerability analysis, exploitation, post-exploitation, privilege escalation and lateral movement, as well as documentation and reporting.vonahi.io
What it sells
  • Red Teaming[2][4][5]Simulates real users to uncover application-specific vulnerabilities.
  • Evaluations[2][5]LLM evaluation of prompts and models that can run inside CI workflows.
  • vPenTest[1][2][3][4][5][7][10][11][12]A SaaS platform for automated network penetration testing. vPenTest covers internal and external network environments.
Categories
Headquarters
San Francisco, United States[1][3]Atlanta, GA, USA[1][11]
Founded
2024[1][12]Not stated on its pages
Ownership and funding
Owned by OpenAI[12]Owned by Kaseya[5]
Named customers
Not stated on its pagesNot stated on its pages
Recent news
  • March 9, 2026OpenAI agreed to buy Promptfoo, a startup helping businesses find and fix security issues in AI models during development.[13]
  • March 9, 2026OpenAI announced it has acquired Promptfoo, an AI security startup founded in 2024 to protect LLMs from adversarial attacks.[12]
Not stated on its pages
G2 and Gartner Peer Insights
  • G2: Not stated on its pages
  • Gartner Peer Insights: Not stated on its pages
  • G2: Not stated on its pages
  • Gartner Peer Insights: Not stated on its pages
Who it fits
Not written yetNot written yet
Last verified
November 4, 2026November 12, 2026

Where they overlap

  • Promptfoo and Vonahi Security are both filed under Breach simulation and automated pen-testing.

Where they differ, field by field

  • Promptfoo's primary category is AI model and agent security; Vonahi Security's is Penetration testing and red team services.
  • Promptfoo is also filed under AI firewalls and guardrails and Static application security testing.
  • Promptfoo lists Red Teaming and Evaluations. Vonahi Security lists vPenTest.
  • Promptfoo is headquartered in San Francisco, United States. Vonahi Security is headquartered in Atlanta, GA, USA.
  • Promptfoo was founded in 2024.
  • Promptfoo is owned by OpenAI. Vonahi Security is owned by Kaseya.

What it sells: Promptfoo

What Red Teaming does[2][4][5]
Promptfoo creates thousands of context-aware attacks tailored to the customer's application. The open-source Community version includes up to 10k probes per month at no charge.
What Evaluations does[2][5]
Promptfoo's LLM evaluation can be integrated into a CircleCI pipeline. Promptfoo can be integrated with test frameworks like Jest and Vitest to evaluate prompts as part of existing testing and CI workflows. Promptfoo provides real-time alerts and automated evaluations to show LLM security status across all projects.

Questions about Promptfoo and Vonahi Security

What do Promptfoo and Vonahi Security sell?
Promptfoo sells Red Teaming and Evaluations. Vonahi Security sells vPenTest.
Are Promptfoo and Vonahi Security in the same category?
They share Breach simulation and automated pen-testing. Promptfoo's primary category is AI model and agent security and Vonahi Security's is Penetration testing and red team services.
Where are Promptfoo and Vonahi Security headquartered?
Promptfoo is headquartered in San Francisco, United States. Vonahi Security is headquartered in Atlanta, GA, USA.
When were Promptfoo and Vonahi Security founded?
Promptfoo was founded in 2024.
Who owns Promptfoo and Vonahi Security?
Promptfoo is owned by OpenAI. Vonahi Security is owned by Kaseya.
What have Promptfoo and Vonahi Security announced recently?
March 9, 2026: OpenAI agreed to buy Promptfoo, a startup helping businesses find and fix security issues in AI models during development.

About Promptfoo

Promptfoo builds open-source tools for secure, reliable AI applications. Promptfoo is based in San Francisco, California, and is now part of OpenAI. Investors and operators backed Promptfoo early, and Promptfoo builds open-source, application-focused AI security.

Promptfoo's red teaming simulates real users to uncover application-specific vulnerabilities. Promptfoo creates thousands of context-aware attacks tailored to the customer's application. Promptfoo says its tests understand business logic, RAG, agents and integrations, and cover 50+ vulnerability types from injection to jailbreaks.[4]

Promptfoo connects to AI apps, agents, and workflows. Promptfoo provides remediation guidance directly in pull requests and developer workflows. Promptfoo lets teams track remediation progress and get suggested steps for each issue.[4][5]

The Community version includes all core features for local testing, evaluation, and vulnerability scanning. The open-source Community version includes up to 10k probes per month at no charge. Enterprise customers can purchase additional probes for larger scale testing. Enterprise pricing is customized based on a team's size and needs.[5]

Promptfoo lets customers manage LLM applications with teams-based access control and SSO, granular permission profiles, and customizable API access. Promptfoo provides real-time alerts and automated evaluations to show LLM security status across all projects. Promptfoo supports customizable plugin collections, scan configurations, and target settings that can be shared among colleagues.[5]

Promptfoo's LLM evaluation can be integrated into a CircleCI pipeline. Promptfoo can be integrated with test frameworks like Jest and Vitest to evaluate prompts as part of existing testing and CI workflows. Promptfoo's application-level jailbreak creation can be integrated with Burp Suite's Intruder feature for security testing of LLM-powered applications. Promptfoo can import eval test cases directly from Microsoft SharePoint CSV files using certificate-based authentication with Azure AD. Promptfoo configurations can reference prompts managed in Langfuse.[6][7][8][9][10]

Promptfoo offers real estate plugins that test every AI touchpoint, from property search to lending to advertising, across all 7 federally protected classes. Promptfoo tests AVM and appraisal AI for demographic correlation in valuations. Promptfoo's real estate testing covers home search assistants, neighborhood recommendation engines, property matching tools, and school district comparison features. Promptfoo's real estate testing can run entirely within a customer's infrastructure, with no applicant or transaction data leaving the environment. Promptfoo integrates with CI/CD pipelines to catch fair housing regressions before deployment. Promptfoo generates structured reports that map directly to Fair Housing Act and ECOA requirements.[11]

Promptfoo says its contributors are from companies like OpenAI, Google, Microsoft, and Amazon.[2][4][5][6][11]

Promptfoo on the record

Sources

Promptfoo full record

  1. [1]PressPromptfoo · promptfoo.dev · undated page, accessed November 4, 2026 · Tier A
  2. [2]promptfoo.devPromptfoo · promptfoo.dev · undated page, accessed November 4, 2026 · Tier A
  3. [3]About Promptfoo | AI Security Experts | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  4. [4]Build Secure AI Applications | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  5. [5]Pricing | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  6. [6]Setting up Promptfoo with CircleCI | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  7. [7]Testing prompts with Jest and Vitest | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  8. [8]Finding LLM Jailbreaks with Burp Suite | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  9. [9]SharePoint Integration | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  10. [10]Langfuse integration | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  11. [11]AI Security for Real Estate | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  12. [12]OpenAI acquires Promptfoo to secure its AI agents | TechCrunchTechCrunch · published March 9, 2026 · Tier B
  13. [13]OpenAI Buying AI Security Startup Promptfoo to Safeguard AI Agents - BloombergBloomberg · published March 9, 2026 · Tier B

Vonahi Security full record

  1. [1]Crest press releaseVonahi Security · vonahi.io · published June 12, 2024 · Tier A
  2. [2]vonahi.iovonahi.io · undated page, accessed November 12, 2026 · Tier A
  3. [3]ServicesVonahi Security · undated page, accessed November 12, 2026 · Tier A
  4. [4]CREST Penetration Testing 2025 | Vonahi SecurityVonahi Security · undated page, accessed November 12, 2026 · Tier A
  5. [5]Network Penetration Testing Platform | vPenTestVonahi Security · undated page, accessed November 12, 2026 · Tier A
  6. [6]Meet Our Team | Vonahi SecurityVonahi Security · undated page, accessed November 12, 2026 · Tier A
  7. [7]Automated Network Penetration Testing | Vonahi SecurityVonahi Security · undated page, accessed November 12, 2026 · Tier A
  8. [8]Get a vPenTest Pricing Quote | Vonahi SecurityVonahi Security · undated page, accessed November 12, 2026 · Tier A
  9. [9]InsurwaveVonahi Security · undated page, accessed November 12, 2026 · Tier A
  10. [10]Stratus ip Case Study | vPenTestVonahi Security · undated page, accessed November 12, 2026 · Tier A
  11. [11]NetcotechVonahi Security · undated page, accessed November 12, 2026 · Tier A
  12. [12]Case StudiesVonahi Security · undated page, accessed November 12, 2026 · Tier A

Spot a factual error? Request a correction.