CISO Tribune

Vendor comparison · 2 companies

Promptfoo vs Skyhawk Security

Promptfoo builds open-source tools for secure, reliable AI applications. Skyhawk Security sells an agentless AI purple team platform that uses the same tools adversaries do. CISO Tribune files both under Breach simulation and automated pen-testing. This page sets the two records side by side: what each sells, where it is based, who owns and funds it, the customers it names and its recent news, each fact numbered to its source.

Change the companies

Up to four companies side by side.

  • Promptfoo
  • Skyhawk Security
Promptfoo vs Skyhawk Security: Products, Customers and Funding Compared
PromptfooPromptfoo builds open-source tools for secure, reliable AI applications.promptfoo.devSkyhawk SecuritySkyhawk Security sells an agentless AI purple team platform that uses the same tools adversaries do.skyhawk.security
What it sells
  • Red Teaming[2][4][5]Simulates real users to uncover application-specific vulnerabilities.
  • Evaluations[2][5]LLM evaluation of prompts and models that can run inside CI workflows.
  • Skyhawk Autonomous Purple Team[5]Ingests findings from a customer's CNAPP, SIEM and vulnerability management tools and runs adversary simulations in an AI-generated replica of the production environment to check whether a finding is actually exploitable.
Categories
Headquarters
San Francisco, United States[1][3]Not stated on its pages
Founded
2024[1][12]Not stated on its pages
Ownership and funding
Owned by OpenAI[12]Privately held[3][7]
Named customers
Not stated on its pagesNot stated on its pages
Recent news
  • March 9, 2026OpenAI agreed to buy Promptfoo, a startup helping businesses find and fix security issues in AI models during development.[13]
  • March 9, 2026OpenAI announced it has acquired Promptfoo, an AI security startup founded in 2024 to protect LLMs from adversarial attacks.[12]
Not stated on its pages
G2 and Gartner Peer Insights
  • G2: Not stated on its pages
  • Gartner Peer Insights: Not stated on its pages
  • G2: Not stated on its pages
  • Gartner Peer Insights: Not stated on its pages
Who it fits
Not written yetFrom its own pages, Skyhawk Security sells mainly to security teams and application teams that work with cloud security tools such as CNAPP, SIEM and vulnerability management. Skyhawk Security describes those teams as inundated with critical alerts. Skyhawk Autonomous Purple Team is delivered through a SaaS platform and ingests findings without requiring agents.
Last verified
November 4, 2026November 2, 2026

Where they overlap

  • Promptfoo and Skyhawk Security are both filed under Breach simulation and automated pen-testing.

Where they differ, field by field

  • Promptfoo's primary category is AI model and agent security; Skyhawk Security's is Cloud detection and response.
  • Promptfoo is also filed under AI firewalls and guardrails and Static application security testing.
  • Promptfoo lists Red Teaming and Evaluations. Skyhawk Security lists Skyhawk Autonomous Purple Team.
  • Promptfoo is headquartered in San Francisco, United States.
  • Promptfoo was founded in 2024.
  • Promptfoo is owned by OpenAI. Skyhawk Security is privately held.

What it sells: Promptfoo

What Red Teaming does[2][4][5]
Promptfoo creates thousands of context-aware attacks tailored to the customer's application. The open-source Community version includes up to 10k probes per month at no charge.
What Evaluations does[2][5]
Promptfoo's LLM evaluation can be integrated into a CircleCI pipeline. Promptfoo can be integrated with test frameworks like Jest and Vitest to evaluate prompts as part of existing testing and CI workflows. Promptfoo provides real-time alerts and automated evaluations to show LLM security status across all projects.

Questions about Promptfoo and Skyhawk Security

What do Promptfoo and Skyhawk Security sell?
Promptfoo sells Red Teaming and Evaluations. Skyhawk Security sells Skyhawk Autonomous Purple Team.
Are Promptfoo and Skyhawk Security in the same category?
They share Breach simulation and automated pen-testing. Promptfoo's primary category is AI model and agent security and Skyhawk Security's is Cloud detection and response.
Where are Promptfoo and Skyhawk Security headquartered?
Promptfoo is headquartered in San Francisco, United States.
When were Promptfoo and Skyhawk Security founded?
Promptfoo was founded in 2024.
Who owns Promptfoo and Skyhawk Security?
Promptfoo is owned by OpenAI. Skyhawk Security is privately held.
Who are Promptfoo and Skyhawk Security sold to?
From its own pages, Skyhawk Security sells mainly to security teams and application teams that work with cloud security tools such as CNAPP, SIEM and vulnerability management.
What have Promptfoo and Skyhawk Security announced recently?
March 9, 2026: OpenAI agreed to buy Promptfoo, a startup helping businesses find and fix security issues in AI models during development.

About Promptfoo

Promptfoo builds open-source tools for secure, reliable AI applications. Promptfoo is based in San Francisco, California, and is now part of OpenAI. Investors and operators backed Promptfoo early, and Promptfoo builds open-source, application-focused AI security.

Promptfoo's red teaming simulates real users to uncover application-specific vulnerabilities. Promptfoo creates thousands of context-aware attacks tailored to the customer's application. Promptfoo says its tests understand business logic, RAG, agents and integrations, and cover 50+ vulnerability types from injection to jailbreaks.[4]

Promptfoo connects to AI apps, agents, and workflows. Promptfoo provides remediation guidance directly in pull requests and developer workflows. Promptfoo lets teams track remediation progress and get suggested steps for each issue.[4][5]

The Community version includes all core features for local testing, evaluation, and vulnerability scanning. The open-source Community version includes up to 10k probes per month at no charge. Enterprise customers can purchase additional probes for larger scale testing. Enterprise pricing is customized based on a team's size and needs.[5]

Promptfoo lets customers manage LLM applications with teams-based access control and SSO, granular permission profiles, and customizable API access. Promptfoo provides real-time alerts and automated evaluations to show LLM security status across all projects. Promptfoo supports customizable plugin collections, scan configurations, and target settings that can be shared among colleagues.[5]

Promptfoo's LLM evaluation can be integrated into a CircleCI pipeline. Promptfoo can be integrated with test frameworks like Jest and Vitest to evaluate prompts as part of existing testing and CI workflows. Promptfoo's application-level jailbreak creation can be integrated with Burp Suite's Intruder feature for security testing of LLM-powered applications. Promptfoo can import eval test cases directly from Microsoft SharePoint CSV files using certificate-based authentication with Azure AD. Promptfoo configurations can reference prompts managed in Langfuse.[6][7][8][9][10]

Promptfoo offers real estate plugins that test every AI touchpoint, from property search to lending to advertising, across all 7 federally protected classes. Promptfoo tests AVM and appraisal AI for demographic correlation in valuations. Promptfoo's real estate testing covers home search assistants, neighborhood recommendation engines, property matching tools, and school district comparison features. Promptfoo's real estate testing can run entirely within a customer's infrastructure, with no applicant or transaction data leaving the environment. Promptfoo integrates with CI/CD pipelines to catch fair housing regressions before deployment. Promptfoo generates structured reports that map directly to Fair Housing Act and ECOA requirements.[11]

Promptfoo says its contributors are from companies like OpenAI, Google, Microsoft, and Amazon.[2][4][5][6][11]

Promptfoo on the record

Sources

Promptfoo full record

  1. [1]PressPromptfoo · promptfoo.dev · undated page, accessed November 4, 2026 · Tier A
  2. [2]promptfoo.devPromptfoo · promptfoo.dev · undated page, accessed November 4, 2026 · Tier A
  3. [3]About Promptfoo | AI Security Experts | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  4. [4]Build Secure AI Applications | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  5. [5]Pricing | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  6. [6]Setting up Promptfoo with CircleCI | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  7. [7]Testing prompts with Jest and Vitest | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  8. [8]Finding LLM Jailbreaks with Burp Suite | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  9. [9]SharePoint Integration | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  10. [10]Langfuse integration | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  11. [11]AI Security for Real Estate | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  12. [12]OpenAI acquires Promptfoo to secure its AI agents | TechCrunchTechCrunch · published March 9, 2026 · Tier B
  13. [13]OpenAI Buying AI Security Startup Promptfoo to Safeguard AI Agents - BloombergBloomberg · published March 9, 2026 · Tier B

Skyhawk Security full record

  1. [1]skyhawk.securitySkyhawk Security · skyhawk.security · undated page, accessed September 27, 2026 · Tier A
  2. [2]Radware launches skyhawk securitySkyhawk Security · skyhawk.security · undated page, accessed December 1, 2022 · Tier A
  3. [3]496094 68PitchBook · pitchbook.com · undated page, accessed September 27, 2026 · Tier C
  4. [4]About Us - Skyhawk SecuritySkyhawk Security · undated page, accessed October 28, 2026 · Tier A
  5. [5]Homepage - Skyhawk SecuritySkyhawk Security · undated page, accessed October 28, 2026 · Tier A
  6. [6]Skyhawk Security Strengthens Autonomous Red Team with Agentic AI, Enabling Continuous Security Control Validation - Skyhawk SecuritySkyhawk Security · published December 2, 2025 · Tier A
  7. [7]New Horizons in Cloud Security Part 2: Benchmarking and Novel Self-improving AI Framework for Maliciousness Classification Using Large Language Models - Skyhawk SecuritySkyhawk Security · undated page, accessed October 28, 2026 · Tier A
  8. [8]Platform - Skyhawk SecuritySkyhawk Security · undated page, accessed October 28, 2026 · Tier A
  9. [9]5 Reasons Why CSPM Tools are not Enough - Skyhawk SecuritySkyhawk Security · undated page, accessed November 10, 2026 · Tier A
  10. [10]Three Reasons why SIEMs are not Enough - Skyhawk SecuritySkyhawk Security · undated page, accessed November 10, 2026 · Tier A
  11. [11]The Science Behind our Security Part 1: Machine Learning - Skyhawk SecuritySkyhawk Security · undated page, accessed November 10, 2026 · Tier A
  12. [12]Skyhawk Synthesis Security Platform mentioned in the 2023 Gartner® Emerging Tech: Security — Cloud Investigation and Response Automation Offers Transformation Opportunities - Skyhawk SecuritySkyhawk Security · undated page, accessed November 10, 2026 · Tier A
  13. [13]Essential Steps to Improve Your AWS Cloud Security | SkyhawkSkyhawk Security · undated page, accessed November 10, 2026 · Tier A
  14. [14]The Science Behind our Security - Part 2: The Models - Skyhawk SecuritySkyhawk Security · undated page, accessed November 10, 2026 · Tier A

Spot a factual error? Request a correction.