CISO Tribune

Vendor comparison · 2 companies

Promptfoo vs Red Sentry

Promptfoo builds open-source tools for secure, reliable AI applications. Red Sentry sells offensive security services, from one-off penetration tests to ongoing PTaaS (Penetration Testing as a Service) partnerships. CISO Tribune files both under Breach simulation and automated pen-testing. This page sets the two records side by side: what each sells, where it is based, who owns and funds it, the customers it names and its recent news, each fact numbered to its source.

Change the companies

Up to four companies side by side.

  • Promptfoo
  • Red Sentry
Promptfoo vs Red Sentry: Products, Customers and Funding Compared
PromptfooPromptfoo builds open-source tools for secure, reliable AI applications.promptfoo.devRed SentryRed Sentry sells offensive security services, from one-off penetration tests to ongoing PTaaS (Penetration Testing as a Service) partnerships.redsentry.com
What it sells
  • Red Teaming[2][4][5]Simulates real users to uncover application-specific vulnerabilities.
  • Evaluations[2][5]LLM evaluation of prompts and models that can run inside CI workflows.
  • PTaaS[1][3][5]A platform that gives teams a central place to track findings, remediation, retesting, communication, and report delivery.
  • Source Code Review[7]Tool-assisted static analysis paired with manual security review and validation.
  • Red Teaming[4]A simulated full-scale attack that tests an organization's people, processes, and technology.
  • Physical Security Assessment[9]Tests whether physical controls, people, and processes prevent unauthorized access to agreed locations and objectives.
Categories
Headquarters
San Francisco, United States[1][3]Not stated on its pages
Founded
2024[1][12]Not stated on its pages
Ownership and funding
Owned by OpenAI[12]Not stated on its pages
Named customers
Not stated on its pagesNot stated on its pages
Recent news
  • March 9, 2026OpenAI agreed to buy Promptfoo, a startup helping businesses find and fix security issues in AI models during development.[13]
  • March 9, 2026OpenAI announced it has acquired Promptfoo, an AI security startup founded in 2024 to protect LLMs from adversarial attacks.[12]
Not stated on its pages
G2 and Gartner Peer Insights
  • G2: Not stated on its pages
  • Gartner Peer Insights: Not stated on its pages
  • G2: Not stated on its pages
  • Gartner Peer Insights: Not stated on its pages
Who it fits
Not written yetFrom its own pages, Red Sentry sells its testing services to organizations of all sizes. For mature security teams, Red Sentry offers advanced Red Teaming and adversary simulation. Red Sentry addresses buyers whose auditors require more than a scan. Red Sentry reviews both traditionally developed and AI-assisted codebases.
Last verified
November 4, 2026November 13, 2026

Where they overlap

  • Promptfoo and Red Sentry are both filed under Breach simulation and automated pen-testing.

Where they differ, field by field

  • Promptfoo's primary category is AI model and agent security; Red Sentry's is Penetration testing and red team services.
  • Promptfoo is also filed under AI firewalls and guardrails and Static application security testing. Red Sentry is also filed under Vulnerability management.
  • Promptfoo lists Red Teaming and Evaluations. Red Sentry lists PTaaS, Source Code Review, Red Teaming and Physical Security Assessment.
  • Promptfoo is headquartered in San Francisco, United States.
  • Promptfoo was founded in 2024.
  • Promptfoo is owned by OpenAI.

What it sells: Promptfoo

What Red Teaming does[2][4][5]
Promptfoo creates thousands of context-aware attacks tailored to the customer's application. The open-source Community version includes up to 10k probes per month at no charge.
What Evaluations does[2][5]
Promptfoo's LLM evaluation can be integrated into a CircleCI pipeline. Promptfoo can be integrated with test frameworks like Jest and Vitest to evaluate prompts as part of existing testing and CI workflows. Promptfoo provides real-time alerts and automated evaluations to show LLM security status across all projects.

What it sells: Red Sentry

What PTaaS does[1][3][5]
PTaaS means penetration testing as a service. Every Red Sentry engagement includes full access to the PTaaS platform at no extra cost. The platform offers Jira integration for pushing remediation tickets to engineering teams. Portal access lets teams track project status, access reports and evidence, and manage remediation.
What Source Code Review does[7]
Source code review is a standalone Red Sentry service. Red Sentry reviews traditionally developed and AI-assisted codebases using the same human-led security review process. One round of remediation testing is included when requested within 90 days of report delivery, unless otherwise scoped.
What Red Teaming does[4]
Red Sentry follows the MITRE ATT&CK framework to simulate the entire lifecycle of a breach. Red team work includes testing endpoint protection (EDR/AV) by attempting to execute custom malware or tools. Red Sentry collaborates with the Blue Team to explain how controls were bypassed.
What Physical Security Assessment does[9]
Physical security assessment is a standalone Red Sentry service. Red Sentry agrees written authorization and rules of engagement before testing starts. Findings are documented with photographic evidence, steps to recreate them, severity, and remediation guidance.

Questions about Promptfoo and Red Sentry

What do Promptfoo and Red Sentry sell?
Promptfoo sells Red Teaming and Evaluations. Red Sentry sells PTaaS, Source Code Review, Red Teaming and Physical Security Assessment.
Are Promptfoo and Red Sentry in the same category?
They share Breach simulation and automated pen-testing. Promptfoo's primary category is AI model and agent security and Red Sentry's is Penetration testing and red team services.
Where are Promptfoo and Red Sentry headquartered?
Promptfoo is headquartered in San Francisco, United States.
When were Promptfoo and Red Sentry founded?
Promptfoo was founded in 2024.
Who owns Promptfoo and Red Sentry?
Promptfoo is owned by OpenAI.
Who are Promptfoo and Red Sentry sold to?
From its own pages, Red Sentry sells its testing services to organizations of all sizes.
What have Promptfoo and Red Sentry announced recently?
March 9, 2026: OpenAI agreed to buy Promptfoo, a startup helping businesses find and fix security issues in AI models during development.

About Promptfoo

Promptfoo builds open-source tools for secure, reliable AI applications. Promptfoo is based in San Francisco, California, and is now part of OpenAI. Investors and operators backed Promptfoo early, and Promptfoo builds open-source, application-focused AI security.

Promptfoo's red teaming simulates real users to uncover application-specific vulnerabilities. Promptfoo creates thousands of context-aware attacks tailored to the customer's application. Promptfoo says its tests understand business logic, RAG, agents and integrations, and cover 50+ vulnerability types from injection to jailbreaks.[4]

Promptfoo connects to AI apps, agents, and workflows. Promptfoo provides remediation guidance directly in pull requests and developer workflows. Promptfoo lets teams track remediation progress and get suggested steps for each issue.[4][5]

The Community version includes all core features for local testing, evaluation, and vulnerability scanning. The open-source Community version includes up to 10k probes per month at no charge. Enterprise customers can purchase additional probes for larger scale testing. Enterprise pricing is customized based on a team's size and needs.[5]

Promptfoo lets customers manage LLM applications with teams-based access control and SSO, granular permission profiles, and customizable API access. Promptfoo provides real-time alerts and automated evaluations to show LLM security status across all projects. Promptfoo supports customizable plugin collections, scan configurations, and target settings that can be shared among colleagues.[5]

Promptfoo's LLM evaluation can be integrated into a CircleCI pipeline. Promptfoo can be integrated with test frameworks like Jest and Vitest to evaluate prompts as part of existing testing and CI workflows. Promptfoo's application-level jailbreak creation can be integrated with Burp Suite's Intruder feature for security testing of LLM-powered applications. Promptfoo can import eval test cases directly from Microsoft SharePoint CSV files using certificate-based authentication with Azure AD. Promptfoo configurations can reference prompts managed in Langfuse.[6][7][8][9][10]

Promptfoo offers real estate plugins that test every AI touchpoint, from property search to lending to advertising, across all 7 federally protected classes. Promptfoo tests AVM and appraisal AI for demographic correlation in valuations. Promptfoo's real estate testing covers home search assistants, neighborhood recommendation engines, property matching tools, and school district comparison features. Promptfoo's real estate testing can run entirely within a customer's infrastructure, with no applicant or transaction data leaving the environment. Promptfoo integrates with CI/CD pipelines to catch fair housing regressions before deployment. Promptfoo generates structured reports that map directly to Fair Housing Act and ECOA requirements.[11]

Promptfoo says its contributors are from companies like OpenAI, Google, Microsoft, and Amazon.[2][4][5][6][11]

Promptfoo on the record

Sources

Promptfoo full record

  1. [1]PressPromptfoo · promptfoo.dev · undated page, accessed November 4, 2026 · Tier A
  2. [2]promptfoo.devPromptfoo · promptfoo.dev · undated page, accessed November 4, 2026 · Tier A
  3. [3]About Promptfoo | AI Security Experts | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  4. [4]Build Secure AI Applications | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  5. [5]Pricing | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  6. [6]Setting up Promptfoo with CircleCI | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  7. [7]Testing prompts with Jest and Vitest | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  8. [8]Finding LLM Jailbreaks with Burp Suite | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  9. [9]SharePoint Integration | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  10. [10]Langfuse integration | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  11. [11]AI Security for Real Estate | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  12. [12]OpenAI acquires Promptfoo to secure its AI agents | TechCrunchTechCrunch · published March 9, 2026 · Tier B
  13. [13]OpenAI Buying AI Security Startup Promptfoo to Safeguard AI Agents - BloombergBloomberg · published March 9, 2026 · Tier B

Red Sentry full record

  1. [1]redsentry.comRed Sentry · redsentry.com · undated page, accessed November 13, 2026 · Tier A
  2. [2]DetailsRed Sentry · app.redsentry.com · undated page, accessed November 13, 2026 · Tier A
  3. [3]Red Sentry | Human-Led Penetration Testing & PTaaSRed Sentry · undated page, accessed November 13, 2026 · Tier A
  4. [4]Penetration Testing & Offensive Security Services | Red SentryRed Sentry · undated page, accessed November 13, 2026 · Tier A
  5. [5]Web Application Penetration Testing Services | Red SentryRed Sentry · undated page, accessed November 13, 2026 · Tier A
  6. [6]API Penetration Testing Services | Red SentryRed Sentry · undated page, accessed November 13, 2026 · Tier A
  7. [7]Secure Code Review Services | Red SentryRed Sentry · undated page, accessed November 13, 2026 · Tier A
  8. [8]Cloud Penetration Testing (AWS, Azure, GCP) | Red SentryRed Sentry · undated page, accessed November 13, 2026 · Tier A
  9. [9]Physical Security Pentesting | Red SentryRed Sentry · undated page, accessed November 13, 2026 · Tier A
  10. [10]Red Teaming Services: Objective-Based Attack Sims | Red SentryRed Sentry · undated page, accessed November 13, 2026 · Tier A
  11. [11]Social Engineering & Phishing Services | Red SentryRed Sentry · undated page, accessed November 13, 2026 · Tier A
  12. [12]SOC 2 Penetration Testing Support | Red SentryRed Sentry · undated page, accessed November 13, 2026 · Tier A
  13. [13]Network Pen Testing (Internal & External) | Red SentryRed Sentry · undated page, accessed November 13, 2026 · Tier A
  14. [14]Pen Testing Services for Modern Organizations | Red SentryRed Sentry · undated page, accessed November 13, 2026 · Tier A

Spot a factual error? Request a correction.