CISO Tribune

Vendor comparison · 2 companies

Bay vs Promptfoo

Bay is an AI agent security platform that gives enterprises visibility into every agent across devices, browsers and cloud workloads, and control over what those agents do in real time. Promptfoo builds open-source tools for secure, reliable AI applications. CISO Tribune files both under AI model and agent security. This page sets the two records side by side: what each sells, where it is based, who owns and funds it, the customers it names and its recent news, each fact numbered to its source.

Change the companies

Up to four companies side by side.

  • Bay
  • Promptfoo
Bay vs Promptfoo: Products, Customers and Funding Compared
BayBay is an AI agent security platform that gives enterprises visibility into every agent across devices, browsers and cloud workloads, and control over what those agents do in real time.bay.ioPromptfooPromptfoo builds open-source tools for secure, reliable AI applications.promptfoo.dev
What it sells
  • Bay[1][2][3][4][5][6][7][8][9]Bay is an AI agent security platform covering agents on devices, in browsers and in cloud workloads. Bay returns allow, ask, steer or block decisions on agent actions at runtime.
  • Lighthouse[6]Lighthouse is Bay's embedded agentic system that drafts policy from an organization's own agent activity.
  • Wave[3]Wave is the ephemeral binary Bay uses to deploy through an existing MDM or EDR.
  • Red Teaming[2][4][5]Simulates real users to uncover application-specific vulnerabilities.
  • Evaluations[2][5]LLM evaluation of prompts and models that can run inside CI workflows.
Categories
Headquarters
Not stated on its pagesSan Francisco, United States[1][3]
Founded
Not stated on its pages2024[1][12]
Ownership and funding
Not stated on its pagesOwned by OpenAI[12]
Named customers
Not stated on its pagesNot stated on its pages
Recent news
Not stated on its pages
  • March 9, 2026OpenAI agreed to buy Promptfoo, a startup helping businesses find and fix security issues in AI models during development.[13]
  • March 9, 2026OpenAI announced it has acquired Promptfoo, an AI security startup founded in 2024 to protect LLMs from adversarial attacks.[12]
G2 and Gartner Peer Insights
  • G2: Not stated on its pages
  • Gartner Peer Insights: Not stated on its pages
  • G2: Not stated on its pages
  • Gartner Peer Insights: Not stated on its pages
Who it fits
Not written yetNot written yet
Last verified
November 5, 2026November 4, 2026

Where they overlap

  • AI model and agent security is the primary category of both Bay and Promptfoo.

Where they differ, field by field

  • Bay is also filed under Endpoint management and application control and Workforce AI usage security. Promptfoo is also filed under AI firewalls and guardrails, Static application security testing and Breach simulation and automated pen-testing.
  • Bay lists Bay, Lighthouse and Wave. Promptfoo lists Red Teaming and Evaluations.
  • Promptfoo is headquartered in San Francisco, United States.
  • Promptfoo was founded in 2024.
  • Promptfoo is owned by OpenAI.

How they differ

CISO Tribune files both Bay and Promptfoo under AI model and agent security as their primary category, but they sell different things within it. Bay sells an AI agent security platform covering agents on devices, in browsers and in cloud workloads, and it returns allow, ask, steer or block decisions on agent actions at runtime. Promptfoo sells Red Teaming, which simulates real users to uncover application-specific vulnerabilities, and Evaluations, which covers LLM evaluation of prompts and models that can run inside CI workflows.

Bay maps every agent, MCP server, extension, model and skill on devices on its first scan, and it deploys with one script through an existing MDM without a proxy. Its Lighthouse system drafts policy from an organization's own agent activity, and Bay replays 30 days of agent history to show what a policy would do before enforcement. Promptfoo creates thousands of context-aware attacks tailored to a customer's application, and its open-source Community version includes up to 10k probes per month at no charge. Promptfoo's evaluation can be integrated into a CircleCI pipeline and with test frameworks like Jest and Vitest.

Bay is a Series A stage company, and its enterprise customers include Micron Technology, Peloton and ClickUp. Promptfoo is headquartered in San Francisco, United States, was founded in 2024, and is owned by OpenAI. On March 9, 2026, OpenAI announced it had acquired Promptfoo.

What it sells: Bay

What Bay does[1][2][3][4][5][6][7][8][9]
Bay maps every agent, MCP server, extension, model and skill on devices on its first scan. Bay builds a contextual entity graph of the users, MCP servers, SaaS apps and access connected to each agent. Bay deploys with one script through an existing MDM and does not require a proxy. Bay keeps full transcripts of prompts, actions and MCP calls.
What Lighthouse does[6]
Lighthouse drafts policy from an organization's own agent activity. Users answer 7 questions about risk appetite, and Lighthouse recommends a setting for each question and builds the policy. Bay replays 30 days of agent history to show what a policy would do before enforcement.
What Wave does[3]
Bay is agentless and deploys through an existing MDM or EDR using Wave, an ephemeral binary. There is no persistent agent to maintain and no proxy in the path.

What it sells: Promptfoo

What Red Teaming does[2][4][5]
Promptfoo creates thousands of context-aware attacks tailored to the customer's application. The open-source Community version includes up to 10k probes per month at no charge.
What Evaluations does[2][5]
Promptfoo's LLM evaluation can be integrated into a CircleCI pipeline. Promptfoo can be integrated with test frameworks like Jest and Vitest to evaluate prompts as part of existing testing and CI workflows. Promptfoo provides real-time alerts and automated evaluations to show LLM security status across all projects.

Questions about Bay and Promptfoo

What do Bay and Promptfoo sell?
Bay sells Bay, Lighthouse and Wave. Promptfoo sells Red Teaming and Evaluations.
Are Bay and Promptfoo in the same category?
Yes. AI model and agent security is the primary category of both on CISO Tribune.
Where are Bay and Promptfoo headquartered?
Promptfoo is headquartered in San Francisco, United States.
When were Bay and Promptfoo founded?
Promptfoo was founded in 2024.
Who owns Bay and Promptfoo?
Promptfoo is owned by OpenAI.
What have Bay and Promptfoo announced recently?
March 9, 2026: OpenAI agreed to buy Promptfoo, a startup helping businesses find and fix security issues in AI models during development.

About Bay

Bay is an AI agent security platform that gives enterprises visibility into every agent across devices, browsers and cloud workloads, and control over what those agents do in real time. Bay describes AI endpoint security as protection for the AI agents, coding assistants and MCP servers running on employee devices. Bay was founded by three engineers who spent their careers in endpoint and API security. Bay is a Series A stage company.[2][3]

Teams run agents like Claude Code, Codex, Gemini CLI and GitHub Copilot in clusters, cloud workspaces and hosted sessions.[5]

Bay finds and maps agents first. On the first scan, Bay maps every agent, MCP server, extension, model and skill on devices, including ones nobody approved. Bay finds every agent, extension, CLI tool, MCP server, skill and model on employee devices. Bay builds a contextual entity graph of how everything connects: the user behind each agent, the MCP servers and SaaS apps it touches, and the access it holds. Bay scans every agent, package, extension, MCP server and skill for malicious indicators before approval. In the browser, Bay brings shadow AI into view, covering chatbots, extensions and embedded SaaS agents. In cloud environments, Bay discovers agents across virtual machines, Kubernetes, Coder workspaces and hosted sessions.[1][3][5][6][7]

Lighthouse, Bay's embedded agentic system, drafts policy from an organization's own agent activity. Users answer 7 questions about risk appetite, and Lighthouse recommends a setting for each question and builds the policy. Policies can be scoped by IdP group, device or runtime, and can set which MCP servers can read or write. Before enforcement, Bay replays 30 days of agent history to show what a policy would do before any user is affected. Bay also lets teams run any policy in simulation mode to see what it would allow, ask or block. At runtime, Bay enforces guardrails inline with the agentic action and returns allow, ask, steer or block in milliseconds. Bay can also prevent prompt injection attempts at runtime.[6]

Bay keeps records of agent activity. Bay keeps full transcripts of prompts, actions and MCP calls, traceable to the person behind each session. A metadata-only mode in Bay keeps prompts on the device when they must not leave it. Bay ties every prompt and agent action to a real identity, corporate or personal. Bay logs every policy change and agent action with who approved it and whether a person or an agent took it. Every decision in Bay is logged against the policy behind it, ready for auditors. Bay connects to an identity provider, so every policy applies to the right people and groups.[5][6][7][8]

Bay also checks configuration. Bay checks how every agent and AI tool is set up, across devices and cloud workloads, so risky settings can be fixed before an agent puts them to use. Bay spots bypass-permissions mode, sandboxes switched off and unrestricted tool access, rates how serious each one is and shows how to fix it. Bay finds the credentials, tokens and secrets that agents and MCP servers can read.[9]

Bay deploys with one script through an existing MDM and does not require a proxy to route traffic through. Bay deploys through an existing MDM or EDR using Wave, an ephemeral binary, so there is no persistent agent to maintain. Bay tells corporate AI accounts from personal ones, including in personal Chrome profiles. Bay's enterprise customers include Micron Technology, Peloton and ClickUp.[1][2][3][6][7][8]

Bay on the record

Sources

Bay full record

  1. [1]bay.ioBay · bay.io · undated page, accessed November 5, 2026 · Tier A
  2. [2]Security Researcher — Careers at BayBay · undated page, accessed November 10, 2026 · Tier A
  3. [3]AI Endpoint Security — BayBay · undated page, accessed November 10, 2026 · Tier A
  4. [4]About — BayBay · undated page, accessed November 10, 2026 · Tier A
  5. [5]Cloud Workspaces — BayBay · undated page, accessed November 10, 2026 · Tier A
  6. [6]Platform — BayBay · undated page, accessed November 10, 2026 · Tier A
  7. [7]Browser — BayBay · undated page, accessed November 10, 2026 · Tier A
  8. [8]AI Governance & Compliance — BayBay · undated page, accessed November 10, 2026 · Tier A
  9. [9]AI Security Posture — BayBay · undated page, accessed November 10, 2026 · Tier A

Promptfoo full record

  1. [1]PressPromptfoo · promptfoo.dev · undated page, accessed November 4, 2026 · Tier A
  2. [2]promptfoo.devPromptfoo · promptfoo.dev · undated page, accessed November 4, 2026 · Tier A
  3. [3]About Promptfoo | AI Security Experts | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  4. [4]Build Secure AI Applications | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  5. [5]Pricing | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  6. [6]Setting up Promptfoo with CircleCI | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  7. [7]Testing prompts with Jest and Vitest | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  8. [8]Finding LLM Jailbreaks with Burp Suite | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  9. [9]SharePoint Integration | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  10. [10]Langfuse integration | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  11. [11]AI Security for Real Estate | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  12. [12]OpenAI acquires Promptfoo to secure its AI agents | TechCrunchTechCrunch · published March 9, 2026 · Tier B
  13. [13]OpenAI Buying AI Security Startup Promptfoo to Safeguard AI Agents - BloombergBloomberg · published March 9, 2026 · Tier B

Spot a factual error? Request a correction.