CISO Tribune

Vendor comparison · 2 companies

NetSPI vs Promptfoo

NetSPI sells pentesting as a service (PTaaS), attack surface management (ASM), and breach and attack simulation (BAS) as a service. Promptfoo builds open-source tools for secure, reliable AI applications. CISO Tribune files both under Breach simulation and automated pen-testing. This page sets the two records side by side: what each sells, where it is based, who owns and funds it, the customers it names and its recent news, each fact numbered to its source.

Change the companies

Up to four companies side by side.

  • NetSPI
  • Promptfoo
NetSPI vs Promptfoo: Products, Customers and Funding Compared
NetSPINetSPI sells pentesting as a service (PTaaS), attack surface management (ASM), and breach and attack simulation (BAS) as a service.netspi.comPromptfooPromptfoo builds open-source tools for secure, reliable AI applications.promptfoo.dev
What it sells
  • AI/ML Pentesting[3]Pentesting of AI and ML systems that includes LLM testing and jailbreaking.
  • Red Team Operations[6]Red team exercises that test security controls, policies, incident response and training.
  • Detective Controls Testing[7]Attack simulations that validate whether security tools detect threats.
  • Social Engineering[6]Email, text, phone and physical social engineering assessments.
  • Red Teaming[2][4][5]Simulates real users to uncover application-specific vulnerabilities.
  • Evaluations[2][5]LLM evaluation of prompts and models that can run inside CI workflows.
Categories
Headquarters
Not stated on its pagesSan Francisco, United States[1][3]
Founded
Not stated on its pages2024[1][12]
Ownership and funding
Not stated on its pagesOwned by OpenAI[12]
Named customers
Not stated on its pagesNot stated on its pages
Recent news
Not stated on its pages
  • March 9, 2026OpenAI agreed to buy Promptfoo, a startup helping businesses find and fix security issues in AI models during development.[13]
  • March 9, 2026OpenAI announced it has acquired Promptfoo, an AI security startup founded in 2024 to protect LLMs from adversarial attacks.[12]
G2 and Gartner Peer Insights
  • G2: Not stated on its pages
  • Gartner Peer Insights: Not stated on its pages
  • G2: Not stated on its pages
  • Gartner Peer Insights: Not stated on its pages
Who it fits
Not written yetNot written yet
Last verified
November 13, 2026November 4, 2026

Where they overlap

  • NetSPI and Promptfoo are both filed under Breach simulation and automated pen-testing.

Where they differ, field by field

  • NetSPI's primary category is Penetration testing and red team services; Promptfoo's is AI model and agent security.
  • NetSPI is also filed under External attack surface management and Exposure prioritisation and CTEM. Promptfoo is also filed under AI firewalls and guardrails and Static application security testing.
  • NetSPI lists AI/ML Pentesting, Red Team Operations, Detective Controls Testing and Social Engineering. Promptfoo lists Red Teaming and Evaluations.
  • Promptfoo is headquartered in San Francisco, United States.
  • Promptfoo was founded in 2024.
  • Promptfoo is owned by OpenAI.

What it sells: NetSPI

What AI/ML Pentesting does[3]
NetSPI's AI/ML Pentesting includes expert LLM testing and jailbreaking. Microsoft partnered with NetSPI to build a standardized AI security testing framework for its 70+ products.
What Red Team Operations does[6]
NetSPI's Red Team Operations test security controls, policies, incident response and training. NetSPI partners with selected threat intelligence providers to test the resiliency of critical systems.
What Detective Controls Testing does[7]
NetSPI Detective Controls Testing validates that security tools operate effectively across endpoint security solutions, network security solutions, SIEMs and MSSPs. NetSPI's ransomware simulation pack covers TTPs and behaviors from real-world ransomware campaigns.
What Social Engineering does[6]
NetSPI's social engineering experts deliver findings from email, text, phone and physical scenarios. NetSPI runs custom phishing engagements to identify gaps in security procedures and technical controls.

What it sells: Promptfoo

What Red Teaming does[2][4][5]
Promptfoo creates thousands of context-aware attacks tailored to the customer's application. The open-source Community version includes up to 10k probes per month at no charge.
What Evaluations does[2][5]
Promptfoo's LLM evaluation can be integrated into a CircleCI pipeline. Promptfoo can be integrated with test frameworks like Jest and Vitest to evaluate prompts as part of existing testing and CI workflows. Promptfoo provides real-time alerts and automated evaluations to show LLM security status across all projects.

Questions about NetSPI and Promptfoo

What do NetSPI and Promptfoo sell?
NetSPI sells AI/ML Pentesting, Red Team Operations, Detective Controls Testing and Social Engineering. Promptfoo sells Red Teaming and Evaluations.
Are NetSPI and Promptfoo in the same category?
They share Breach simulation and automated pen-testing. NetSPI's primary category is Penetration testing and red team services and Promptfoo's is AI model and agent security.
Where are NetSPI and Promptfoo headquartered?
Promptfoo is headquartered in San Francisco, United States.
When were NetSPI and Promptfoo founded?
Promptfoo was founded in 2024.
Who owns NetSPI and Promptfoo?
Promptfoo is owned by OpenAI.
What have NetSPI and Promptfoo announced recently?
March 9, 2026: OpenAI agreed to buy Promptfoo, a startup helping businesses find and fix security issues in AI models during development.

About NetSPI

NetSPI sells pentesting as a service (PTaaS), attack surface management (ASM), and breach and attack simulation (BAS) as a service. NetSPI's inception was in 2001. NetSPI states that it has more than 20 years of history, 350+ experts and 50+ pentesting services. NetSPI combines human penetration testers with purpose-built AI to deliver continuous cybersecurity testing. NetSPI embeds AI throughout its testing methodologies. The NetSPI Platform is designed for modern enterprises managing ongoing pentesting programs and complex attack surfaces. The NetSPI Platform lets users manage integrations, scans and agents in one centralized workflow.[2][3]

NetSPI offers pentesting for web, API, mobile, thick and virtual applications, and AI/ML pentesting. NetSPI's AI/ML pentesting includes expert LLM testing and jailbreaking. Microsoft partnered with NetSPI to build a standardized AI security testing framework for its 70+ products. NetSPI's cloud pentesting covers AWS, Azure and Google Cloud infrastructures. NetSPI tests z/OS mainframes, including the CICS and IMS region and application. NetSPI's network pentesting covers internal, external, wireless, host-based and virtual desktop networks. NetSPI tests hardware systems in automotive, medical device, IoT, ATM and operational technology settings. Testers on the NetSPI Platform are supported by certifications such as OSCP, OSCE, GXPN, GPEN, GWAPT, CISSP, CEH and CREST. NetSPI introduced EchoBench, a human-calibrated benchmark for autonomous AI web app pentesting.[3][5]

NetSPI sells security assessments and strategic advisory services tailored to an organization's needs. NetSPI's Red Team Operations test security controls, policies, incident response and training. NetSPI's social engineering experts deliver findings from email, text, phone and physical scenarios. NetSPI runs custom phishing engagements to identify gaps in security procedures and technical controls.[3][6]

NetSPI Detective Controls Testing validates that security tools operate effectively across endpoint security solutions, network security solutions, SIEMs and MSSPs. NetSPI's ransomware simulation pack simulates TTPs and behaviors from real-world ransomware campaigns, including threat actors such as CL0P, BlackCat and Fin7. NetSPI's Azure simulation pack runs authenticated and anonymous attacks against Azure, including command execution, credential guessing and sensitive data gathering. NetSPI's Linux simulation pack focuses on tactics often used to exploit Linux environments, such as remote code execution, shell configuration modifications and data extraction. NetSPI's macOS simulation pack addresses Apple's macOS with simulations for Command & Script Interpreter execution, LaunchAgent persistence and data exfiltration. NetSPI's ESXi simulation pack simulates adversarial tactics such as brute force and ransomware that are common in ESXi environments. NetSPI's threat modeling service takes a holistic approach to identifying potential threats to a company's systems and applications. NetSPI experts review source code manually to identify vulnerabilities that automated scanners cannot detect. NetSPI's cybersecurity maturity work assesses current cybersecurity program structure and maturity, then reviews current business objectives and compliance requirements.[6][7]

NetSPI automatically scans an organization's external perimeter and internal assets with integrations across identities, applications and devices. The NetSPI Platform automatically scans the external perimeter, including look-alike domains and dark web exposures. NetSPI also gives visibility across owned assets and the internal attack surface, including users, applications, devices and clouds. NetSPI's AWS cloud configuration review detects public exposure of sensitive credentials and proprietary data in AWS environments. The NetSPI Platform tracks changes to an Azure cloud environment and its configurations over time. NetSPI's centralized threat intelligence dashboard consolidates multiple dark web data sources. NetSPI provides continuous discovery and assessment of both registered and unregistered look-alike domains. With domain monitoring on the NetSPI Platform, users can prioritize threats and prepare takedown reports based on domain association, brand abuse and threat confirmation findings. NetSPI offers integrations across asset managers, IAM and vulnerabilities.[3]

NetSPI offers MCP integration for AI and LLMs to its validated vulnerability data. An MCP-compatible AI assistant can be connected to the NetSPI Platform MCP Server.[3][8]

Chubb is a commercial and personal property and casualty insurer with operations in 54 countries. NetSPI and Chubb have a partnership aimed at the security posture and underwriting outcomes of Chubb's clients. Chubb says NetSPI performs on-demand penetration tests for some of its insureds as part of the underwriting process for their renewals. Chubb uses NetSPI's Attack Surface Management platform to identify vulnerabilities and other security issues for its policyholders. NetSPI works with channel and technology partners who deliver proactive security services to customers across the globe.[1][2][5][6][7][8][9]

NetSPI on the record

Sources

NetSPI full record

  1. [1]netspi.comNetSPI · netspi.com · undated page, accessed November 13, 2026 · Tier A
  2. [2]About Us - NetSPINetSPI · undated page, accessed November 13, 2026 · Tier A
  3. [3]NetSPI - Proactive Cyber Security | PTaaS, ASM, BASNetSPI · undated page, accessed November 13, 2026 · Tier A
  4. [4]The NetSPI Platform - NetSPINetSPI · undated page, accessed November 13, 2026 · Tier A
  5. [5]Customer Stories - NetSPINetSPI · undated page, accessed November 13, 2026 · Tier A
  6. [6]Cyber Security Assessments & Strategic Advisory Services - NetSPINetSPI · undated page, accessed November 13, 2026 · Tier A
  7. [7]Detective Controls Testing: Attack Simulation & Control ValidationNetSPI · undated page, accessed November 13, 2026 · Tier A
  8. [8]Model Context Protocol - NetSPINetSPI · undated page, accessed November 13, 2026 · Tier A
  9. [9]NetSPI Customer Case Study – ChubbNetSPI · undated page, accessed November 13, 2026 · Tier A

Promptfoo full record

  1. [1]PressPromptfoo · promptfoo.dev · undated page, accessed November 4, 2026 · Tier A
  2. [2]promptfoo.devPromptfoo · promptfoo.dev · undated page, accessed November 4, 2026 · Tier A
  3. [3]About Promptfoo | AI Security Experts | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  4. [4]Build Secure AI Applications | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  5. [5]Pricing | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  6. [6]Setting up Promptfoo with CircleCI | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  7. [7]Testing prompts with Jest and Vitest | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  8. [8]Finding LLM Jailbreaks with Burp Suite | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  9. [9]SharePoint Integration | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  10. [10]Langfuse integration | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  11. [11]AI Security for Real Estate | PromptfooPromptfoo · undated page, accessed November 10, 2026 · Tier A
  12. [12]OpenAI acquires Promptfoo to secure its AI agents | TechCrunchTechCrunch · published March 9, 2026 · Tier B
  13. [13]OpenAI Buying AI Security Startup Promptfoo to Safeguard AI Agents - BloombergBloomberg · published March 9, 2026 · Tier B

Spot a factual error? Request a correction.