Promptfoo

Promptfoo is an open-source CLI tool and library designed for testing, evaluating, and red-teaming LLM applications. Built for developers, AI engineers, and security teams, Promptfoo enables automated testing of prompts, model outputs, and agentic workflows to ensure safety, performance, and reliability before production deployment.

Features of Promptfoo:

• Evaluates LLM output quality, accuracy, and compliance using custom assertions and automated metrics.
• Supports red-teaming and security testing to detect prompt injections, jailbreaks, and vulnerabilities.
• Integrates seamlessly with top LLM providers, including OpenAI, Anthropic, Ollama, and custom endpoints.
• Provides continuous integration (CI/CD) support to run evaluations automatically on every code change.
• Enables side-by-side comparison of prompt versions, temperature settings, and model performances.
• Offers a lightweight local web UI and CLI interface for fast, private developer workflows.
• Supports customizable evaluation logic using Python, JavaScript, or declarative YAML configs.

Promptfoo usage:

$ sudo su

# Verify installation:
$ which promptfoo
$ promptfoo --version
$ npm list -g promptfoo

Disclaimer: Promptfoo is provided under its applicable open-source licensing terms. Users are responsible for ensuring compliance with applicable laws, API provider policies, security practices, and organizational guidelines when evaluating models, executing red-teaming tests, or processing sensitive data.