Promptfoo

Promptfoo is a CLI and library for testing, evaluating, and red-teaming LLM applications. It compares prompts, models, and RAG pipelines with automated assertions, scores outputs against expected behavior, and includes vulnerability scanning and adversarial red-teaming for security testing. It installs via npm, Homebrew, or pip and runs without setup through npx. Released under the MIT license.