garak
Vulnerability scanner for large language models
garak is profiled here as a Testing tool for engineering teams. Read about features, pricing, and how it compares to related options in the tools directory.
Description
Garak is an open-source LLM vulnerability scanner created by Leon Derczynski and now maintained under NVIDIA's GitHub organization. It fires libraries of adversarial probes at a model or endpoint, covering prompt injection, jailbreaks, data leakage, toxicity, and hallucination, then reports which attacks landed. Security teams run it before release to find weaknesses while they are still cheap to fix. Each run produces a report that maps findings to specific probe categories, so fixes can be verified by running the same scan again.
Key Capabilities:
Probe library covering prompt injection, jailbreak, encoding, and exfiltration attacks
Detectors that score outputs for leakage, harmful content, and hallucination
Support for OpenAI-compatible APIs, Hugging Face models, REST endpoints, and Ollama
Report generation with per-probe hit rates for security review
Plugin architecture for custom probes and detectors
Apache 2.0 license with NVIDIA-maintained releases
Alternative tools
- Pulumi
Infrastructure as code in general-purpose programming languages
- Momentic
AI-powered end-to-end testing written in plain English
- OpenHands
Open-source autonomous coding agent for real development tasks
- DeepChecks
Validate ML models, LLM applications, and AI agent decisions across every development stage
- CodeGeeX
Free open-source AI coding assistant from Tsinghua University
- Sourcery
Automated AI code reviewer for GitHub and GitLab pull requests