AgentDojo
AgentDojo: A self-hosted Python framework for benchmarking prompt injection and agent defenses. Ranked #28 of 29 in AI Security Testing Tools by our editors (6.4/10); pricing: Free plan; best for researchers benchmarking agent defenses.
At a glance
- Editor score6.4 / 10
- PricingFree plan
- Best forResearchers benchmarking agent defenses
- Free planYes
- Paid fromFree
- Prompt injection testsYes
- Facts checked21 Sep 2026
Where it wins
- Free open source with prompt-injection and jailbreak benchmarks
- Create custom attacks, tasks, suites, pipelines, and defenses
- Measures both security and utility across agent workflows
Where it doesn't
- Self-hosted deployment requires a suitable local environment
- Focused on tool-using LLM agent evaluation
- Does not verify leakage or unsafe-output testing
Our verdict on AgentDojo
AgentDojo is an open-source Python framework and benchmark for evaluating prompt-injection attacks and defenses in tool-using LLM agents. It is designed for researchers and developers who need to run repeatable security evaluations across realistic workflows. The project includes task suites, simulated environments, attack implementations, defense components, model pipelines, and measurements for both security and utility. Researchers benchmarking agent defenses will find its focus especially relevant.
Its strongest advantage is the breadth of evaluation building blocks available within a free, open-source project. AgentDojo includes prompt-injection attack benchmarking, built-in jailbreak attack classes, custom attack creation and registration, task authoring, and task-suite support. It also supports agent pipeline and defense composition, a prompt-injection detection component, and multiple LLM pipeline integrations. That combination supports comparisons between attacks, defenses, agent configurations, and task outcomes rather than limiting evaluation to a single attack type.
The main trade-off is deployment and scope. AgentDojo is self-hosted, so teams need to manage the environment in which the Python framework, benchmarks, and integrations run. Its purpose is also specific: evaluating attacks and defenses in tool-using LLM agents. The published capabilities do not extend to verifying leakage or unsafe-output testing. Choose AgentDojo when open, customizable benchmarking and security-and-utility evaluation are the priority. Consider an alternative when you need managed hosting or broader coverage of leakage and unsafe-output testing.
Your product? Our editors can test AgentDojo in depth and publish a review, labelled as paid · from $149/mo →
AgentDojo pricing
AgentDojo fact sheet
| Free plan | Yes |
|---|---|
| Paid from | Free |
| Prompt injection tests | Yes |
| Jailbreak tests | Yes |
| Data leakage tests | Not verified |
| Unsafe output tests | Not verified |
| Custom test cases | Yes |
| Deployment mode | Self_hosted |
| Deployment | Self-hosted |
| Support | Docs |
| Built for | Solo, Small business, Mid-market (editorial estimate) |
| Pricing | Free plan |
| Website | agentdojo.spylab.ai |
| Facts checked | 21 Sep 2026 |
Alternatives to AgentDojo
- PromptGuardBroad AI security testing with flexible deployment and a low-cost paid entry tier.9.3
- Akto Agentic Red TeamingBroad AI security testing for enterprise agent and API security teams.9.1
- MindgardA broad AI risk platform spanning discovery, testing, protection, and remediation.9.0
See all AgentDojo alternatives →
Used AgentDojo? Be the first to review it
The editor score above is our own research. What this page doesn't have yet is a reader's view — what you used AgentDojo for, what worked and what didn't. No stars are seeded and no review is paid for; an editor reads every one before it appears.
Write a reviewTwo minutes · verified accounts only · read by an editor before it appears
Featured on iTechGuides
AgentDojo is listed in our AI Security Testing Tools directory. Add the badge to your site — it links back to this page.
<a href="https://www.itechguides.com/products/agentdojo/"><img src="https://www.itechguides.com/best/badge/agentdojo.svg" alt="Featured on iTechGuides" width="230" height="46"></a>
Reviewed by iTechGuides Editors · Editorial team · Updated Oct 2026
Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.
Last updated · How we research and update