Suggestions appear as you type. Use the up and down arrows to choose one and Enter to open it.

JailbreakBench

Free#35 of 39 in AI Model Evaluation Software

JailbreakBench: A focused toolkit for standardized jailbreak, refusal, and safety-behavior research. Ranked #35 of 39 in AI Model Evaluation Software by our editors (5.6/10); pricing: Free plan; best for standardized jailbreak and refusal research.

5.6/10Editor score
JailbreakBench5.6 Visit JailbreakBench

At a glance

  • Editor score
    5.6 / 10
  • Pricing
    Free plan
  • Best for
    Standardized jailbreak and refusal research
  • Free plan
    Yes
  • Paid from
    Free
  • Safety & bias checks
    Yes
  • Founded
    2024
  • Facts checked
    19 Nov 2026
  • Where it wins

    • JBB-Behaviors covers 200 benign and misuse behaviors
    • Standardized threat models, prompts, templates, and scoring functions
    • Leaderboards and LiteLLM/vLLM pipelines support comparative studies
  • Where it doesn't

    • Self-hosted deployment puts setup and infrastructure work on your team
    • Focus is narrower than general-purpose model evaluation platforms
    • Jailbreak and refusal judges are based on Llama 3 models

Our verdict on JailbreakBench

JailbreakBench is an open-source robustness benchmark for large language models, centered on jailbreak attacks, refusals, over-refusals, and related safety behavior. It is aimed at AI safety researchers, evaluation teams, and organizations that need a consistent way to compare attacks and defenses. The toolkit runs on Linux in a self-hosted deployment and supports solo researchers through enterprise teams that can manage their own evaluation environment.

Its main strength is a defined evaluation structure rather than a general collection of prompts. The JBB-Behaviors dataset includes 200 benign and misuse behaviors, while the library standardizes threat models, system prompts, chat templates, and scoring functions. Leaderboards track attack and defense performance across large language models, and a repository of submitted jailbreak artifacts gives contributors a shared basis for comparison. Prompt evaluation can run through LiteLLM or vLLM, with Hugging Face Datasets available for dataset workflows. Judges for jailbreak and refusal outcomes are based on Llama 3 models, and the project supports submitting new attacks and defenses.

JailbreakBench fits teams that value transparent, contribution-driven research and want to run evaluations locally. Its specifications also cover regression benchmarking, safety-bias testing, and human review, which can support repeatable research programs beyond a single attack demonstration. The trade-off is operational: self-hosting means your team handles installation, model access, execution, and maintenance, while support is oriented around community channels and documentation. Organizations seeking a hosted service, broad provider management, or a wider model-quality testing suite should consider a more general evaluation platform. For focused jailbreak and refusal studies, however, its standardized dataset, scoring approach, and public comparison workflow provide a clear research foundation.

Your product? Our editors can test JailbreakBench in depth and publish a review, labelled as paid · from $149/mo →

JailbreakBench pricing

Plans Free planFree Free to use — no paid tier required for the core job.
See plans on jailbreakbench.github.io

JailbreakBench fact sheet

Free planYes
Paid fromFree
Evaluation typesjailbreak attack success, refusal, over-refusal, safety behavior
Safety & bias checksYes
Regression benchmarksYes
Human review workflowsYes
Included evaluation runsNot verified
Deployment optionSelf_hosted
Model providersLiteLLM, vLLM
DeploymentSelf-hosted
PlatformsLinux
SupportCommunity, Docs
Built forSolo, Small business, Mid-market, Enterprise (editorial estimate)
Integrations3 integrations: LiteLLM, vLLM, Hugging Face Datasets
PricingFree plan
Websitejailbreakbench.github.io
Facts checked19 Nov 2026

JailbreakBench integrations

JailbreakBench lists 3 integrations on its own site.

  • LiteLLM
  • vLLM
  • Hugging Face Datasets

Alternatives to JailbreakBench

See all JailbreakBench alternatives →

Used JailbreakBench? Be the first to review it

The editor score above is our own research. What this page doesn't have yet is a reader's view — what you used JailbreakBench for, what worked and what didn't. No stars are seeded and no review is paid for; an editor reads every one before it appears.

Write a reviewTwo minutes · verified accounts only · read by an editor before it appears

Reviews come only from verified accounts. Sign in or create an account first — your e-mail is never shown.

Your rating

0 characters · at least 80, up to 3,000

Posted from your verified account. Reviews appear after an editor reads them, usually within two working days.

Featured on iTechGuides

Featured on iTechGuides — JailbreakBench 5.6/10

JailbreakBench is listed in our AI Model Evaluation Software directory. Add the badge to your site — it links back to this page.

<a href="https://www.itechguides.com/products/jailbreakbench/"><img src="https://www.itechguides.com/best/badge/jailbreakbench.svg" alt="Featured on iTechGuides" width="230" height="46"></a>

Reviewed by iTechGuides Editors · Editorial team · Updated Nov 2026

Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.

Last updated · How we research and update