Starstruk Logo MarkStarstruk

v0.13.0

NVIDIA/garakv0.13.0Sep 2, 2025by jmartin-tech

AI Summary

Major feature release adding conversation support, configurable system prompts, and renaming failure to attack success. New attack probes including Doctor attack, SAT (Simple Assistive Task Linkage), and ASCII smuggling.

Key Highlights

  • Conversation support
  • Configurable system prompt
  • Rename failure -> attack success
  • Doctor attack + encoding/Leet
  • SAT (Simple Assistive Task Linkage) probe
  • Ascii Smuggling probe
  • Markdown exfil probe generalization

New Features

  • Doctor attack + encoding/Leet
  • Simple Assistive Task Linkage Probe
  • Ascii Smuggling probe
  • Generalized Markdown exfil probe
  • Rename failure -> attack success
  • Conversation support
  • Configurable system prompt

Full Release Notes

## What's Changed

### New plugins
* Doctor attack + encoding/Leet by @leondz in https://github.com/NVIDIA/garak/pull/1180
* Simple Assistive Task Linkage Probe by @erickgalinkin in https://github.com/NVIDIA/garak/pull/1319
* Ascii Smuggling by @erickgalinkin in https://github.com/NVIDIA/garak/pull/1299
* Added more generalized version of Markdown exfil probe by @aishwaryap in https://github.com/NVIDIA/garak/pull/1259

### New features
* Feature: rename failure -> attack success by @leondz in https://github.com/NVIDIA/garak/pull/1326
* Feature: conversation support by @jmartin-tech in https://github.com/NVIDIA/garak/pull/1254
* Feature: Configurable system prompt by @erickgalinkin in https://github.com/NVIDIA/garak/pull/1337

### Improved plugins
* Expand python exploitation payloads by @erickgalinkin in https://github.com/NVIDIA/garak/pull/1300
* Bug fix in python regex in malwaregen.AnyCode detector by @aishwaryap in https://github.com/NVIDIA/garak/pull/1296
* Bug fix to malwaregen anycode detector in keyword using by @aishwaryap in https://github.com/NVIDIA/garak/pull/1302
* Adding wider detection of :: and // in malwaregen.AnyCode detector by @aishwaryap in https://github.com/NVIDIA/garak/pull/1307
* Update datasets and regex for package hallucination by @arjun-krishna1 in https://github.com/NVIDIA/garak/pull/1124

### Documentation
* amend docs copyright by @leondz in https://github.com/NVIDIA/garak/pull/1284
* documentation: typo fix by @dbaker-arch in https://github.com/NVIDIA/garak/pull/1286
* docs: improve conformance to PEP-0257 by @jmartin-tech in https://github.com/NVIDIA/garak/pull/1298
* docs: update contact email in readme by @leondz in https://github.com/NVIDIA/garak/pull/1341

### Tuning & fixes
* Replace deprecated `np.infty` with `np.inf`. by @erickgalinkin in https://github.com/NVIDIA/garak/pull/1283
* restrict datasets version due to new torchcodec dependency by @jmartin-tech in https://github.com/NVIDIA/garak/pull/1290
* Promptinject cleanup by @erickgalinkin in https://github.com/NVIDIA/garak/pull/1292
* add missing import for `re` in azure generator by @jmartin-tech in https://github.com/NVIDIA/garak/pull/1294
* fix missing '.' in default config probe_spec by @jmartin-tech in https://github.com/NVIDIA/garak/pull/1295
* download models used in translation tests early by @jmartin-tech in https://github.com/NVIDIA/garak/pull/1308
* Tweaks to how `wn` is used by @06kellyjac in https://github.com/NVIDIA/garak/pull/1316
* Added NASM sections in regex for assembly in malwaregen.Anycode detector by @aishwaryap in https://github.com/NVIDIA/garak/pull/1310
* Use numpy v2 by @06kellyjac in https://github.com/NVIDIA/garak/pull/1314
* update usage of fschat required for compatibility by @jmartin-tech in https://github.com/NVIDIA/garak/pull/1322
* cohere version upgrade by @dchiitmalla in https://github.com/NVIDIA/garak/pull/1252
* improve cache and label automation by @jmartin-tech in https://github.com/NVIDIA/garak/pull/1324
* fix doc extending.rst by @solo-daemon in https://github.com/NVIDIA/garak/pull/1328
* reporting: add tags to digest, tidy naming by @leondz in https://github.com/NVIDIA/garak/pull/1334
* reporting: update defcon descriptions to talk about risk by @leondz in https://github.com/NVIDIA/garak/pull/1348
* judge detectors conversation refactor by @jmartin-tech in https://github.com/NVIDIA/garak/pull/1346

## New Contributors
* @dbaker-arch made their first contribution in https://github.com/NVIDIA/garak/pull/1286
* @06kellyjac made their first contribution in https://github.com/NVIDIA/garak/pull/1316
* @solo-daemon made their first contribution in https://github.com/NVIDIA/garak/pull/1328

**Full Changelog**: https://github.com/NVIDIA/garak/compare/v0.12.0...v0.13.0