Starstruk Logo MarkStarstruk

v0.13.1

NVIDIA/garakv0.13.1Oct 1, 2025by jmartin-tech

AI Summary

Expanded probe suite with encoding and attack probes including Atbash, DRA, token smuggling, and package hallucination. Major config refactoring from model_* to target_* naming.

Key Highlights

  • Atbash Encoding probe
  • DRA (Disguise and Reconstruction Attack) probe
  • Token smuggling probe
  • Package hallucination support for dart, perl, raku
  • Config: model_* to target_* refactor
  • CLI filtering support for --list_* options

New Features

  • Atbash Encoding probe
  • Ansi escape codes in tokenizer probe
  • Dropbox repeated token attack
  • DRA (Disguise and Reconstruction Attack) probe
  • Package hallucination support for dart, perl, raku
  • Token smuggling probe
  • Support detectors including None in output values
  • Config: model_* to target_* renaming
  • CLI filtering support for --list_* options

Full Release Notes

## What's Changed

### New plugins
* probe: Atbash Encoding by @Nakul-Rajpal in https://github.com/NVIDIA/garak/pull/1343
* probe: ansi escape codes in tokenizer by @leondz in https://github.com/NVIDIA/garak/pull/1351
* dropbox repeated token attack by @dchiitmalla in https://github.com/NVIDIA/garak/pull/1244
* probe: DRA (Disguise and Reconstruction Attack) by @patriciapampanelli in https://github.com/NVIDIA/garak/pull/1345
* probes: package hallucination support for dart, perl, & raku by @dchiitmalla in https://github.com/NVIDIA/garak/pull/1243
* probe: Added token smuggling probe module  by @mrowebot in https://github.com/NVIDIA/garak/pull/1192

### New features
* feature: support detectors including `None` in output values by @leondz in https://github.com/NVIDIA/garak/pull/1280
* config: `model_*` to `target_*` by @leondz in https://github.com/NVIDIA/garak/pull/1383
* cli: add filtering support for --list_* options by @JosephDavisC in https://github.com/NVIDIA/garak/pull/1367

### Improved plugins
* bugfix: future probes now use future phrasing by @leondz in https://github.com/NVIDIA/garak/pull/1388
* rename and extend Web injection probes by @erickgalinkin in https://github.com/NVIDIA/garak/pull/1335

### Documentation
* fixing probable typo in cliref.rst by @cassiasamp in https://github.com/NVIDIA/garak/pull/1353
* docs(chore): Fix most build warnings by @mikemckiernan in https://github.com/NVIDIA/garak/pull/1359
* docs: reorganize table of concepts and getting started page by @mikemckiernan in https://github.com/NVIDIA/garak/pull/1360
* docs: theme recolor by @leondz in https://github.com/NVIDIA/garak/pull/1385
* docs: auto-include ASR in probe doc page if current calibration exists by @leondz in https://github.com/NVIDIA/garak/pull/1387
* bugfix: ASR figures in probe docs are now actual ASRs by @leondz in https://github.com/NVIDIA/garak/pull/1392

### Tuning & fixes
* Specify `flit` build-system within `pyproject.toml` by @06kellyjac in https://github.com/NVIDIA/garak/pull/1317
* Update how license is defined in pyproject.toml by @06kellyjac in https://github.com/NVIDIA/garak/pull/1315
* reporting: add basic docs to scripts in analyze pkg by @leondz in https://github.com/NVIDIA/garak/pull/1369
* update: tektronix typo fix by @leondz in https://github.com/NVIDIA/garak/pull/1372
* cli: standardise reporting tool invocation patterns by @SubGlitch1 in https://github.com/NVIDIA/garak/pull/1370
* adding local fixture to setup wordnet environment by @dhruvmalik007 in https://github.com/NVIDIA/garak/pull/1342
* reporting: add aggregation of report jsonl digest objects, and tests for aggregation by @leondz in https://github.com/NVIDIA/garak/pull/1336
* update: rename `data/misp_descriptions.tsv` to `data/tags.misp.tsv` by @leondz in https://github.com/NVIDIA/garak/pull/1381

## New Contributors
* @cassiasamp made their first contribution in https://github.com/NVIDIA/garak/pull/1353
* @Nakul-Rajpal made their first contribution in https://github.com/NVIDIA/garak/pull/1343
* @SubGlitch1 made their first contribution in https://github.com/NVIDIA/garak/pull/1370
* @dhruvmalik007 made their first contribution in https://github.com/NVIDIA/garak/pull/1342
* @patriciapampanelli made their first contribution in https://github.com/NVIDIA/garak/pull/1345
* @JosephDavisC made their first contribution in https://github.com/NVIDIA/garak/pull/1367

**Full Changelog**: https://github.com/NVIDIA/garak/compare/v0.13.0...v0.13.1