garak Releases

Adds 'LLM as a Judge' detector, O1 model support for OpenAI, Ollama generator, Azure OpenAI support, and Vision NIMs. Introduces payload/probe separation and various documentation updates.

Oct 31, 2024

A maintenance release focusing on website stability, UI improvements for node selection colors, and bug fixes for conditional nodes and file management.

Oct 6, 2024

This release significantly updates the macro node system and simplifies the conditional node, requiring automatic or manual migration for existing projects.

Oct 5, 2024

Focuses on macro editor enhancements, such as long text support and pin interaction fixes, as well as simplifying value and function nodes.

Sep 15, 2024

This release introduces new probes for hallucinations in Ruby, NPM, and Rust crates, along with a Groq API generator. It also includes refactoring for the generations parameter, secure HuggingFace assets, and tokenizer customization.

Sep 6, 2024

Adds a probe to assess HuggingFace repositories for malicious files and improves configuration handling using XDG paths. Includes comparative reporting for detector scores and enables HFDetector model configuration.

Aug 13, 2024

Adds BEAST Attack Implementation and Grandma attack probes, along with configurable plugins and Windows/OSX support. Includes JSON Path support for the REST generator and support for GPT-4o models.

Jul 29, 2024

Marks the project's 1st birthday with major additions including multimodal support (LLaVa), LiteLLM generator, DoNotAnswer probe, and NIM generators. Adds parallel OpenAI calls and enhanced Windows compatibility.

May 10, 2024

Adds new encoding probes, Rasa generator, and support for multiple buffs. Includes OpenAI upgrades and fixes for REST generator timeout parameters.

Feb 20, 2024

A maintenance release fixing exception printing behavior, clarifying REST generator documentation, and updating generator documentation and examples.

Jan 26, 2024

Adds probes for repetition nudging, invisible text injection, and DAN in the wild, alongside a generator for NVIDIA cloud functions.

Jan 19, 2024

Overhauls reporting with automatic HTML report creation and grouping by tags. Adds new buffs (Base64, CharCode), NeMo Guardrails generator, and AutoDAN probe.

Dec 20, 2023

Adds GCG jailbreak probe, NVIDIA Optimum support, OWASP tags, and paraphrase buffs. Introduces comprehensive config file support and progress bars.

Dec 8, 2023

Renames ART to AG, adds generators for NeMo LLM and OctoML, and introduces a generic REST connector. Adds parallelisation options and interactive mode.

Nov 14, 2023

A maintenance release prioritizing testing, documentation, and performance improvements for package hallucination detection.

Jul 27, 2023

Introduces vulnerability reporting to AVID, package hallucination detection, and new CLI options for encoding payloads.

Jul 25, 2023

Adds new probes for data leakage and glitch tokens, alongside improvements to CLI output and vulnerability reporting.

Jul 12, 2023

Adds a new Hugging Face model generator and improves the auto-red-team module with better progress tracking.

Jul 4, 2023