Starstruk Logo MarkStarstruk

v1.3.0

arhamkhnz/next-shadcn-admin-dashboardv1.3.0May 5, 2026by p-e-w

AI Summary

Adds support for new models (Qwen3.5, Gemma 4), improves VRAM usage, and adds benchmarking and reproducible runs.

Key Highlights

  • Qwen3.5 model support
  • Gemma 4 model support
  • Reproducible runs implementation
  • Peak VRAM usage reduction
  • Integrated benchmarking system

New Features

  • Qwen3.5 support
  • Gemma 4 support
  • Reproducible runs
  • Reduced VRAM usage
  • VRAM reporting for multi-GPU
  • Division-by-zero fix in evaluator
  • Model card generation
  • Automatic response prefix determination

Full Release Notes

## Changes

* @Vinay-Umrethe (who had previously contributed under the username @Vinayyyy7) implemented reproducible runs in https://github.com/p-e-w/heretic/pull/191. @p-e-w revised and improved that implementation in https://github.com/p-e-w/heretic/pull/303.
* @magiccodingman reduced peak VRAM usage in https://github.com/p-e-w/heretic/pull/239. @olekssy fixed a bug in that implementation in https://github.com/p-e-w/heretic/pull/301.
* @farolone added support for Qwen3.5 models in https://github.com/p-e-w/heretic/pull/187
* @MoonRide303 added support for Gemma 4 models in https://github.com/p-e-w/heretic/pull/287
* @erm14254 made sure all abliterable components across layers are displayed in https://github.com/p-e-w/heretic/pull/215
* @cpagac fixed VRAM usage reporting for multi-GPU setups in https://github.com/p-e-w/heretic/pull/169
* @cpagac fixed a division-by-zero error in the evaluator in https://github.com/p-e-w/heretic/pull/225
* @spikymoth improved automatic response prefix determination with a two-step process in https://github.com/p-e-w/heretic/pull/194
* @spikymoth added model card generation for local models with an existing README in https://github.com/p-e-w/heretic/pull/157
* @Diplo2by improved startup speed when Heretic is run with `-h`/`--help` in https://github.com/p-e-w/heretic/pull/293
* @AWuhrmann fixed the example value for the `max_memory` setting in https://github.com/p-e-w/heretic/pull/284
* @p-e-w added an integrated benchmarking system, made the response prefix logic configurable, implemented multiple infrastructure improvements, and fixed various minor issues

## New Contributors

* @cpagac made their first contribution in https://github.com/p-e-w/heretic/pull/169
* @farolone made their first contribution in https://github.com/p-e-w/heretic/pull/187
* @erm14254 made their first contribution in https://github.com/p-e-w/heretic/pull/215
* @AWuhrmann made their first contribution in https://github.com/p-e-w/heretic/pull/284
* @MoonRide303 made their first contribution in https://github.com/p-e-w/heretic/pull/287
* @Diplo2by made their first contribution in https://github.com/p-e-w/heretic/pull/293
* @magiccodingman made their first contribution in https://github.com/p-e-w/heretic/pull/239
* @olekssy made their first contribution in https://github.com/p-e-w/heretic/pull/301

**Full Changelog**: https://github.com/p-e-w/heretic/compare/v1.2.0...v1.3.0