Starstruk Logo MarkStarstruk

v1.1.0

jgraph/drawiov1.1.0Dec 10, 2025by p-e-w

AI Summary

This release introduces support for multi-GPU setups and Apple Silicon (MPS), alongside new quantization formats like MXFP4. It also adds research features such as early stopping and thinking models, while improving notebook compatibility and fixing various loading errors.

Key Highlights

  • Multi-GPU support added
  • Apple Silicon (MPS) support added
  • MXFP4 quantized model support added
  • Notebook (Colab/Kaggle) compatibility added
  • Research features including early stopping and thinking models support

New Features

  • Multi-GPU support
  • Apple Silicon (MPS) support
  • IBM Granite MoE support
  • MXFP4 quantized model support
  • Notebook compatibility
  • Research features
  • Support for models requiring trust_remote_code
  • Refusal detection improvements

Full Release Notes

## Changes

* @mbarnson added basic MPS (Apple Silicon) support in https://github.com/p-e-w/heretic/pull/5
* @red40maxxer reduced memory usage in https://github.com/p-e-w/heretic/pull/15
* @Ooooze added IBM Granite MoE support in https://github.com/p-e-w/heretic/pull/14
* @kldzj added multi-GPU support in https://github.com/p-e-w/heretic/pull/17 and https://github.com/p-e-w/heretic/pull/32
* @ricyoung fixed an error when Hugging Face user profile fields are missing in https://github.com/p-e-w/heretic/pull/20
* @tymat added support for MXFP4 quantized models with Triton tensors in https://github.com/p-e-w/heretic/pull/28
* @spikymoth improved support for loading local datasets in https://github.com/p-e-w/heretic/pull/33
* @kldzj added support for models that require `trust_remote_code` in https://github.com/p-e-w/heretic/pull/31
* @Vinayyyy7 added notebook (Colab/Kaggle) compatibility in https://github.com/p-e-w/heretic/pull/42
* @Vinayyyy7 fixed loading for certain models that default to the float32 dtype in https://github.com/p-e-w/heretic/pull/44
* @spikymoth improved refusal detection in https://github.com/p-e-w/heretic/pull/45
* @red40maxxer added a PR title lint to CI in https://github.com/p-e-w/heretic/pull/66
* @p-e-w added research features, support for stopping the optimization process early, and support for thinking models, and implemented an important padding fix suggested by @accemlcc

## New Contributors

* @mbarnson made their first contribution in https://github.com/p-e-w/heretic/pull/5
* @red40maxxer made their first contribution in https://github.com/p-e-w/heretic/pull/15
* @Ooooze made their first contribution in https://github.com/p-e-w/heretic/pull/14
* @kldzj made their first contribution in https://github.com/p-e-w/heretic/pull/17
* @ricyoung made their first contribution in https://github.com/p-e-w/heretic/pull/20
* @tymat made their first contribution in https://github.com/p-e-w/heretic/pull/28
* @spikymoth made their first contribution in https://github.com/p-e-w/heretic/pull/33
* @Vinayyyy7 made their first contribution in https://github.com/p-e-w/heretic/pull/42

**Full Changelog**: https://github.com/p-e-w/heretic/compare/v1.0.1...v1.1.0