Starstruk Logo MarkStarstruk

0.2

luminal-ai/luminal0.2Mar 1, 2024by jafioti

AI Summary

Major release adding convolutional neural network modules (Conv1D, Conv2d), pooling layers, Mistral model support, and Q8 weight quantization. Includes various bug fixes and performance improvements for the deep learning framework.

Key Highlights

  • Simple Pooling implementation added
  • Conv1D module added
  • Conv2d module added
  • Added support for Mistral model
  • Q8 Weight Quantization implemented
  • Fixed swish activation function

New Features

  • Simple Pooling implementation
  • Conv1D module
  • Conv2d module
  • Mistral model support
  • Q8 Weight Quantization
  • Fixed swish activation
  • F16 matmul improvements
  • Longer prompt and token generation for testing

Full Release Notes

## What's Changed
Everything.

And also:
* Simple Pooling implementation by @TheSeamau5 in https://github.com/jafioti/luminal/pull/4
* Conv1D module by @TheSeamau5 in https://github.com/jafioti/luminal/pull/7
* Conv2d by @TheSeamau5 in https://github.com/jafioti/luminal/pull/8
* Add support for Mistral by @TheSeamau5 in https://github.com/jafioti/luminal/pull/9
* Shell script to download mistral that actually works by @TheSeamau5 in https://github.com/jafioti/luminal/pull/10
* Fix swish by @TheSeamau5 in https://github.com/jafioti/luminal/pull/11
* Minor improvement to f16 matmul, Longer prompt and token generation for testing by @TheSeamau5 in https://github.com/jafioti/luminal/pull/12
* Small Improvements to main by @TheSeamau5 in https://github.com/jafioti/luminal/pull/17
* Q8 Weight Quantization by @jafioti in https://github.com/jafioti/luminal/pull/24


**Full Changelog**: https://github.com/jafioti/luminal/compare/0.1...0.2