v0.1.2

hiyouga/LlamaFactoryv0.1.2Jul 20, 2023by hiyouga

AI Summary

Adds LLaMA-2 support and fixes critical configuration issues including ZeRO-3 and API bugs.

Key Highlights

Full support for LLaMA-2 models
Fix for DeepSpeed ZeRO-3 configuration
Advanced configurations in Web UI

Breaking Changes

Downgraded pydantic to version < 2.0.0

New Features

LLaMA-2 support
Advanced Web UI configurations
ShareGPT dataset support
ZeRO-3 bug fix

Full Release Notes

- Support **LLaMA-2** (good issue #202 )
- Advanced configurations in Web UI
- Fix API (downgrade pydantic<2.0.0)
- Fix baichuan lora hparam #194 #212 
- Fix padding #196 
- Fix ZeRO-3 #199 
- Allow pass args to app #213 
- Code simplification
- Add ShareGPT dataset