v0.3.0

hiyouga/LlamaFactoryv0.3.0Nov 16, 2023by hiyouga

AI Summary

Initial full-parameter RLHF release featuring core refactoring and support for full-parameter training.

Key Highlights

Support for full-parameter RLHF training (RM & PPO)
Core refactoring of llmtuner

New Features

Full-parameter RLHF training
Core refactoring
Improved LLaMA Board with full-parameter RLHF and demo mode

Full Release Notes

### New features

- Support full-parameter RLHF training (RM & PPO)
- Refactor llmtuner core in #1525 by @hiyouga 
- Better LLaMA Board: full-parameter RLHF and demo mode

### New models

- Base models
  - ChineseLLaMA-1.3B
  - LingoWhale-8B
- Instruct/Chat models
  - ChineseAlpaca-1.3B
  - Zephyr-7B-Alpha/Beta

### Bug fix

- Fix bugs in partial-parameter (freeze) tuning
- Fix #224 #336 #931 #936 #1011 #1489 #1494 #1507 #1514