rustymimi-0.2.2
ed-donner/llm_engineeringrustymimi-0.2.2Sep 22, 2024by LaurentMazare
AI Summary
This release extends the context window to 8192 tokens, enabling approximately 5 minutes of conversation on the moshi-mlx model.
Key Highlights
- Extended context size to 8192 tokens
- Optimized for 5-minute conversations on moshi-mlx
- Improved conversation handling capabilities
New Features
- Extended context size to 8192
- Longer conversation capability on moshi-mlx
Full Release Notes
This includes the extended context size to 8192 so should provide 5 mins conversations on moshi-mlx.