Starstruk Logo MarkStarstruk

v0.4.1

janhq/janv0.4.1Dec 14, 2023by github-actions[bot]

AI Summary

Focuses on inference engine capabilities, specifically Nitro and OpenAI integration with support for multiple engines and NVIDIA Triton.

Key Highlights

  • Multiple inference engines support (Nitro and OpenAI)
  • NVIDIA Triton TRT-LLM extension added
  • Nitro process management improvements (Killing process via API)
  • Prompt templates for inference
  • Hotfix for OpenAI models on Windows and various UI bugs

New Features

  • Multiple inference engines
  • Triton support
  • Prompt Templates
  • Nitro API kill mechanism

Full Release Notes

## Changes

- Update README.md @imtuyethan (#903)

## 🚀 Features

- feat: Kill nitro process with API - nitro 0.1.27 @vuonghoainam (#975)
- feat: Inference Nitro with Prompt Template @hahuyhoang411 (#952)
- feat: Add NVIDIA triton trt-llm extension @vuonghoainam (#888)
- feat: Hotfit for Nitro loading on CPU with hyper-threading support @vuonghoainam (#931)
- feat: adding model params @namchuai (#886)
- feat: Multiple inference engines for nitro and openai @vuonghoainam (#814)
- docs: add json schema for engine and model parameters @tikikun (#840)
- feat: improve SEO keywords @hieu-jan (#894)
- enhancement: fix spacing landing page responsive @urmauur (#891)
- bug: added label coming soon for windows and linux @urmauur (#881)

## 🐛 Fixes

- fix: 963 can not run openai models on windows @louis-jan (#974)
- fix: Inference engine Nitro with Windows with/ without CUDA @vuonghoainam (#950)
- Fix error Jan app linux crash @hiento09 (#958)
- fix: windows bug - control buttons close,max,min hidden @linhtran174 (#949)
- bug: fix ui landing page @urmauur (#937)
- fix: model parameters for inference extensions @vuonghoainam (#935)
- [bug] Fix floating border outside card right panel @urmauur (#934)
- fix: import\_typescript.default.isTokenKind is not a function @louis-jan (#923)
- bug: fix syntax formatting @urmauur (#899)
- bug:  update metadata title and desc @urmauur (#884)
- fix: download button text color is blending into the background @louis-jan (#883)

## 🧰 Maintenance

- chore: add desktop app analytics @louis-jan (#978)
- refactor: clean types and interfaces @0xSage (#966)
- docs: scaffold dev docs @0xSage (#856)
- chore: Bump nitro to 0.1.26 @vuonghoainam (#960)
- Update update-release-url.yml @hiento09 (#951)
- Fix update release url pipeline run failed @hiento09 (#947)
- chore: Bumpt nitro bin version to version 0.1.23 @vuonghoainam (#942)
- Fix update release url pipeline @hiento09 (#941)
- CI automatically update Update README with Nightly Build Information and stable download URL @hiento09 (#940)
- refactor: deprecate invokers - auto proxying apis - strict types @louis-jan (#924)
- docs: standardize yaml files @hieu-jan (#933)
- chore: universal module definition @louis-jan (#902)
- docs: add assistants api reference @hieu-jan (#801)
- docs: add json schema for engine and model parameters @tikikun (#840)

## Contributor

@0xSage, @hahuyhoang411, @hiento09, @hieu-jan, @imtuyethan, @jan-service-account, @linhtran174, @louis-jan, @namchuai, @tikikun, @urmauur and @vuonghoainam