0.4.0
google/comprehensive-rust0.4.0Jan 3, 2025by Mini256
AI Summary
This release introduces an Evaluation (beta) tool to assess Chat Engine outputs and adds support for new LLM and embedding providers such as Gitee AI, vLLM, and Xinference. It also improves file handling by allowing reference file downloads and setting upload size limits.
Key Highlights
- Evaluation (beta) tool for Factual Correctness and Semantic Similarity
- New LLM providers: Gitee AI, vLLM, and Xinference
- New embedding providers: Gitee AI and Amazon Bedrock
- Configurable upload file size limit via site settings
New Features
- Evaluation (beta) tool
- Gitee AI LLM provider
- vLLM LLM provider
- Xinference LLM provider
- Gitee AI embedding provider
- Amazon Bedrock embedding provider
- Download reference files in chat page
Full Release Notes
## Highlights
- Support [Evaluation (beta)](https://tidb.ai/docs/evaluation) tool to evaluate the performance and reliability of the Chat Engine’s outputs (by @Icemap @634750802 ).
- Current support key metrics:
- Factual Correctness
- Semantic Similarity
- Support new LLM providers
- [Gitee AI](https://tidb.ai/docs/llm#gitee-ai) (by @lc-soft)
- Test new OpenAI-like providers (by @jrj5423)
- [vLLM](https://tidb.ai/docs/llm#vllm)
- [Xinference](https://tidb.ai/docs/llm#xinference)
- Support new embedding model providers
- [Gitee AI](https://tidb.ai/docs/embedding-model#gitee-ai) (by @lc-soft)
- [Amazon Bedrock](https://tidb.ai/docs/embedding-model#amazon-bedrock) (by @jrj5423 @Mini256)
## Improvements
- Limit the upload file size via `max_upload_file_size` (10MB by default) parameter on site setting (by @sszgwdk @634750802 )
- Support download the reference file in the chat page (by @Rutheniumlmw @634750802 )
## New Contributors
* @sszgwdk made their first contribution in https://github.com/pingcap/autoflow/pull/497
* @jrj5423 made their first contribution in https://github.com/pingcap/autoflow/pull/522
* @Rutheniumlmw made their first contribution in https://github.com/pingcap/autoflow/pull/538
* @lc-soft made their first contribution in https://github.com/pingcap/autoflow/pull/470
* @nicognaW made their first contribution in https://github.com/pingcap/autoflow/pull/496
If you are deploying Autoflow using docker, please follow the [Upgrade](https://tidb.ai/docs/deploy-with-docker#upgrade) guide to upgrade your Autoflow.
**Full Changelog**: https://github.com/pingcap/autoflow/compare/v0.3.0...0.4.0