v0.15.0

infiniflow/ragflowv0.15.0Dec 18, 2024by yuzhichang

AI Summary

Released on December 18, 2024, this update focuses on enhancing Agent capabilities, improving retrieval performance with Page Rank scores, and adding Kubernetes support via Helm charts. It also introduces a dark mode UI, Japanese language support, and resumable GraphRAG and RAPTOR tasks.

Key Highlights

  • Support for Page Rank scores to improve retrieval performance across multiple knowledge bases.
  • Helm chart for deploying RAGFlow on Kubernetes.
  • Dark mode UI with Japanese language support available.
  • Resumable GraphRAG and RAPTOR tasks for enhanced task management resilience.
  • Agent-specific APIs and support for importing/exporting agents in JSON format.

New Features

  • Iframe integration for embedding RAGFlow into webpages.
  • Step run functionality for Agent components and tools.
  • Infinity engine upgrade and configuration file support.
  • Added Mistral models.
  • Enhanced retrieval performance when using Infinity as the document engine.

Full Release Notes

Released on December 18, 2024. Cheers!

### New features

- Introduces additional Agent-specific APIs.
- Supports using page rank score to improve retrieval performance when searching across multiple knowledge bases.
- Offers an iframe in Chat and Agent to facilitate the integration of RAGFlow into your webpage.
- Adds a Helm chart for deploying RAGFlow on Kubernetes.
- Supports importing or exporting an agent in JSON format.
- Supports step run for Agent components/tools.
- Adds a new UI language: Japanese.
- Supports resuming GraphRAG and RAPTOR from a failure, enhancing task management resilience.
- Adds more Mistral models.
- Adds a dark mode to the UI, allowing users to toggle between light and dark themes.

### Improvements

- Upgrades the Document Layout Analysis model in Deepdoc.
- Significantly enhances the retrieval performance when using [Infinity](https://github.com/infiniflow/infinity) as document engine.

## What's Changed
* Fix the issue where the agent interface cannot call the context by @kunkeji in https://github.com/infiniflow/ragflow/pull/3725
* Fix image_id absence issue by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3735
* Fix GPU docker compose file by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3736
* Fix raptor issue by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3737
* Refactor dockerfile by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3741
* Change Traditional Chinese to Simplified Chinese by @kunkeji in https://github.com/infiniflow/ragflow/pull/3742
* Update document by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3746
* Pass top_p to ollama by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3744
* Added release notes v0.11.0 by @writinwaters in https://github.com/infiniflow/ragflow/pull/3745
* Feat: Add DatasetTable #3221 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3743
* Feat: Support for formulas #1954 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3747
* Weight up title and keywords for chunks in terms of retrieval by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3750
* Fixed increase_usage for builtin models by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3748
* Image compression by @kunkeji in https://github.com/infiniflow/ragflow/pull/3749
* Feat: Translate comments of file-util.ts to English #3749 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3757
* Optimize the knowledge base card UI  by @kunkeji in https://github.com/infiniflow/ragflow/pull/3756
* Feat: Add tooltip to delimiter filed #1909 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3758
* Fix chunk creation using Infinity by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3763
* Update progress info and start welcome info by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3768
* Update QR code of wechat by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3776
* Update README by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3777
* Update file parsing progress info by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3780
* Refactor parse progress by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3781
* add jina new models in jina connector by @devMls in https://github.com/infiniflow/ragflow/pull/3770
* Removed obsolete instructions by @writinwaters in https://github.com/infiniflow/ragflow/pull/3785
* Fix out of boundary. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3786
* Fix the bug that prevented modifying `dataset_ids` by @Feiue in https://github.com/infiniflow/ragflow/pull/3784
* Fix service_conf for oc9 docker compose file. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3790
* Detect invalid response from api.siliconflow.cn by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3792
* Update document: how upload file large than 128MB by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3791
* Feat: Quit from jointed team #3759 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3797
* More dataset test cases by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3802
* Set Log level by env by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3798
* Improved ollama doc by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3787
* [DOC] We have no plan to maintain Docker images for ARM. Please build your … by @writinwaters in https://github.com/infiniflow/ragflow/pull/3808
* Feat: Supports page rank score for different knowledge bases. #3794 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3800
* Fix the bug that the agent could not find the context by @Feiue in https://github.com/infiniflow/ragflow/pull/3795
* Feat: Add TestingForm #3221 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3810
* Fix voyage embedding. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3818
* Web API test cases by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3812
* Fix: page_chars attribute does not exist in some formats of PDF by @cyhasuka in https://github.com/infiniflow/ragflow/pull/3796
* Feat: Store the pagerank field at the outermost #3794 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3822
* Fix @ in model name issue. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3821
* Add pagerank to KB. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3809
* Add Helm chart deployment method by @sd109 in https://github.com/infiniflow/ragflow/pull/3815
* Fix the agent reference bug and the session prologue by @Feiue in https://github.com/infiniflow/ragflow/pull/3823
* Add more mistral models. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3826
* Refactor embedding batch_size by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3825
* Feat: Modify the style of the home page in bright mode #3221 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3832
* Fix parsing JSON file error by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3829
* Add api for list agents and agent seesions by @Feiue in https://github.com/infiniflow/ragflow/pull/3835
* Change default error message to English by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3838
* Update QRcode by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3844
* Email sending tool by @kunkeji in https://github.com/infiniflow/ragflow/pull/3837
* Web: Fixed the download and preview file not authorized. by @baifachuan in https://github.com/infiniflow/ragflow/pull/3652
* Fix preview issue in file manager. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3846
* Update docs. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3849
* Feat: Fixed the problem of not finding EmailForm #3837 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3847
* Fix: Delete unused code #3651 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3852
* Fix: Hide the download button if it is an empty file #3762 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3853
* Add sdk for list agents and sessions by @Feiue in https://github.com/infiniflow/ragflow/pull/3848
* Refine synonym query. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3855
* Feat: Bind the route to the navigation bar in the head #3221 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3863
* Fix open AI compatible rerank issue. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3866
* Fix chunk position issue. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3867
* Fix: The right coordinates of Categorize and Switch operators are misplaced #3868 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3869
* Fix HuggingFace model error. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3870
* Feat: Add question parameter to edit chunk modal #3873 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3874
* Feat: Adjust the input box width of EditTag to 100% #3873 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3876
* Feat: Add question parameter to edit chunk modal by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3875
* Fix chunk available issue by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3877
* Feat: Add tooltip to question item of ChunkCreatingModal #3873 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3878
* Revert "Feat: Add tooltip to question item of ChunkCreatingModal #3873" by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3879
* Feat: Add tooltip to question item of ChunkCreatingModal  #3873 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3880
* Add a dependency blincker. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3882
* Fix typos by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3887
* Feat: Import & export the agents. #3851 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3894
* release with CI by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3891
* Fix: An error occurred when deleting a new conversation #3898 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3900
* Remove token check while adding model. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3903
* Fix: Fixed the issue that the agent list page failed to load #3827 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3902
* Remove vector stored in component output. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3908
* Introduced NEED_MIRROR by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3907
* Refactor UI text by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3911
* Update oc9 docker compose file by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3913
* Fix errors detected by Ruff by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3918
* Added static check at PR CI by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3921
* Add Japanese support by @cidrugHug8 in https://github.com/infiniflow/ragflow/pull/3906
* Add support to iframe chatbot by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3929
* Obsoleted dev and dev-slim by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3930
* Fix field missing issue. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3931
* Fixed tmp in Dockerfile by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3933
* Fix transformers dependencies for slim. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3934
* Fix error message for image access. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3936
* Fix session API issues. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3939
* api http  return error by @isthaison in https://github.com/infiniflow/ragflow/pull/3941
* organize chunks by document in the prompt by @devMls in https://github.com/infiniflow/ragflow/pull/3925
* Fixed log not displaying by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3946
* Miscellaneous updates by @writinwaters in https://github.com/infiniflow/ragflow/pull/3942
* Allows quick entry of entities separated by commas by @isthaison in https://github.com/infiniflow/ragflow/pull/3914
* Fix syn error. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3953
* Case insensitive when set doc engine by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3954
* Theme switch support by @isthaison in https://github.com/infiniflow/ragflow/pull/3568
* Fixed README by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3956
* Rename page_num_list, top_list, position_list by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3940
* Feat: Modify the data structure of the chunk in the conversation #3909 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3955
* Feat: Exclude reference from the data returned by the conversation/get interface  #3909 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3962
* Support iframe chatbot. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3961
* Fixed retrieval TypeError: unhashable type: 'list' by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3966
* Add back beartype by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3967
* Fix: Answers with links to information not parsing #3839 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3968
* Added release notes by @writinwaters in https://github.com/infiniflow/ragflow/pull/3969
* Disable SQL DB binlog in Helm chart by @sd109 in https://github.com/infiniflow/ragflow/pull/3976
* update typo vietnamese by @isthaison in https://github.com/infiniflow/ragflow/pull/3973
* Fix exec sql exception issue. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3982
* Update api documents by @Feiue in https://github.com/infiniflow/ragflow/pull/3979
* Fix:  Fixed the issue where two consecutive indexes were displayed incorrectly #3839 by @cike8899 in https://github.com/infiniflow/ragflow/pull/3988
* Update comment by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/3981
* Support debug components. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/3994
* UI updates + RAGFlow image description by @writinwaters in https://github.com/infiniflow/ragflow/pull/3995
* Updated RAGFlow edition descriptions by @writinwaters in https://github.com/infiniflow/ragflow/pull/4001
* Try to reuse existing chunks by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3983
* Replaced md5 with xxhash64 for chunk id by @yuzhichang in https://github.com/infiniflow/ragflow/pull/4009
* Fix: Completion AttributeError: 'list' object has no attribute 'get' by @lizheng419 in https://github.com/infiniflow/ragflow/pull/3999
* Add mssql support by @isthaison in https://github.com/infiniflow/ragflow/pull/3985
* Updated UI by @writinwaters in https://github.com/infiniflow/ragflow/pull/4011
* Fix json file parse by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/4004
* Component debugging funcionality. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/4012
* Fix bug in hierarchical_merge function by @unsw-luopan in https://github.com/infiniflow/ragflow/pull/4006
* Fix bugs in agent api and update api document by @Feiue in https://github.com/infiniflow/ragflow/pull/3996
* Migrate infinity at startup by @yuzhichang in https://github.com/infiniflow/ragflow/pull/3858
* Feat: Supports to debug single component in Agent. #3993 by @cike8899 in https://github.com/infiniflow/ragflow/pull/4007
* Feat: Reparse a file shall reuse existing chunks if possible #3793 by @cike8899 in https://github.com/infiniflow/ragflow/pull/4021
* Set task progress on exception by @yuzhichang in https://github.com/infiniflow/ragflow/pull/4025
* Fix xinfo_groups returns unexpected result by @yuzhichang in https://github.com/infiniflow/ragflow/pull/4026
* Fix connection error for adding visual llm. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/4028
* Updated RAGFlow Agent UI by @writinwaters in https://github.com/infiniflow/ragflow/pull/4029
* Update launch_ragflow_from_source.md by @isthaison in https://github.com/infiniflow/ragflow/pull/4005
* Fixed a display issue by @writinwaters in https://github.com/infiniflow/ragflow/pull/4030
* Updated configurations by @writinwaters in https://github.com/infiniflow/ragflow/pull/4032
* extraction sqlquery by @isthaison in https://github.com/infiniflow/ragflow/pull/4027
* Remove Redundant None Check for vector_similarity_weight by @learnerLj in https://github.com/infiniflow/ragflow/pull/4037
* Fix chunk number error after re-parsing. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/4043
* Fix: Every time you switch the page number of a chunk, the PDF document will be reloaded. #4046 by @cike8899 in https://github.com/infiniflow/ragflow/pull/4047
* Cache the result from llm for graphrag and raptor by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/4051
* Fix: Hide the upload button in the external chat box  #2242 by @cike8899 in https://github.com/infiniflow/ragflow/pull/4048
* Feat: Set the color of the canvas's control button #3851 by @cike8899 in https://github.com/infiniflow/ragflow/pull/4053
* Upgrades Document Layout Analysis model. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/4054
* Compatible with former API keys. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/4055
* Feat: Modify the text of the embedded website button #3909 by @cike8899 in https://github.com/infiniflow/ragflow/pull/4057
* Feat: Modify the link address of the agent id #3909 by @cike8899 in https://github.com/infiniflow/ragflow/pull/4062
* Fix raptor resuable issue. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/4063
* Added pagerank support to infinity by @yuzhichang in https://github.com/infiniflow/ragflow/pull/4059
* Fix rerank_model bug in chat and markdown bug by @Feiue in https://github.com/infiniflow/ragflow/pull/4061
* Fix position lost issue. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/4068
* Feat: Bind event to  the theme Switch #3221 by @cike8899 in https://github.com/infiniflow/ragflow/pull/4067
* Elasticsearch disk-based shard allocator use absolute byte values instead of ratio by @yuzhichang in https://github.com/infiniflow/ragflow/pull/4069
* show avatar dialog instead of default by @isthaison in https://github.com/infiniflow/ragflow/pull/4033
* Add Architecture-Specific Logic for msodbcsql in Dockerfile #4036 by @midilandlu in https://github.com/infiniflow/ragflow/pull/4049
* Feat: Add AdvancedSettingForm #3221 by @cike8899 in https://github.com/infiniflow/ragflow/pull/4071
* Fix: The cursor is lost after entering a character in the operator form #4072 by @cike8899 in https://github.com/infiniflow/ragflow/pull/4073
* update chinese model warning message by @benquike in https://github.com/infiniflow/ragflow/pull/4075
* Fix:  Fixed the issue with external chat box reporting errors #3909 by @cike8899 in https://github.com/infiniflow/ragflow/pull/4079
* Fix conversation bug in agent session by @Feiue in https://github.com/infiniflow/ragflow/pull/4078
* Fix arm doc by @yuzhichang in https://github.com/infiniflow/ragflow/pull/4080
* Fix abnormal user invitaion message. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/4081
* Refactor trie load and construct by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/4083
* Fix: Fixed the issue where the required information in the input box was incorrect when inviting users #2834 by @cike8899 in https://github.com/infiniflow/ragflow/pull/4086
* Add huqie trie to docker image. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/4084
* Update team invite message by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/4085
* Bump infinity to 0.5.0 by @yuzhichang in https://github.com/infiniflow/ragflow/pull/4088
* Fix raptor by @yuzhichang in https://github.com/infiniflow/ragflow/pull/4089
* Feat: Add MultiSelect #3221 by @cike8899 in https://github.com/infiniflow/ragflow/pull/4090
* Prepare docs for v0.15.0 release by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/4077
* Added release notes for v0.15.0 by @writinwaters in https://github.com/infiniflow/ragflow/pull/4056
* Add latest updates. by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/4093
* Feat: Translate the previous run into parsing #4094 by @cike8899 in https://github.com/infiniflow/ragflow/pull/4095

## New Contributors
* @kunkeji made their first contribution in https://github.com/infiniflow/ragflow/pull/3725
* @devMls made their first contribution in https://github.com/infiniflow/ragflow/pull/3770
* @sd109 made their first contribution in https://github.com/infiniflow/ragflow/pull/3815
* @cidrugHug8 made their first contribution in https://github.com/infiniflow/ragflow/pull/3906
* @lizheng419 made their first contribution in https://github.com/infiniflow/ragflow/pull/3999
* @unsw-luopan made their first contribution in https://github.com/infiniflow/ragflow/pull/4006
* @learnerLj made their first contribution in https://github.com/infiniflow/ragflow/pull/4037
* @midilandlu made their first contribution in https://github.com/infiniflow/ragflow/pull/4049

**Full Changelog**: https://github.com/infiniflow/ragflow/compare/v0.14.1...v0.15.0