v0.10.0

infiniflow/ragflowv0.10.0Aug 23, 2024by KevinHuSh

AI Summary

Released on August 23, 2024, this release supports text-to-SQL by RAG and provides Agent API. It adds monitoring for the task executor and introduces new operators like Github, DeepL, and ExecSQL.

Key Highlights

  • Supports text to SQL by RAG.
  • Provide the health check on task_executor process.
  • Add more Agent operator: Github, DeepL, BaiduFanyi, QWeather, ExecSQL, GoogleScholar.
  • Supports file type: eml.
  • Supports embedding model: Cohere.

New Features

  • Provides Agent API.
  • Supports more LLMs: GPT-4o-mini, PerfXCloud, TogetherAI, Upstage, Novita.AI, 01.AI, SiliconFlow, XunFei Spark, Baidu Yiyan, Tencent Hunyuan.

Full Release Notes

## Release Summary
- Supports text to SQL by RAG
- Provides Agent API
- Provide the health check on task_executor process.
- Add more Agent operator: Github, DeepL, BaiduFanyi, QWeather, ExecSQL, GoogleScholar
- Supports file type: eml
- Supports embedding model: Cohere
- Supports more LLMs or model services : GPT-4o-mini, PerfXCloud, TogetherAI, Upstage, Novita.AI, 01.AI, SiliconFlow, XunFei Spark, Baidu Yiyan, Tencent Hunyuan

## What's Changed
* refine loginfo about graprag progress by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1823
* feat: Add GoogleScholar #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1818
* fix: align limitation with env by @Chunshan-Theta in https://github.com/infiniflow/ragflow/pull/1819
* add supprot for OpenAI-API-Compatible llm by @hangters in https://github.com/infiniflow/ragflow/pull/1787
* add support for eml file parser by @hangters in https://github.com/infiniflow/ragflow/pull/1768
* fix #1816 by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1829
* Fixed a broken link by @writinwaters in https://github.com/infiniflow/ragflow/pull/1831
* feat: Move files in file manager #1826 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1837
* fix: Unable to create a new chat assistant after closing the edit modal #1833 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1838
* fix: Embedding error in file parsing #1835 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1839
* fix: Entity types are only displayed when the knowledge graph is selected #1594 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1841
* add callback to entity extraction by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1843
* refine mindmap by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1844
* fix LocalAI add bug by @hangters in https://github.com/infiniflow/ragflow/pull/1851
* add support for cohere by @hangters in https://github.com/infiniflow/ragflow/pull/1849
* fix add slef base url openai error by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1854
* feat: Do not display arrow icons on leaf node of folders #1826 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1862
* fix: The size of operators created from agent templates is displayed incorrectly #1863 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1864
* Fix a "TypeError: expected string or buffer bug" in docx files extracted using Knowledge Graph.#1859 by @jiyegege in https://github.com/infiniflow/ragflow/pull/1865
* add support for lepton by @hangters in https://github.com/infiniflow/ragflow/pull/1866
* remove jina pack in requirement file to fix package conflict by @hangters in https://github.com/infiniflow/ragflow/pull/1867
* fix: Reference markers in the context may be carried over into the next answer by @leecj in https://github.com/infiniflow/ragflow/pull/1855
* add support for gpt-4o-mini by @AAlexDing in https://github.com/infiniflow/ragflow/pull/1827
* Add GitHub, deepl, baidu-fanyi by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1857
* fix code injection by @Lyutoon in https://github.com/infiniflow/ragflow/pull/1868
* less text, better extraction by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1869
* feat: Add component DeepL #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1870
* feat: Add component GitHub #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1871
* feat: Add component BaiduFanyi #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1874
* Add component qweather by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1873
* Update version and format by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1878
* feat:  Replace the LocalAi icon #762 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1875
* Enhance the robustness of the code by @hangters in https://github.com/infiniflow/ragflow/pull/1879
* feat: Add component QWeather #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1881
* add using jina deploy local llm in deploy_local_llm.mdx by @hangters in https://github.com/infiniflow/ragflow/pull/1872
* fix: model type only support single value by @hangters in https://github.com/infiniflow/ragflow/pull/1884
* add function: upload and parse by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1889
* Add agent api by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1888
* fix no modual error by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1892
* rm qwen-v1-max by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1894
* remove qwen-v1-max by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1895
* feat: Expose the agent's chat window to third parties #1842 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1897
* Fix token list , stats in api app.py by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1896
* add support for PerfXCloud by @hangters in https://github.com/infiniflow/ragflow/pull/1883
* add support for TogetherAI by @hangters in https://github.com/infiniflow/ragflow/pull/1890
* add support for Upstage by @hangters in https://github.com/infiniflow/ragflow/pull/1902
* Fix agent non stream by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1904
* add sql to naive parser by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1908
* fix: When the component id is very long, the delete button of generate will be hidden #1906 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1907
* feat: Add delimiter field to naive parsing method #1909 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1911
* add support for novita.ai by @hangters in https://github.com/infiniflow/ragflow/pull/1910
* fix: Chunks cannot be deleted #1912 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1913
* feat: Added explanation on the parsing method of knowledge graph #1594 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1916
* fix api argument error by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1920
* fix: Error on chat api,<BadRequestKeyError '400: Bad Request'> #1918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1923
* boost paralal of graphrag by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1924
* fix parameter error by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1925
* feat: After selecting the parsing method as knowledge graph, the delimiter and chunk token number are displayed. #1594 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1929
* Fix retrieval API error  and add multi-kb search by @wingjson in https://github.com/infiniflow/ragflow/pull/1928
* add support for SILICONFLOW by @hangters in https://github.com/infiniflow/ragflow/pull/1926
* fix prefXCloud logo bug by @hangters in https://github.com/infiniflow/ragflow/pull/1933
* feat: Modify PerfXCloud name #1853 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1931
* fix mind map bug by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1934
* refine error log while chunking by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1937
* refine llm init by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1938
* fix empty graph issue by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1939
* add doc ids to chat by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1944
* feat: Supports chatting with files/images #1880 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1943
* requirements_dev.txt is useless by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1945
* Format file format from Windows/dos to Unix by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1949
* feat: Delete the file from the upload control of the message input box  #1880 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1946
* add interface to get doc infos by doc ids by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1950
* Refactor switch component by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1940
* add support for 01.AI by @hangters in https://github.com/infiniflow/ragflow/pull/1951
* Correct the incorrect description of the pre-installed models on the SILICONFLOW platform. by @morler in https://github.com/infiniflow/ragflow/pull/1956
* feat: Add FileIcon #1880 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1960
* Update api.md by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1961
* fix add Bedrock llm error by @hangters in https://github.com/infiniflow/ragflow/pull/1952
* feat: Add MessageInput to the external chat page #1880 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1963
* feat: Delete the files uploaded in the external dialog box #1880 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1967
* Refactor user register by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1962
* refine upload & parse by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1969
* Refactor user registration by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1970
* Refactor user register & login by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1971
* fix OpenAI Embedding length error by @hangters in https://github.com/infiniflow/ragflow/pull/1972
* Add component ExeSQL by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1966
* fix: Opening file whose type is Knowledge Graph appear error with tsx #1975 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1978
* fix 01.ai url error by @hangters in https://github.com/infiniflow/ragflow/pull/1977
* feat: Add component ExecSQL #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1982
* feat:  Add tip to loop of ExeSQL #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1983
* feat: Hide the upload button in the external agent's chat box  #1880 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1984
* Update README.md by @andrewkwok-shanghaitech in https://github.com/infiniflow/ragflow/pull/1979
* fix empty mind map issue by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1991
* Add API to get doc info by doc ids by @wingjson in https://github.com/infiniflow/ragflow/pull/1986
* Add template text2sql by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1985
* add support for Replicate by @hangters in https://github.com/infiniflow/ragflow/pull/1980
* feat: Add SwitchForm #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1994
* fix mutiple retrieval component content by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1997
* Refactor display Text by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1999
* feat: Add complex dynamic form to SwitchForm #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2001
* feat: Extract the code for building categorize operator coordinates to hooks.ts #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2005
* Fix mutiple retrieval component content by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/2006
* Fix generate param empty_response by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/2010
* Updated Model Information for Tongyi-Qianwen and ZHIPU-AI by @morler in https://github.com/infiniflow/ragflow/pull/2003
* turn down es bulk size by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/2013
* add support for Tencent Hunyuan by @hangters in https://github.com/infiniflow/ragflow/pull/2015
* feat: Build the positions of the Switch handle #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2018
* add support for XunFei Spark by @hangters in https://github.com/infiniflow/ragflow/pull/2017
* doc: fix zh and ja document type by @aboutmydreams in https://github.com/infiniflow/ragflow/pull/2012
* feat: Build the edges of Switch  by form data #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2022
* feat: Update Switch form data #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2029
* Fix generate component reset_index and update text2sql template prompt by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/2031
* feat: Add SwitchOperatorOptions to Select of Switch #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2033
* feat: Test the database connection of the ExeSQL operator #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2036
* feat: Build options for the component id field of the Switch operator #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2037
* add taskexecutor status check by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/2038
* How to make your changes to vm.max_map_count persistent on macOS by @writinwaters in https://github.com/infiniflow/ragflow/pull/2041
* feat: Delete Answer and Relevant from RestrictedUpstreamMap of Switch #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2039
* show error log of KG extraction by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/2045
* fix: Fix return type annotation in truncate function by @huangbaichao in https://github.com/infiniflow/ragflow/pull/2044
* filter out + in es query by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/2046
* Fix component exesql bug by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/2042
* Refactor component exesql by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/2048
* [Doc] Add Korean translation for README.md by @RektPunk in https://github.com/infiniflow/ragflow/pull/2040
* add support for markdown file in one parse way by @hangters in https://github.com/infiniflow/ragflow/pull/2052
* feat: Fixed the issue where the test database connection was successful but the prompt message showed that there was no error status #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2051
* Add template DB Assistant and exesql sql column description by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/2054
* add support for Baidu yiyan by @hangters in https://github.com/infiniflow/ragflow/pull/2049
* Add Explanation for entering the API key when adding an LLM by @hangters in https://github.com/infiniflow/ragflow/pull/2055
* feat: Create a conversation before uploading files in it #1880 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2057
* feat: Remove Typography from SwitchForm #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2059
* fix uploading docx for mind map by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/2064
* Fix Bedrock system prompt by @rantav in https://github.com/infiniflow/ragflow/pull/2062
* support monitoring task executor by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/2069
* fix: Add Task Executor to system panel #2061 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2070
* update doc for release by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/2071

## New Contributors
* @AAlexDing made their first contribution in https://github.com/infiniflow/ragflow/pull/1827
* @Lyutoon made their first contribution in https://github.com/infiniflow/ragflow/pull/1868
* @wingjson made their first contribution in https://github.com/infiniflow/ragflow/pull/1928
* @morler made their first contribution in https://github.com/infiniflow/ragflow/pull/1956
* @andrewkwok-shanghaitech made their first contribution in https://github.com/infiniflow/ragflow/pull/1979
* @aboutmydreams made their first contribution in https://github.com/infiniflow/ragflow/pull/2012
* @RektPunk made their first contribution in https://github.com/infiniflow/ragflow/pull/2040
* @rantav made their first contribution in https://github.com/infiniflow/ragflow/pull/2062

**Full Changelog**: https://github.com/infiniflow/ragflow/compare/v0.9.0...v0.10.0