v0.10.0
infiniflow/ragflowv0.10.0Aug 23, 2024by KevinHuSh
AI Summary
Released on August 23, 2024, this release supports text-to-SQL by RAG and provides Agent API. It adds monitoring for the task executor and introduces new operators like Github, DeepL, and ExecSQL.
Key Highlights
- Supports text to SQL by RAG.
- Provide the health check on task_executor process.
- Add more Agent operator: Github, DeepL, BaiduFanyi, QWeather, ExecSQL, GoogleScholar.
- Supports file type: eml.
- Supports embedding model: Cohere.
New Features
- Provides Agent API.
- Supports more LLMs: GPT-4o-mini, PerfXCloud, TogetherAI, Upstage, Novita.AI, 01.AI, SiliconFlow, XunFei Spark, Baidu Yiyan, Tencent Hunyuan.
Full Release Notes
## Release Summary - Supports text to SQL by RAG - Provides Agent API - Provide the health check on task_executor process. - Add more Agent operator: Github, DeepL, BaiduFanyi, QWeather, ExecSQL, GoogleScholar - Supports file type: eml - Supports embedding model: Cohere - Supports more LLMs or model services : GPT-4o-mini, PerfXCloud, TogetherAI, Upstage, Novita.AI, 01.AI, SiliconFlow, XunFei Spark, Baidu Yiyan, Tencent Hunyuan ## What's Changed * refine loginfo about graprag progress by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1823 * feat: Add GoogleScholar #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1818 * fix: align limitation with env by @Chunshan-Theta in https://github.com/infiniflow/ragflow/pull/1819 * add supprot for OpenAI-API-Compatible llm by @hangters in https://github.com/infiniflow/ragflow/pull/1787 * add support for eml file parser by @hangters in https://github.com/infiniflow/ragflow/pull/1768 * fix #1816 by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1829 * Fixed a broken link by @writinwaters in https://github.com/infiniflow/ragflow/pull/1831 * feat: Move files in file manager #1826 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1837 * fix: Unable to create a new chat assistant after closing the edit modal #1833 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1838 * fix: Embedding error in file parsing #1835 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1839 * fix: Entity types are only displayed when the knowledge graph is selected #1594 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1841 * add callback to entity extraction by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1843 * refine mindmap by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1844 * fix LocalAI add bug by @hangters in https://github.com/infiniflow/ragflow/pull/1851 * add support for cohere by @hangters in https://github.com/infiniflow/ragflow/pull/1849 * fix add slef base url openai error by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1854 * feat: Do not display arrow icons on leaf node of folders #1826 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1862 * fix: The size of operators created from agent templates is displayed incorrectly #1863 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1864 * Fix a "TypeError: expected string or buffer bug" in docx files extracted using Knowledge Graph.#1859 by @jiyegege in https://github.com/infiniflow/ragflow/pull/1865 * add support for lepton by @hangters in https://github.com/infiniflow/ragflow/pull/1866 * remove jina pack in requirement file to fix package conflict by @hangters in https://github.com/infiniflow/ragflow/pull/1867 * fix: Reference markers in the context may be carried over into the next answer by @leecj in https://github.com/infiniflow/ragflow/pull/1855 * add support for gpt-4o-mini by @AAlexDing in https://github.com/infiniflow/ragflow/pull/1827 * Add GitHub, deepl, baidu-fanyi by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1857 * fix code injection by @Lyutoon in https://github.com/infiniflow/ragflow/pull/1868 * less text, better extraction by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1869 * feat: Add component DeepL #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1870 * feat: Add component GitHub #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1871 * feat: Add component BaiduFanyi #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1874 * Add component qweather by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1873 * Update version and format by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1878 * feat: Replace the LocalAi icon #762 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1875 * Enhance the robustness of the code by @hangters in https://github.com/infiniflow/ragflow/pull/1879 * feat: Add component QWeather #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1881 * add using jina deploy local llm in deploy_local_llm.mdx by @hangters in https://github.com/infiniflow/ragflow/pull/1872 * fix: model type only support single value by @hangters in https://github.com/infiniflow/ragflow/pull/1884 * add function: upload and parse by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1889 * Add agent api by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1888 * fix no modual error by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1892 * rm qwen-v1-max by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1894 * remove qwen-v1-max by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1895 * feat: Expose the agent's chat window to third parties #1842 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1897 * Fix token list , stats in api app.py by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1896 * add support for PerfXCloud by @hangters in https://github.com/infiniflow/ragflow/pull/1883 * add support for TogetherAI by @hangters in https://github.com/infiniflow/ragflow/pull/1890 * add support for Upstage by @hangters in https://github.com/infiniflow/ragflow/pull/1902 * Fix agent non stream by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1904 * add sql to naive parser by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1908 * fix: When the component id is very long, the delete button of generate will be hidden #1906 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1907 * feat: Add delimiter field to naive parsing method #1909 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1911 * add support for novita.ai by @hangters in https://github.com/infiniflow/ragflow/pull/1910 * fix: Chunks cannot be deleted #1912 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1913 * feat: Added explanation on the parsing method of knowledge graph #1594 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1916 * fix api argument error by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1920 * fix: Error on chat api,<BadRequestKeyError '400: Bad Request'> #1918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1923 * boost paralal of graphrag by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1924 * fix parameter error by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1925 * feat: After selecting the parsing method as knowledge graph, the delimiter and chunk token number are displayed. #1594 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1929 * Fix retrieval API error and add multi-kb search by @wingjson in https://github.com/infiniflow/ragflow/pull/1928 * add support for SILICONFLOW by @hangters in https://github.com/infiniflow/ragflow/pull/1926 * fix prefXCloud logo bug by @hangters in https://github.com/infiniflow/ragflow/pull/1933 * feat: Modify PerfXCloud name #1853 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1931 * fix mind map bug by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1934 * refine error log while chunking by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1937 * refine llm init by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1938 * fix empty graph issue by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1939 * add doc ids to chat by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1944 * feat: Supports chatting with files/images #1880 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1943 * requirements_dev.txt is useless by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1945 * Format file format from Windows/dos to Unix by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1949 * feat: Delete the file from the upload control of the message input box #1880 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1946 * add interface to get doc infos by doc ids by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1950 * Refactor switch component by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1940 * add support for 01.AI by @hangters in https://github.com/infiniflow/ragflow/pull/1951 * Correct the incorrect description of the pre-installed models on the SILICONFLOW platform. by @morler in https://github.com/infiniflow/ragflow/pull/1956 * feat: Add FileIcon #1880 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1960 * Update api.md by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1961 * fix add Bedrock llm error by @hangters in https://github.com/infiniflow/ragflow/pull/1952 * feat: Add MessageInput to the external chat page #1880 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1963 * feat: Delete the files uploaded in the external dialog box #1880 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1967 * Refactor user register by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1962 * refine upload & parse by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1969 * Refactor user registration by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1970 * Refactor user register & login by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1971 * fix OpenAI Embedding length error by @hangters in https://github.com/infiniflow/ragflow/pull/1972 * Add component ExeSQL by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1966 * fix: Opening file whose type is Knowledge Graph appear error with tsx #1975 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1978 * fix 01.ai url error by @hangters in https://github.com/infiniflow/ragflow/pull/1977 * feat: Add component ExecSQL #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1982 * feat: Add tip to loop of ExeSQL #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1983 * feat: Hide the upload button in the external agent's chat box #1880 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1984 * Update README.md by @andrewkwok-shanghaitech in https://github.com/infiniflow/ragflow/pull/1979 * fix empty mind map issue by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1991 * Add API to get doc info by doc ids by @wingjson in https://github.com/infiniflow/ragflow/pull/1986 * Add template text2sql by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1985 * add support for Replicate by @hangters in https://github.com/infiniflow/ragflow/pull/1980 * feat: Add SwitchForm #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1994 * fix mutiple retrieval component content by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1997 * Refactor display Text by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1999 * feat: Add complex dynamic form to SwitchForm #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2001 * feat: Extract the code for building categorize operator coordinates to hooks.ts #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2005 * Fix mutiple retrieval component content by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/2006 * Fix generate param empty_response by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/2010 * Updated Model Information for Tongyi-Qianwen and ZHIPU-AI by @morler in https://github.com/infiniflow/ragflow/pull/2003 * turn down es bulk size by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/2013 * add support for Tencent Hunyuan by @hangters in https://github.com/infiniflow/ragflow/pull/2015 * feat: Build the positions of the Switch handle #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2018 * add support for XunFei Spark by @hangters in https://github.com/infiniflow/ragflow/pull/2017 * doc: fix zh and ja document type by @aboutmydreams in https://github.com/infiniflow/ragflow/pull/2012 * feat: Build the edges of Switch by form data #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2022 * feat: Update Switch form data #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2029 * Fix generate component reset_index and update text2sql template prompt by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/2031 * feat: Add SwitchOperatorOptions to Select of Switch #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2033 * feat: Test the database connection of the ExeSQL operator #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2036 * feat: Build options for the component id field of the Switch operator #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2037 * add taskexecutor status check by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/2038 * How to make your changes to vm.max_map_count persistent on macOS by @writinwaters in https://github.com/infiniflow/ragflow/pull/2041 * feat: Delete Answer and Relevant from RestrictedUpstreamMap of Switch #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2039 * show error log of KG extraction by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/2045 * fix: Fix return type annotation in truncate function by @huangbaichao in https://github.com/infiniflow/ragflow/pull/2044 * filter out + in es query by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/2046 * Fix component exesql bug by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/2042 * Refactor component exesql by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/2048 * [Doc] Add Korean translation for README.md by @RektPunk in https://github.com/infiniflow/ragflow/pull/2040 * add support for markdown file in one parse way by @hangters in https://github.com/infiniflow/ragflow/pull/2052 * feat: Fixed the issue where the test database connection was successful but the prompt message showed that there was no error status #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2051 * Add template DB Assistant and exesql sql column description by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/2054 * add support for Baidu yiyan by @hangters in https://github.com/infiniflow/ragflow/pull/2049 * Add Explanation for entering the API key when adding an LLM by @hangters in https://github.com/infiniflow/ragflow/pull/2055 * feat: Create a conversation before uploading files in it #1880 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2057 * feat: Remove Typography from SwitchForm #1739 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2059 * fix uploading docx for mind map by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/2064 * Fix Bedrock system prompt by @rantav in https://github.com/infiniflow/ragflow/pull/2062 * support monitoring task executor by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/2069 * fix: Add Task Executor to system panel #2061 by @cike8899 in https://github.com/infiniflow/ragflow/pull/2070 * update doc for release by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/2071 ## New Contributors * @AAlexDing made their first contribution in https://github.com/infiniflow/ragflow/pull/1827 * @Lyutoon made their first contribution in https://github.com/infiniflow/ragflow/pull/1868 * @wingjson made their first contribution in https://github.com/infiniflow/ragflow/pull/1928 * @morler made their first contribution in https://github.com/infiniflow/ragflow/pull/1956 * @andrewkwok-shanghaitech made their first contribution in https://github.com/infiniflow/ragflow/pull/1979 * @aboutmydreams made their first contribution in https://github.com/infiniflow/ragflow/pull/2012 * @RektPunk made their first contribution in https://github.com/infiniflow/ragflow/pull/2040 * @rantav made their first contribution in https://github.com/infiniflow/ragflow/pull/2062 **Full Changelog**: https://github.com/infiniflow/ragflow/compare/v0.9.0...v0.10.0