v0.8.0
infiniflow/ragflowv0.8.0Jul 8, 2024by KevinHuSh
AI Summary
Released on July 8, 2024, this release focuses on Self-RAG support and Graph/Agent UI improvements. It enhances parsing capabilities for PDF, Docx, and Markdown files and updates the Dataset API.
Key Highlights
- Support Self-RAG.
- Graph/Agent UI improvements including nodes, edges, and forms.
- Supports obtaining PDF documents from web pages.
- API updates for Dataset management (create, update, delete).
- Integration with Discord server.
New Features
- Add Mistral model support.
- Add pdf support for QA parser.
- Add docx support for QA parser.
- Add markdown support for QA parser.
- Add bedrock icon.
Full Release Notes
## What's Changed * Update README by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1001 * fix bug 994 ,991 by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1004 * fix #994 by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1006 * Update info by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1005 * Add file rag/svr/discord_svr.py by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1008 * fix chunk modification bug by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1011 * Adding the Minimax model by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1009 * Update README_zh.md,typo by @ArtificialZeng in https://github.com/infiniflow/ragflow/pull/997 * Update README by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1014 * Fix: bug #991 by @chinamerp in https://github.com/infiniflow/ragflow/pull/1013 * Add API for moving files by @aopstudio in https://github.com/infiniflow/ragflow/pull/1016 * refine file select code by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1021 * Update readme and add license by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1018 * refine API request data processing by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1031 * fix: fixed the problem that the api will be called directly after selecting the chat assistant picture by @cike8899 in https://github.com/infiniflow/ragflow/pull/1034 * create the python sdk to return version by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1039 * [doc] Updated document on max map count by @writinwaters in https://github.com/infiniflow/ragflow/pull/1037 * Update SDK->sdk, and add create_dataset by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1047 * added delete_dataset method by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1051 * fix: change the address of the ollama document by @cike8899 in https://github.com/infiniflow/ragflow/pull/1043 * delete SDK repo and edit readme by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1054 * refine rerank by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1056 * feat: add custom edge by @cike8899 in https://github.com/infiniflow/ragflow/pull/1061 * add version to package volcengine by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1062 * feat: fetch flow by @cike8899 in https://github.com/infiniflow/ragflow/pull/1068 * add self-rag by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1070 * feat: Support Password Access for ElasticSearch by @cklogic in https://github.com/infiniflow/ragflow/pull/1072 * rm wrongly uploaded py by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1073 * feat: run flow by @cike8899 in https://github.com/infiniflow/ragflow/pull/1076 * feat: support Self-RAG #1069 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1079 * feat: modify the chinese translation of self-rag #1069 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1081 * The interface supported by Traditional Chinese is not complete #1074 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1082 * documentaion for self-rag by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1080 * feat: add FlowChatBox #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1086 * fix: bug similarity() in YoudaoRerank by @chinamerp in https://github.com/infiniflow/ragflow/pull/1084 * Updated Ollama part of local deployment by @writinwaters in https://github.com/infiniflow/ragflow/pull/1066 * fix bug in api by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1088 * Fixed a Docusaurus display issue by @writinwaters in https://github.com/infiniflow/ragflow/pull/1089 * feat: watch graph change by @cike8899 in https://github.com/infiniflow/ragflow/pull/1092 * fix: logger formater is not work by @chinamerp in https://github.com/infiniflow/ragflow/pull/1090 * [doc] Updated default value of quote in 'get answers' by @writinwaters in https://github.com/infiniflow/ragflow/pull/1093 * add preview gif by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1097 * feat: add OperateDropdown and send debug message #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1095 * Update README by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1101 * Add redis config by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1104 * infinity: Update embedding_model.py by @michaelfeil in https://github.com/infiniflow/ragflow/pull/1109 * Supports obtaining PDF documents from web pages by @fkzhao in https://github.com/infiniflow/ragflow/pull/1107 * fix: hide web crawl menu item by @cike8899 in https://github.com/infiniflow/ragflow/pull/1110 * API: create dataset by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1106 * feat: generate uuid with human-id #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1111 * Updated the doc for configuring api key by @writinwaters in https://github.com/infiniflow/ragflow/pull/1112 * feat: catch errors when sending messages #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1113 * feat: add icon to graph nodes #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1117 * [doc] Minor editorial updates. by @writinwaters in https://github.com/infiniflow/ragflow/pull/1115 * feat: set the anchor points of all nodes to be enterable and exitable #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1119 * Update discord link by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1123 * refactor by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1124 * feat: when a node of the graph is selected, the border of the node is highlighted. #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1125 * fix multi-modual bug by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1127 * feat: add delete menu to graph node #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1133 * feat: duplicate node #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1136 * fix file preview in file management by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1151 * support graph by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1152 * add support for mistral by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1153 * Add pdf support for QA parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1155 * refine doc about supporting PDF for Q&A by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1160 * Fix VolcEngine BUG by @yungongzi in https://github.com/infiniflow/ragflow/pull/1165 * Fix Docker image building failure on MacOS (ARM architecture) by @aopstudio in https://github.com/infiniflow/ragflow/pull/1177 * upgrade version fix security bug by @rickywu in https://github.com/infiniflow/ragflow/pull/1173 * create list_dataset api and tests by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1138 * delete_dataset method and tests created by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1186 * added documentation for api and fixed: duplicate get_dataset() by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1190 * [doc] RAGFlow's api key never expires by @writinwaters in https://github.com/infiniflow/ragflow/pull/1188 * added api documentation and added more tests by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1194 * Add markdown support for QA parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1180 * fix too long query exception by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1195 * Remove the visibilty of RAGFlow API by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1196 * [doc] Hid new API doc on docusaurus site by @writinwaters in https://github.com/infiniflow/ragflow/pull/1198 * fixed: duplicate name by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1202 * add README to graph by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1211 * fix: using embd which user configured at knowledgebase by @chinamerp in https://github.com/infiniflow/ragflow/pull/1163 * created get_dataset, update_dataset API and fixed: delete by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1201 * fix:failed to Create new Chunk in database #1159 by @chinamerp in https://github.com/infiniflow/ragflow/pull/1214 * Add docx support for QA parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1213 * Add docx support for manual parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1227 * polished doc for dataset API by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1219 * feat: support json file by @chinamerp in https://github.com/infiniflow/ragflow/pull/1217 * refine code to prevent exception by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1231 * feat: grey out the team function #1221 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1244 * Create SECURITY.md by @William957-web in https://github.com/infiniflow/ragflow/pull/1241 * Let json files support naive parsing methods #1245 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1247 * Place pdf's image at the correct position in QA parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1235 * fix Rerank Vector Similarity Score by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1249 * feat: format code before submitting it #1251 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1252 * Support displaying images in the chunks of docx files when using general parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1253 * Update SECURITY.md by @William957-web in https://github.com/infiniflow/ragflow/pull/1248 * Optimized the chat interface (including the chat API after sharing) by @yungongzi in https://github.com/infiniflow/ragflow/pull/1215 * feat: modify the background color of chat messages by @cike8899 in https://github.com/infiniflow/ragflow/pull/1262 * Support displaying tables in the chunks of pdf file when using QA parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1263 * feat: add LLMSelect by @cike8899 in https://github.com/infiniflow/ragflow/pull/1270 * API: upload document api by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1264 * feat: add DynamicCategorize #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1273 * feat: build categorize list from object #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1276 * feat: change nodes to circular #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1279 * feat: add CategorizeHandle #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1282 * docs: update quickstart.mdx by @eltociear in https://github.com/infiniflow/ragflow/pull/1283 * feat: use useUpdateNodeInternals to solve the issue that the newly ad… by @cike8899 in https://github.com/infiniflow/ragflow/pull/1287 * Update README.md by @Hegenittih in https://github.com/infiniflow/ragflow/pull/1286 * Fix dependency conflict by @aopstudio in https://github.com/infiniflow/ragflow/pull/1293 * Fix occasional errors in pdf table recognition by @aopstudio in https://github.com/infiniflow/ragflow/pull/1277 * Support table for markdown file in general parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1278 * Update sdk readme by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1291 * Fix ragflow may encounter an OOM (Out Of Memory) when there are a lot of conversations by @hwzhuhao in https://github.com/infiniflow/ragflow/pull/1292 * fix mem leak for local reranker by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1295 * feat: restrict classification operators cannot be connected to Answer and other classification #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1294 * feat: delete the edge on the classification node anchor when the anch… by @cike8899 in https://github.com/infiniflow/ragflow/pull/1297 * feat: set the edge as the data source to achieve two-way linkage betw… by @cike8899 in https://github.com/infiniflow/ragflow/pull/1299 * Introduce new features by @aopstudio in https://github.com/infiniflow/ragflow/pull/1296 * feat: fix the problem of form entries being deleted when adding a new line #918 and clear the selection box to delete the corresponding edge by @cike8899 in https://github.com/infiniflow/ragflow/pull/1301 * Update README.md by @leenuhom in https://github.com/infiniflow/ragflow/pull/1285 * feat: filter out selected values in other to fields from the curren… by @cike8899 in https://github.com/infiniflow/ragflow/pull/1307 * feat: limit there to be only one line between two nodes #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1310 * API: completed delete_doc api by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1290 * feat: translate fields of CategorizeForm #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1311 * feat: add MessageForm #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1312 * feat: add RelevantForm #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1313 * fix: fixed the issue where spaces could not be entered in the message… by @cike8899 in https://github.com/infiniflow/ragflow/pull/1320 * Optimize docx handle method in laws parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1302 * feat: get the operator type from id #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1323 * feat: construct the edge of the classification operator from dsl #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1329 * upgrade laws parser of docx by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1332 * feat: modify the name of an operator #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1333 * API: created list_doc by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1327 * feat: modify the style of the operator #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1335 * Doc: added doc for three doc methods by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1336 * feat: customize edge arrow #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1338 * feat: add CreateFlowModal #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1343 * Add Intel IPEX-LLM setup under deploy_local_llm by @lzivan in https://github.com/infiniflow/ragflow/pull/1269 * feat: add RelevantForm #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1344 * feat: add DynamicParameters #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1346 * add interpreter to graph by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1347 * feat: build nodes and edges from customer_service dsl #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1348 * feat: create flow from dsl template #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1351 * API: create update_doc method by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1341 * feat: create blank canvas #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1356 * feat: pull the message list after sending the message successfully #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1364 * Integrates LLM Azure OpenAI by @yonghuili1 in https://github.com/infiniflow/ragflow/pull/1318 * fix: add icon to MiniMax and Mistral #1353 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1367 * refine templates of graph by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1368 * feat: call the reset api before opening the run drawer each time #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1370 * feat: build nodes and edges from chat bot dsl #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1372 * add keyword extraction in graph by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1373 * feat: add graph tab to header #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1374 * feat: replace the graph icon in the header #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1376 * API: Download doc api by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1354 * feat: add description text to operators and extract the useFetchModelId to logicHooks.ts and drag the operator to the canvas and initialize the form data #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1379 * feat: deleting a node does not require a confirmation box to pop up #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1380 * Add Graph Baidusearch and dsl_example by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1378 * feat: click on a blank area of the canvas to hide the form drawer #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1384 * feat: add GraphAvatar to graph list #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1385 * feat: save graph data before opening the debug drawer #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1387 * feat: save the parameters of the generate operator to the form field … by @cike8899 in https://github.com/infiniflow/ragflow/pull/1390 * Duckduckgosearch by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1388 * feat: add duckduckgo icon #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1391 * feat: after deleting the edge, set the corresponding field in the node's form field to undefined #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1393 * add Duckduckgo pkg by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1392 * fix: use user-defined rerank model's top_k parameter when knowledge Q&A conversation by @hwzhuhao in https://github.com/infiniflow/ragflow/pull/1396 * be more specific for error message by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1409 * Add Support for AWS Bedrock by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1408 * fix duckduckgosearch.py bug by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1410 * feat: translate graph #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1411 * feat: node cannot connect to itself #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1412 * feat: add icon to title of operator form #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1413 * fix botocore by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1414 * feat: when Categorize establishes a connection with other operators, it adds the target node to the to field. #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1418 * update docs for release 0.8.0 by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1419 * examples empty in categorize by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1422 * feat: highlight the nodes that the workflow passes through #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1423 * update Minimax and Azure-Openai icon in setting page by @hangters in https://github.com/infiniflow/ragflow/pull/1420 * feat: translate graph list #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1426 * feat: translate graph of header #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1428 * empty kb id for templates by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1429 * feat: add bedrock icon by @cike8899 in https://github.com/infiniflow/ragflow/pull/1430 * Fixed a docusaurus display issue by @writinwaters in https://github.com/infiniflow/ragflow/pull/1431 ## New Contributors * @cecilia-uu made their first contribution in https://github.com/infiniflow/ragflow/pull/1009 * @ArtificialZeng made their first contribution in https://github.com/infiniflow/ragflow/pull/997 * @chinamerp made their first contribution in https://github.com/infiniflow/ragflow/pull/1013 * @michaelfeil made their first contribution in https://github.com/infiniflow/ragflow/pull/1109 * @rickywu made their first contribution in https://github.com/infiniflow/ragflow/pull/1173 * @William957-web made their first contribution in https://github.com/infiniflow/ragflow/pull/1241 * @Hegenittih made their first contribution in https://github.com/infiniflow/ragflow/pull/1286 * @hwzhuhao made their first contribution in https://github.com/infiniflow/ragflow/pull/1292 * @leenuhom made their first contribution in https://github.com/infiniflow/ragflow/pull/1285 * @lzivan made their first contribution in https://github.com/infiniflow/ragflow/pull/1269 * @hangters made their first contribution in https://github.com/infiniflow/ragflow/pull/1420 **Full Changelog**: https://github.com/infiniflow/ragflow/compare/v0.7.0...v0.8.0