v0.8.0

infiniflow/ragflowv0.8.0Jul 8, 2024by KevinHuSh

AI Summary

Released on July 8, 2024, this release focuses on Self-RAG support and Graph/Agent UI improvements. It enhances parsing capabilities for PDF, Docx, and Markdown files and updates the Dataset API.

Key Highlights

  • Support Self-RAG.
  • Graph/Agent UI improvements including nodes, edges, and forms.
  • Supports obtaining PDF documents from web pages.
  • API updates for Dataset management (create, update, delete).
  • Integration with Discord server.

New Features

  • Add Mistral model support.
  • Add pdf support for QA parser.
  • Add docx support for QA parser.
  • Add markdown support for QA parser.
  • Add bedrock icon.

Full Release Notes

## What's Changed
* Update README by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1001
* fix bug 994 ,991 by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1004
* fix #994 by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1006
* Update info by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1005
* Add file rag/svr/discord_svr.py by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1008
* fix chunk modification bug by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1011
* Adding the Minimax model by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1009
* Update README_zh.md,typo by @ArtificialZeng in https://github.com/infiniflow/ragflow/pull/997
* Update README by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1014
* Fix: bug #991 by @chinamerp in https://github.com/infiniflow/ragflow/pull/1013
* Add API for moving files by @aopstudio in https://github.com/infiniflow/ragflow/pull/1016
* refine file select code by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1021
* Update readme and add license by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1018
* refine API request data processing by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1031
* fix: fixed the problem that the api will be called directly after selecting the chat assistant picture by @cike8899 in https://github.com/infiniflow/ragflow/pull/1034
* create the python sdk to return version by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1039
* [doc] Updated document on max map count by @writinwaters in https://github.com/infiniflow/ragflow/pull/1037
* Update SDK->sdk, and add create_dataset by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1047
* added delete_dataset method by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1051
* fix: change the address of the ollama document by @cike8899 in https://github.com/infiniflow/ragflow/pull/1043
* delete SDK repo and edit readme by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1054
* refine rerank by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1056
* feat: add custom edge by @cike8899 in https://github.com/infiniflow/ragflow/pull/1061
* add version to package volcengine by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1062
* feat: fetch flow by @cike8899 in https://github.com/infiniflow/ragflow/pull/1068
* add self-rag by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1070
* feat: Support Password Access for ElasticSearch by @cklogic in https://github.com/infiniflow/ragflow/pull/1072
* rm wrongly uploaded py by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1073
* feat: run flow by @cike8899 in https://github.com/infiniflow/ragflow/pull/1076
* feat: support Self-RAG #1069 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1079
* feat: modify the chinese translation of self-rag #1069 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1081
* The interface supported by Traditional Chinese is not complete #1074 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1082
* documentaion for self-rag by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1080
* feat: add FlowChatBox #918  by @cike8899 in https://github.com/infiniflow/ragflow/pull/1086
* fix: bug similarity() in YoudaoRerank by @chinamerp in https://github.com/infiniflow/ragflow/pull/1084
* Updated Ollama part of local deployment by @writinwaters in https://github.com/infiniflow/ragflow/pull/1066
* fix bug in api by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1088
* Fixed a Docusaurus display issue by @writinwaters in https://github.com/infiniflow/ragflow/pull/1089
* feat: watch graph change by @cike8899 in https://github.com/infiniflow/ragflow/pull/1092
* fix: logger formater is not work by @chinamerp in https://github.com/infiniflow/ragflow/pull/1090
* [doc] Updated default value of quote in 'get answers' by @writinwaters in https://github.com/infiniflow/ragflow/pull/1093
* add preview gif by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1097
* feat: add OperateDropdown and send debug message #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1095
* Update README by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1101
* Add redis config by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1104
* infinity: Update embedding_model.py by @michaelfeil in https://github.com/infiniflow/ragflow/pull/1109
* Supports obtaining PDF documents from web pages by @fkzhao in https://github.com/infiniflow/ragflow/pull/1107
* fix: hide web crawl menu item by @cike8899 in https://github.com/infiniflow/ragflow/pull/1110
* API: create dataset by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1106
* feat: generate uuid with human-id #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1111
* Updated the doc for configuring api key by @writinwaters in https://github.com/infiniflow/ragflow/pull/1112
* feat: catch errors when sending messages #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1113
* feat: add icon to graph nodes #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1117
* [doc] Minor editorial updates. by @writinwaters in https://github.com/infiniflow/ragflow/pull/1115
* feat: set the anchor points of all nodes to be enterable and exitable #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1119
* Update discord link by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1123
* refactor by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1124
* feat: when a node of the graph is selected, the border of the node is highlighted. #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1125
* fix multi-modual bug by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1127
* feat: add delete menu to graph node #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1133
* feat: duplicate node #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1136
* fix file preview in file management by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1151
* support graph by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1152
* add support for mistral by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1153
* Add pdf support for QA parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1155
* refine doc about supporting PDF for Q&A by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1160
* Fix VolcEngine BUG by @yungongzi in https://github.com/infiniflow/ragflow/pull/1165
* Fix Docker image building failure on MacOS (ARM architecture) by @aopstudio in https://github.com/infiniflow/ragflow/pull/1177
* upgrade version fix security bug by @rickywu in https://github.com/infiniflow/ragflow/pull/1173
* create list_dataset api and tests by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1138
* delete_dataset method and tests created by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1186
* added documentation for api and fixed: duplicate get_dataset() by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1190
* [doc] RAGFlow's api key never expires by @writinwaters in https://github.com/infiniflow/ragflow/pull/1188
* added api documentation and added more tests by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1194
* Add markdown support for QA parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1180
* fix too long query exception by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1195
* Remove the visibilty of RAGFlow API by @JinHai-CN in https://github.com/infiniflow/ragflow/pull/1196
* [doc] Hid new API doc on docusaurus site by @writinwaters in https://github.com/infiniflow/ragflow/pull/1198
* fixed: duplicate name by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1202
* add README to graph by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1211
* fix: using embd which user configured at knowledgebase by @chinamerp in https://github.com/infiniflow/ragflow/pull/1163
* created get_dataset, update_dataset API and fixed: delete by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1201
* fix:failed to Create new Chunk in database #1159 by @chinamerp in https://github.com/infiniflow/ragflow/pull/1214
* Add docx support for QA parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1213
* Add docx support for manual parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1227
* polished doc for dataset API by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1219
* feat: support json file by @chinamerp in https://github.com/infiniflow/ragflow/pull/1217
* refine code to prevent exception by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1231
* feat: grey out the team function #1221 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1244
* Create SECURITY.md by @William957-web in https://github.com/infiniflow/ragflow/pull/1241
* Let json files support naive parsing methods #1245 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1247
* Place pdf's image at the correct position in QA parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1235
* fix Rerank Vector Similarity Score by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1249
* feat: format code before submitting it #1251  by @cike8899 in https://github.com/infiniflow/ragflow/pull/1252
* Support displaying images in the chunks of docx files when using general parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1253
* Update SECURITY.md by @William957-web in https://github.com/infiniflow/ragflow/pull/1248
* Optimized the chat interface (including the chat API after sharing) by @yungongzi in https://github.com/infiniflow/ragflow/pull/1215
* feat: modify the background color of chat messages  by @cike8899 in https://github.com/infiniflow/ragflow/pull/1262
* Support displaying tables in the chunks of pdf file when using QA parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1263
* feat: add LLMSelect by @cike8899 in https://github.com/infiniflow/ragflow/pull/1270
* API: upload document api by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1264
* feat: add DynamicCategorize #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1273
* feat: build categorize list from object #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1276
* feat: change nodes to circular #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1279
* feat: add CategorizeHandle #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1282
* docs: update quickstart.mdx by @eltociear in https://github.com/infiniflow/ragflow/pull/1283
* feat: use useUpdateNodeInternals to solve the issue that the newly ad… by @cike8899 in https://github.com/infiniflow/ragflow/pull/1287
* Update README.md by @Hegenittih in https://github.com/infiniflow/ragflow/pull/1286
* Fix dependency conflict by @aopstudio in https://github.com/infiniflow/ragflow/pull/1293
* Fix occasional errors in pdf table recognition by @aopstudio in https://github.com/infiniflow/ragflow/pull/1277
* Support table for markdown file in general parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1278
* Update sdk readme by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1291
* Fix ragflow may encounter an OOM (Out Of Memory) when there are a lot of conversations by @hwzhuhao in https://github.com/infiniflow/ragflow/pull/1292
* fix mem leak for local reranker by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1295
* feat: restrict classification operators cannot be connected to Answer and other classification #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1294
* feat: delete the edge on the classification node anchor when the anch… by @cike8899 in https://github.com/infiniflow/ragflow/pull/1297
* feat: set the edge as the data source to achieve two-way linkage betw… by @cike8899 in https://github.com/infiniflow/ragflow/pull/1299
* Introduce new features by @aopstudio in https://github.com/infiniflow/ragflow/pull/1296
* feat: fix the problem of form entries being deleted when adding a new line #918 and clear the selection box to delete the corresponding edge by @cike8899 in https://github.com/infiniflow/ragflow/pull/1301
* Update README.md by @leenuhom in https://github.com/infiniflow/ragflow/pull/1285
* feat: filter out selected values ​​in other to fields from the curren… by @cike8899 in https://github.com/infiniflow/ragflow/pull/1307
* feat: limit there to be only one line between two nodes #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1310
* API: completed delete_doc api by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1290
* feat: translate fields of CategorizeForm #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1311
* feat: add MessageForm #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1312
* feat: add RelevantForm #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1313
* fix: fixed the issue where spaces could not be entered in the message… by @cike8899 in https://github.com/infiniflow/ragflow/pull/1320
* Optimize docx handle method in laws parser by @aopstudio in https://github.com/infiniflow/ragflow/pull/1302
* feat: get the operator type from id #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1323
* feat: construct the edge of the classification operator from dsl #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1329
* upgrade laws parser of docx by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1332
* feat: modify the name of an operator #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1333
* API: created list_doc by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1327
* feat: modify the style of the operator #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1335
* Doc: added doc for three doc methods by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1336
* feat: customize edge arrow #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1338
* feat: add CreateFlowModal #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1343
* Add Intel IPEX-LLM setup under deploy_local_llm by @lzivan in https://github.com/infiniflow/ragflow/pull/1269
* feat: add RelevantForm #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1344
* feat: add DynamicParameters #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1346
* add interpreter to graph by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1347
* feat: build nodes and edges from customer_service dsl #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1348
* feat: create flow from  dsl template #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1351
* API: create update_doc method by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1341
* feat: create blank canvas #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1356
* feat: pull the message list after sending the message successfully #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1364
* Integrates LLM Azure OpenAI by @yonghuili1 in https://github.com/infiniflow/ragflow/pull/1318
* fix: add icon to MiniMax  and Mistral #1353 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1367
* refine templates of graph by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1368
* feat:  call the reset api before opening the run drawer each time #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1370
* feat: build nodes and edges from chat bot dsl #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1372
* add keyword extraction in graph by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1373
* feat: add graph tab to header #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1374
* feat: replace the graph icon in the header #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1376
* API: Download doc api by @cecilia-uu in https://github.com/infiniflow/ragflow/pull/1354
* feat: add description text to operators and extract the useFetchModelId to logicHooks.ts and drag the operator to the canvas and initialize the form data #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1379
* feat: deleting a node does not require a confirmation box to pop up #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1380
* Add Graph Baidusearch and dsl_example by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1378
* feat: click on a blank area of ​​the canvas to hide the form drawer #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1384
* feat: add GraphAvatar to graph list #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1385
* feat: save graph data before opening the debug drawer #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1387
* feat: save the parameters of the generate operator to the form field … by @cike8899 in https://github.com/infiniflow/ragflow/pull/1390
* Duckduckgosearch by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1388
* feat: add duckduckgo icon #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1391
* feat: after deleting the edge, set the corresponding field in the node's form field to undefined #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1393
* add Duckduckgo pkg by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1392
* fix: use user-defined rerank model's top_k parameter when knowledge Q&A conversation by @hwzhuhao in https://github.com/infiniflow/ragflow/pull/1396
* be more specific for error message by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1409
* Add Support for AWS Bedrock by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1408
* fix duckduckgosearch.py bug by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1410
* feat: translate graph #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1411
* feat: node cannot connect to itself #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1412
* feat: add icon to title of operator form #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1413
* fix botocore  by @guoyuhao2330 in https://github.com/infiniflow/ragflow/pull/1414
* feat: when Categorize establishes a connection with other operators, it adds the target node to the to field. #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1418
* update docs for release 0.8.0 by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1419
* examples empty in categorize by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1422
* feat: highlight the nodes that the workflow passes through #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1423
* update Minimax and Azure-Openai  icon in setting page by @hangters in https://github.com/infiniflow/ragflow/pull/1420
* feat: translate graph list #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1426
* feat: translate graph of header #918 by @cike8899 in https://github.com/infiniflow/ragflow/pull/1428
* empty kb id for templates by @KevinHuSh in https://github.com/infiniflow/ragflow/pull/1429
* feat: add bedrock icon by @cike8899 in https://github.com/infiniflow/ragflow/pull/1430
* Fixed a docusaurus display issue by @writinwaters in https://github.com/infiniflow/ragflow/pull/1431

## New Contributors
* @cecilia-uu made their first contribution in https://github.com/infiniflow/ragflow/pull/1009
* @ArtificialZeng made their first contribution in https://github.com/infiniflow/ragflow/pull/997
* @chinamerp made their first contribution in https://github.com/infiniflow/ragflow/pull/1013
* @michaelfeil made their first contribution in https://github.com/infiniflow/ragflow/pull/1109
* @rickywu made their first contribution in https://github.com/infiniflow/ragflow/pull/1173
* @William957-web made their first contribution in https://github.com/infiniflow/ragflow/pull/1241
* @Hegenittih made their first contribution in https://github.com/infiniflow/ragflow/pull/1286
* @hwzhuhao made their first contribution in https://github.com/infiniflow/ragflow/pull/1292
* @leenuhom made their first contribution in https://github.com/infiniflow/ragflow/pull/1285
* @lzivan made their first contribution in https://github.com/infiniflow/ragflow/pull/1269
* @hangters made their first contribution in https://github.com/infiniflow/ragflow/pull/1420

**Full Changelog**: https://github.com/infiniflow/ragflow/compare/v0.7.0...v0.8.0