v0.8.0
paulpierre/markdown-crawlerv0.8.0Mar 29, 2024by garylin2099
AI Summary
Introduces Data Interpreter, an autonomous agent capable of using various tools, integrates the RAG module, and adds support for new LLMs including Claude, QianFan, DashScope, and Yi.
Key Highlights
- Data Interpreter (autonomous agent)
- RAG integration
- New LLM support (Claude, QianFan, DashScope, Yi)
Breaking Changes
- Restructure DataInterpreter
- Rename interpreter
New Features
- Data Interpreter
- RAG module
- New LLMs (Claude, QianFan, DashScope, Yi)
- Repo-to-markdown conversion
- Tree command
- Custom tool examples
Full Release Notes
# Release Highlights ## Data Interpreter: Open Source and Better "Devin" Data Interpreter is an autonomous agent that uses notebook, browser, shell, stable diffusion, and any custom tool to complete tasks. Data Interpreter has achieved **state-of-the-art scores in machine learning, mathematical reasoning, and open-ended tasks**, and can analyze stocks, imitate websites, and train models. It can debug code by itself, fix failures by itself, and solve a large number of real-life problems by itself. We open-source our code and provide a wealth of working examples to give everyone access to state-of-the-art AI capabilities. π [Paper](https://arxiv.org/abs/2402.18679) π [Examples](https://docs.deepwisdom.ai/main/en/DataInterpreter/) π [How to use](https://docs.deepwisdom.ai/main/en/guide/use_cases/agent/interpreter/intro.html) ## RAG RAG module integrated! Common features such as indexing, retrieval, and rank are supported. Explore this [example](https://github.com/geekan/MetaGPT/blob/main/metagpt/roles/sales.py) for a quick start. ## New LLMs New members for the supported LLM family: This time, Claude, QianFan, DashScope, and Yi. Check out [here](https://docs.deepwisdom.ai/main/en/guide/get_started/configuration.html) for configuration. # What's Changed - Add ut mocker for mermaid ink by @shenchucheng in https://github.com/geekan/MetaGPT/pull/884 - Unify Interpreter naming by @garylin2099 in https://github.com/geekan/MetaGPT/pull/901 - Bump ipykernel to 6.27.1 by @revupst in https://github.com/geekan/MetaGPT/pull/938 - Update role.py : Role.set_actions() by @lixiangtiandashen in https://github.com/geekan/MetaGPT/pull/922 - Fix action.llm.model in examples/debate_simple by @BaoLiqi in https://github.com/geekan/MetaGPT/pull/930 - Feat mock openai embed for document_store and memory UTs by @better629 in https://github.com/geekan/MetaGPT/pull/939 - Feat add qianfan and dashscope by @better629 in https://github.com/geekan/MetaGPT/pull/940 - Changed requirements.txt by @Abhishek0075 in https://github.com/geekan/MetaGPT/pull/933 - Feat simplify provider ut code by @better629 in https://github.com/geekan/MetaGPT/pull/942 - Update prompt of ocr example by @mannaandpoem in https://github.com/geekan/MetaGPT/pull/944 - Feat: Wrap Openllm, Fireworks and other services into the OpenAILLM class. by @YangQianli92 in https://github.com/geekan/MetaGPT/pull/946 - Doc: add docker installation section and fold it by @voidking in https://github.com/geekan/MetaGPT/pull/950 - Feat fix missing mistral by @better629 in https://github.com/geekan/MetaGPT/pull/953 - Feat add anthropic_api by @better629 in https://github.com/geekan/MetaGPT/pull/961 - Update code plan and change and Improve test coverage by @mannaandpoem in https://github.com/geekan/MetaGPT/pull/948 - Rename interpreter by @garylin2099 in https://github.com/geekan/MetaGPT/pull/952 - Feat: RFC197 by @iorisa in https://github.com/geekan/MetaGPT/pull/960 - Feat: +SECURITY.md by @iorisa in https://github.com/geekan/MetaGPT/pull/970 - Feat: fix JSONDecodeError error caused by incorrect indentation used β¦ by @moyitech in https://github.com/geekan/MetaGPT/pull/963 - Feat: +rfc197 example by @iorisa in https://github.com/geekan/MetaGPT/pull/968 - Improvement made : by automating search engine configuration in example search_in_search_engine.py by @Abhishek0075 in https://github.com/geekan/MetaGPT/pull/965 - Restructure DataInterpreter by @garylin2099 in https://github.com/geekan/MetaGPT/pull/995 - Restore WalmartSalesForecast example. by @orange-crow in https://github.com/geekan/MetaGPT/pull/1007 - Feat add offcial yi-34b by @better629 in https://github.com/geekan/MetaGPT/pull/1010 - Fix bug#979 : RuntimeError: fail to reduce message length by @azurewtl in https://github.com/geekan/MetaGPT/pull/986 - Feat:add user llm config by @liujun3660105 in https://github.com/geekan/MetaGPT/pull/997 - Feat add rag by @better629 in https://github.com/geekan/MetaGPT/pull/974 - Fixbug: #1031 by @iorisa in https://github.com/geekan/MetaGPT/pull/1035 - Update gpt-3.5-turbo-0125 in count_message_tokens by @RuifengFu in https://github.com/geekan/MetaGPT/pull/1020 - Fix: typos by @testwill in https://github.com/geekan/MetaGPT/pull/1027 - Fix bug: #1018 by @iorisa in https://github.com/geekan/MetaGPT/pull/1037 - Fix critical bug: human prior not injected by @garylin2099 in https://github.com/geekan/MetaGPT/pull/1043 - Correct bad URL in token_counter by @jinchihe in https://github.com/geekan/MetaGPT/pull/1042 - Update readme with data interpreter usage by @garylin2099 in https://github.com/geekan/MetaGPT/pull/1047 - Fix text ut error by @shenchucheng in https://github.com/geekan/MetaGPT/pull/1049 - Update process for "Fix bug" by @mannaandpoem in https://github.com/geekan/MetaGPT/pull/1054 - Fixbug: #1016 by @iorisa in https://github.com/geekan/MetaGPT/pull/1058 - Add params to search engine by @geekan in https://github.com/geekan/MetaGPT/pull/1065 - Feat: + tree command by @iorisa in https://github.com/geekan/MetaGPT/pull/985 - Fix state value extract for issues/1067 by @better629 in https://github.com/geekan/MetaGPT/pull/1069 - Fix bug: llm.timeout not working by @iorisa in https://github.com/geekan/MetaGPT/pull/1060 - Feat: repo to markdown by @iorisa in https://github.com/geekan/MetaGPT/pull/1061 - Fdd custom tool example by @geekan in https://github.com/geekan/MetaGPT/pull/1071 - Make the rag module optional by @seehi in https://github.com/geekan/MetaGPT/pull/1070 - Fix minecraft typo by @geekan in https://github.com/geekan/MetaGPT/pull/1072 - Fixbug: #1076 by @iorisa in https://github.com/geekan/MetaGPT/pull/1080 - Replace *.deepwisdom.ai with a local server for scraping by @shenchucheng in https://github.com/geekan/MetaGPT/pull/1081 - Fixbug: #958 by @iorisa in https://github.com/geekan/MetaGPT/pull/1082 - Updata di example and change the location of the .ipynb locations by @luxiangtaoya in https://github.com/geekan/MetaGPT/pull/1090 - Fix issue 868 by @orange-crow in https://github.com/geekan/MetaGPT/pull/1098 - Fix provider failed ut by @better629 in https://github.com/geekan/MetaGPT/pull/1107 - Skip rebuild seq view by @geekan in https://github.com/geekan/MetaGPT/pull/1108 - Fixbug: #1100 by @iorisa in https://github.com/geekan/MetaGPT/pull/1105 - Changed concatenation of strings to f-strings to improve readability by @eukub in https://github.com/geekan/MetaGPT/pull/648 - Feat rag add more features by @better629 in https://github.com/geekan/MetaGPT/pull/1114 - Update paddleocr version to fix its bug by @garylin2099 in https://github.com/geekan/MetaGPT/pull/1133 # New Contributors * @revupst made their first contribution in https://github.com/geekan/MetaGPT/pull/938 * @lixiangtiandashen made their first contribution in https://github.com/geekan/MetaGPT/pull/922 * @BaoLiqi made their first contribution in https://github.com/geekan/MetaGPT/pull/930 * @Abhishek0075 made their first contribution in https://github.com/geekan/MetaGPT/pull/933 * @YangQianli92 made their first contribution in https://github.com/geekan/MetaGPT/pull/946 * @moyitech made their first contribution in https://github.com/geekan/MetaGPT/pull/963 * @azurewtl made their first contribution in https://github.com/geekan/MetaGPT/pull/986 * @liujun3660105 made their first contribution in https://github.com/geekan/MetaGPT/pull/997 * @RuifengFu made their first contribution in https://github.com/geekan/MetaGPT/pull/1020 * @testwill made their first contribution in https://github.com/geekan/MetaGPT/pull/1027 * @jinchihe made their first contribution in https://github.com/geekan/MetaGPT/pull/1042 * @luxiangtaoya made their first contribution in https://github.com/geekan/MetaGPT/pull/1090 * @eukub made their first contribution in https://github.com/geekan/MetaGPT/pull/648 Kudos to all the contributors for making their first mark!