v0.8.0

a16z-infra/llm-app-stackv0.8.0Mar 29, 2024by garylin2099

AI Summary

A major update for MetaGPT introducing the Data Interpreter (autonomous agent), RAG integration, and support for multiple new LLM providers.

Key Highlights

  • Data Interpreter: An autonomous agent capable of complex tasks like coding, analysis, and debugging
  • RAG module integration (indexing, retrieval, rank)
  • New LLM providers: Claude, QianFan, DashScope, and Yi
  • Refactored Data Interpreter

New Features

  • Data Interpreter
  • RAG module
  • New LLM providers (Claude, QianFan, DashScope, Yi)
  • Tree command
  • Repo-to-markdown feature

Full Release Notes

# Release Highlights
## Data Interpreter: Open Source and Better "Devin"
 
Data Interpreter is an autonomous agent that uses notebook, browser, shell, stable diffusion, and any custom tool to complete tasks.

Data Interpreter has achieved **state-of-the-art scores in machine learning, mathematical reasoning, and open-ended tasks**, and can analyze stocks, imitate websites, and train models.

It can debug code by itself, fix failures by itself, and solve a large number of real-life problems by itself.

We open-source our code and provide a wealth of working examples to give everyone access to state-of-the-art AI capabilities.
  
šŸ“ [Paper](https://arxiv.org/abs/2402.18679)
šŸ”— [Examples](https://docs.deepwisdom.ai/main/en/DataInterpreter/)
šŸ“– [How to use](https://docs.deepwisdom.ai/main/en/guide/use_cases/agent/interpreter/intro.html)

## RAG
RAG module integrated! Common features such as indexing, retrieval, and rank are supported. Explore this [example](https://github.com/geekan/MetaGPT/blob/main/metagpt/roles/sales.py) for a quick start.


## New LLMs
New members for the supported LLM family: This time, Claude, QianFan, DashScope, and Yi. Check out [here](https://docs.deepwisdom.ai/main/en/guide/get_started/configuration.html) for configuration.


# What's Changed
- Add ut mocker for mermaid ink by @shenchucheng in https://github.com/geekan/MetaGPT/pull/884
- Unify Interpreter naming by @garylin2099 in https://github.com/geekan/MetaGPT/pull/901
- Bump ipykernel to 6.27.1 by @revupst in https://github.com/geekan/MetaGPT/pull/938
- Update role.py : Role.set_actions() by @lixiangtiandashen in https://github.com/geekan/MetaGPT/pull/922
- Fix action.llm.model in examples/debate_simple by @BaoLiqi in https://github.com/geekan/MetaGPT/pull/930
- Feat mock openai embed for document_store and memory UTs by @better629 in https://github.com/geekan/MetaGPT/pull/939
- Feat add qianfan and dashscope by @better629 in https://github.com/geekan/MetaGPT/pull/940
- Changed requirements.txt  by @Abhishek0075 in https://github.com/geekan/MetaGPT/pull/933
- Feat simplify provider ut code by @better629 in https://github.com/geekan/MetaGPT/pull/942
- Update prompt of ocr example by @mannaandpoem in https://github.com/geekan/MetaGPT/pull/944
- Feat: Wrap Openllm, Fireworks and other services into the OpenAILLM class. by @YangQianli92 in https://github.com/geekan/MetaGPT/pull/946
- Doc: add docker installation section and fold it by @voidking in https://github.com/geekan/MetaGPT/pull/950
- Feat fix missing mistral by @better629 in https://github.com/geekan/MetaGPT/pull/953
- Feat add anthropic_api by @better629 in https://github.com/geekan/MetaGPT/pull/961
- Update code plan and change and Improve test coverage by @mannaandpoem in https://github.com/geekan/MetaGPT/pull/948
- Rename interpreter by @garylin2099 in https://github.com/geekan/MetaGPT/pull/952
- Feat: RFC197 by @iorisa in https://github.com/geekan/MetaGPT/pull/960
- Feat: +SECURITY.md by @iorisa in https://github.com/geekan/MetaGPT/pull/970
- Feat: fix JSONDecodeError error caused by incorrect indentation used … by @moyitech in https://github.com/geekan/MetaGPT/pull/963
- Feat: +rfc197 example by @iorisa in https://github.com/geekan/MetaGPT/pull/968
- Improvement made : by automating search engine configuration in example search_in_search_engine.py by @Abhishek0075 in https://github.com/geekan/MetaGPT/pull/965
- Restructure DataInterpreter by @garylin2099 in https://github.com/geekan/MetaGPT/pull/995
- Restore WalmartSalesForecast example. by @orange-crow in https://github.com/geekan/MetaGPT/pull/1007
- Feat add offcial yi-34b by @better629 in https://github.com/geekan/MetaGPT/pull/1010
- Fix bug#979 : RuntimeError: fail to reduce message length  by @azurewtl in https://github.com/geekan/MetaGPT/pull/986
- Feat:add user llm config by @liujun3660105 in https://github.com/geekan/MetaGPT/pull/997
- Feat add rag  by @better629 in https://github.com/geekan/MetaGPT/pull/974
- Fixbug: #1031 by @iorisa in https://github.com/geekan/MetaGPT/pull/1035
- Update gpt-3.5-turbo-0125 in count_message_tokens by @RuifengFu in https://github.com/geekan/MetaGPT/pull/1020
- Fix: typos by @testwill in https://github.com/geekan/MetaGPT/pull/1027
- Fix bug: #1018 by @iorisa in https://github.com/geekan/MetaGPT/pull/1037
- Fix critical bug: human prior not injected by @garylin2099 in https://github.com/geekan/MetaGPT/pull/1043
- Correct bad URL in token_counter by @jinchihe in https://github.com/geekan/MetaGPT/pull/1042
- Update readme with data interpreter usage by @garylin2099 in https://github.com/geekan/MetaGPT/pull/1047
- Fix text ut error by @shenchucheng in https://github.com/geekan/MetaGPT/pull/1049
- Update process for "Fix bug" by @mannaandpoem in https://github.com/geekan/MetaGPT/pull/1054
- Fixbug: #1016 by @iorisa in https://github.com/geekan/MetaGPT/pull/1058
- Add params to search engine by @geekan in https://github.com/geekan/MetaGPT/pull/1065
- Feat: + tree command by @iorisa in https://github.com/geekan/MetaGPT/pull/985
- Fix state value extract for issues/1067 by @better629 in https://github.com/geekan/MetaGPT/pull/1069
- Fix bug: llm.timeout not working by @iorisa in https://github.com/geekan/MetaGPT/pull/1060
- Feat: repo to markdown by @iorisa in https://github.com/geekan/MetaGPT/pull/1061
- Fdd custom tool example by @geekan in https://github.com/geekan/MetaGPT/pull/1071
- Make the rag module optional by @seehi in https://github.com/geekan/MetaGPT/pull/1070
- Fix minecraft typo by @geekan in https://github.com/geekan/MetaGPT/pull/1072
- Fixbug: #1076 by @iorisa in https://github.com/geekan/MetaGPT/pull/1080
- Replace *.deepwisdom.ai with a local server for scraping by @shenchucheng in https://github.com/geekan/MetaGPT/pull/1081
- Fixbug: #958 by @iorisa in https://github.com/geekan/MetaGPT/pull/1082
- Updata di example and change the location of the .ipynb locations by @luxiangtaoya in https://github.com/geekan/MetaGPT/pull/1090
- Fix issue 868 by @orange-crow in https://github.com/geekan/MetaGPT/pull/1098
- Fix provider failed ut by @better629 in https://github.com/geekan/MetaGPT/pull/1107
- Skip rebuild seq view by @geekan in https://github.com/geekan/MetaGPT/pull/1108
- Fixbug: #1100 by @iorisa in https://github.com/geekan/MetaGPT/pull/1105
- Changed concatenation of strings to f-strings to improve readability by @eukub in https://github.com/geekan/MetaGPT/pull/648
- Feat rag add more features by @better629 in https://github.com/geekan/MetaGPT/pull/1114
- Update paddleocr version to fix its bug by @garylin2099 in https://github.com/geekan/MetaGPT/pull/1133

# New Contributors
* @revupst made their first contribution in https://github.com/geekan/MetaGPT/pull/938
* @lixiangtiandashen made their first contribution in https://github.com/geekan/MetaGPT/pull/922
* @BaoLiqi made their first contribution in https://github.com/geekan/MetaGPT/pull/930
* @Abhishek0075 made their first contribution in https://github.com/geekan/MetaGPT/pull/933
* @YangQianli92 made their first contribution in https://github.com/geekan/MetaGPT/pull/946
* @moyitech made their first contribution in https://github.com/geekan/MetaGPT/pull/963
* @azurewtl made their first contribution in https://github.com/geekan/MetaGPT/pull/986
* @liujun3660105 made their first contribution in https://github.com/geekan/MetaGPT/pull/997
* @RuifengFu made their first contribution in https://github.com/geekan/MetaGPT/pull/1020
* @testwill made their first contribution in https://github.com/geekan/MetaGPT/pull/1027
* @jinchihe made their first contribution in https://github.com/geekan/MetaGPT/pull/1042
* @luxiangtaoya made their first contribution in https://github.com/geekan/MetaGPT/pull/1090
* @eukub made their first contribution in https://github.com/geekan/MetaGPT/pull/648

Kudos to all the contributors for making their first mark!