v1.5.0

huggingface/smolagentsv1.5.0Jan 24, 2025by albertvillanova

AI Summary

A major feature release that adds Vision Language Model (VLM) support, Azure OpenAI integration, and significant improvements to the Python executor and security model.

Key Highlights

  • VLM support
  • Azure OpenAI support
  • Improved Python executor
  • Local interpreter security

New Features

  • Vision Language Model support
  • Azure OpenAI integration
  • Security updates for executors

Full Release Notes

## What's Changed

### New Features 🚀 
* Add VLM support by @merveenoyan in https://github.com/huggingface/smolagents/pull/220

### Fixes 🐛 
* refactor: update model type to ChatMessage in agent classes by @jank in https://github.com/huggingface/smolagents/pull/263
* Fixes AttributeError: 'CodeAgent' object has no attribute 'logger' #258 by @joaopauloschuler in https://github.com/huggingface/smolagents/pull/259
* Improve tool call argument parsing by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/267
* Remove unused and undocumented `test_mode` parameter by @Wauplin in https://github.com/huggingface/smolagents/pull/273
* Fix Bug in from_langchain in tools.py by @RolandJAAI in https://github.com/huggingface/smolagents/pull/268
* Python interpreter: improve suggestions for possible mappings by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/266
* Improve python executor's error logging by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/275
* The use of BASE_PYTHON_TOOLS enables the use of compile, exec and eval by @tandiapa in https://github.com/huggingface/smolagents/pull/274
* Try first dunder method in evaluate_augassign by @albertvillanova in https://github.com/huggingface/smolagents/pull/285
* Add cool GIF of agent run inspection using Phoenix by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/277
* Remove pickle5 package from E2BExecutor by @albertvillanova in https://github.com/huggingface/smolagents/pull/295
* Fuse stream and direct run calls by @clefourrier in https://github.com/huggingface/smolagents/pull/296
* minor fix for console in AgentLogger by @nbroad1881 in https://github.com/huggingface/smolagents/pull/303
* Add Azure OpenAI support by @vladiliescu in https://github.com/huggingface/smolagents/pull/282
* Fix arg passing to AgentExecutionError by @albertvillanova in https://github.com/huggingface/smolagents/pull/309
* refactor(models): restructure model parameter handling by @kingdomad in https://github.com/huggingface/smolagents/pull/227
* Local interpreter security: prevent builtins functions from being used if they have not been added as tools by @tandiapa in https://github.com/huggingface/smolagents/pull/299
* Support any and none tool types by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/280
* Minor fix: adding a 60 seconds timeout to the visit webpage tool by @Killian-pit in https://github.com/huggingface/smolagents/pull/308
* Fix: source code inspection in interactive shells by @antoinejeannot in https://github.com/huggingface/smolagents/pull/281
* Refactor evaluate_augassign and test all operators by @albertvillanova in https://github.com/huggingface/smolagents/pull/313
* Unset temperature in models by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/315
* Fix tool calls with LiteLLM and tool optional types by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/318
* Multiple tool example by @touseefahmed96 in https://github.com/huggingface/smolagents/pull/293
* RAG on your huggingface_doc data using chromadb and groq api by @touseefahmed96 in https://github.com/huggingface/smolagents/pull/235
* Improve static tools initialization safety by @kingdomad in https://github.com/huggingface/smolagents/pull/324
* Append unused error message to memory by @albertvillanova in https://github.com/huggingface/smolagents/pull/325

### Documentation and examples 📚 
* Fix code examples with additional_args and num_ctx examples also in zh docs by @RolandJAAI in https://github.com/huggingface/smolagents/pull/260
* Update building_good_agents.md by @derekalia in https://github.com/huggingface/smolagents/pull/283
* Update guided_tour.md by @sanjeed5 in https://github.com/huggingface/smolagents/pull/287
* Added Hindi docs for smolagents by @keetrap in https://github.com/huggingface/smolagents/pull/279
* Update README and documentation to clarify Hub integrations with Gradio Spaces by @davidberenstein1957 in https://github.com/huggingface/smolagents/pull/306
* Update README.md fix quick demo code import bug by @Deng-Xian-Sheng in https://github.com/huggingface/smolagents/pull/327
* Add args to MultiStepAgent docstring by @albertvillanova in https://github.com/huggingface/smolagents/pull/332
* Fix MultiStepAgent docstring by @albertvillanova in https://github.com/huggingface/smolagents/pull/336
* Fix docstrings of models by @albertvillanova in https://github.com/huggingface/smolagents/pull/344
* docstring args for ToolCallingAgent, CodeAgent and ManagedAgent by @touseefahmed96 in https://github.com/huggingface/smolagents/pull/335
* Corrected tool examples in ToolCallingAgent system prompts by @RolandJAAI in https://github.com/huggingface/smolagents/pull/341
* Improve inference choice examples by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/311

### Maintenance 🏗️
* Add linter rules + apply make style by @Wauplin in https://github.com/huggingface/smolagents/pull/255
* Fix CI quality issue by @albertvillanova in https://github.com/huggingface/smolagents/pull/272
* Bump version to 1.5.0.dev by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/256
* Make import time faster (optional deps + delay imports) by @Wauplin in https://github.com/huggingface/smolagents/pull/253
* Fix CI quality by @albertvillanova in https://github.com/huggingface/smolagents/pull/286
* Add huggingface-hub as required dependency by @albertvillanova in https://github.com/huggingface/smolagents/pull/288
* Make e2b optional dependency by @albertvillanova in https://github.com/huggingface/smolagents/pull/292
* Remove package json files by @albertvillanova in https://github.com/huggingface/smolagents/pull/314
* Update README instructions to run tests by @albertvillanova in https://github.com/huggingface/smolagents/pull/328
* Move torchvision to the torch extra by @nonsleepr in https://github.com/huggingface/smolagents/pull/297

## New Contributors
* @tandiapa made their first contribution in https://github.com/huggingface/smolagents/pull/274
* @keetrap made their first contribution in https://github.com/huggingface/smolagents/pull/279
* @sanjeed5 made their first contribution in https://github.com/huggingface/smolagents/pull/287
* @davidberenstein1957 made their first contribution in https://github.com/huggingface/smolagents/pull/306
* @clefourrier made their first contribution in https://github.com/huggingface/smolagents/pull/296
* @nbroad1881 made their first contribution in https://github.com/huggingface/smolagents/pull/303
* @vladiliescu made their first contribution in https://github.com/huggingface/smolagents/pull/282
* @Killian-pit made their first contribution in https://github.com/huggingface/smolagents/pull/308
* @antoinejeannot made their first contribution in https://github.com/huggingface/smolagents/pull/281
* @touseefahmed96 made their first contribution in https://github.com/huggingface/smolagents/pull/293
* @Deng-Xian-Sheng made their first contribution in https://github.com/huggingface/smolagents/pull/327
* @nonsleepr made their first contribution in https://github.com/huggingface/smolagents/pull/297
* @merveenoyan made their first contribution in https://github.com/huggingface/smolagents/pull/220

**Full Changelog**: https://github.com/huggingface/smolagents/compare/v1.4.1...v1.5.0