v1.5.0
huggingface/smolagentsv1.5.0Jan 24, 2025by albertvillanova
AI Summary
A major feature release that adds Vision Language Model (VLM) support, Azure OpenAI integration, and significant improvements to the Python executor and security model.
Key Highlights
- VLM support
- Azure OpenAI support
- Improved Python executor
- Local interpreter security
New Features
- Vision Language Model support
- Azure OpenAI integration
- Security updates for executors
Full Release Notes
## What's Changed ### New Features 🚀 * Add VLM support by @merveenoyan in https://github.com/huggingface/smolagents/pull/220 ### Fixes 🐛 * refactor: update model type to ChatMessage in agent classes by @jank in https://github.com/huggingface/smolagents/pull/263 * Fixes AttributeError: 'CodeAgent' object has no attribute 'logger' #258 by @joaopauloschuler in https://github.com/huggingface/smolagents/pull/259 * Improve tool call argument parsing by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/267 * Remove unused and undocumented `test_mode` parameter by @Wauplin in https://github.com/huggingface/smolagents/pull/273 * Fix Bug in from_langchain in tools.py by @RolandJAAI in https://github.com/huggingface/smolagents/pull/268 * Python interpreter: improve suggestions for possible mappings by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/266 * Improve python executor's error logging by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/275 * The use of BASE_PYTHON_TOOLS enables the use of compile, exec and eval by @tandiapa in https://github.com/huggingface/smolagents/pull/274 * Try first dunder method in evaluate_augassign by @albertvillanova in https://github.com/huggingface/smolagents/pull/285 * Add cool GIF of agent run inspection using Phoenix by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/277 * Remove pickle5 package from E2BExecutor by @albertvillanova in https://github.com/huggingface/smolagents/pull/295 * Fuse stream and direct run calls by @clefourrier in https://github.com/huggingface/smolagents/pull/296 * minor fix for console in AgentLogger by @nbroad1881 in https://github.com/huggingface/smolagents/pull/303 * Add Azure OpenAI support by @vladiliescu in https://github.com/huggingface/smolagents/pull/282 * Fix arg passing to AgentExecutionError by @albertvillanova in https://github.com/huggingface/smolagents/pull/309 * refactor(models): restructure model parameter handling by @kingdomad in https://github.com/huggingface/smolagents/pull/227 * Local interpreter security: prevent builtins functions from being used if they have not been added as tools by @tandiapa in https://github.com/huggingface/smolagents/pull/299 * Support any and none tool types by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/280 * Minor fix: adding a 60 seconds timeout to the visit webpage tool by @Killian-pit in https://github.com/huggingface/smolagents/pull/308 * Fix: source code inspection in interactive shells by @antoinejeannot in https://github.com/huggingface/smolagents/pull/281 * Refactor evaluate_augassign and test all operators by @albertvillanova in https://github.com/huggingface/smolagents/pull/313 * Unset temperature in models by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/315 * Fix tool calls with LiteLLM and tool optional types by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/318 * Multiple tool example by @touseefahmed96 in https://github.com/huggingface/smolagents/pull/293 * RAG on your huggingface_doc data using chromadb and groq api by @touseefahmed96 in https://github.com/huggingface/smolagents/pull/235 * Improve static tools initialization safety by @kingdomad in https://github.com/huggingface/smolagents/pull/324 * Append unused error message to memory by @albertvillanova in https://github.com/huggingface/smolagents/pull/325 ### Documentation and examples 📚 * Fix code examples with additional_args and num_ctx examples also in zh docs by @RolandJAAI in https://github.com/huggingface/smolagents/pull/260 * Update building_good_agents.md by @derekalia in https://github.com/huggingface/smolagents/pull/283 * Update guided_tour.md by @sanjeed5 in https://github.com/huggingface/smolagents/pull/287 * Added Hindi docs for smolagents by @keetrap in https://github.com/huggingface/smolagents/pull/279 * Update README and documentation to clarify Hub integrations with Gradio Spaces by @davidberenstein1957 in https://github.com/huggingface/smolagents/pull/306 * Update README.md fix quick demo code import bug by @Deng-Xian-Sheng in https://github.com/huggingface/smolagents/pull/327 * Add args to MultiStepAgent docstring by @albertvillanova in https://github.com/huggingface/smolagents/pull/332 * Fix MultiStepAgent docstring by @albertvillanova in https://github.com/huggingface/smolagents/pull/336 * Fix docstrings of models by @albertvillanova in https://github.com/huggingface/smolagents/pull/344 * docstring args for ToolCallingAgent, CodeAgent and ManagedAgent by @touseefahmed96 in https://github.com/huggingface/smolagents/pull/335 * Corrected tool examples in ToolCallingAgent system prompts by @RolandJAAI in https://github.com/huggingface/smolagents/pull/341 * Improve inference choice examples by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/311 ### Maintenance 🏗️ * Add linter rules + apply make style by @Wauplin in https://github.com/huggingface/smolagents/pull/255 * Fix CI quality issue by @albertvillanova in https://github.com/huggingface/smolagents/pull/272 * Bump version to 1.5.0.dev by @aymeric-roucher in https://github.com/huggingface/smolagents/pull/256 * Make import time faster (optional deps + delay imports) by @Wauplin in https://github.com/huggingface/smolagents/pull/253 * Fix CI quality by @albertvillanova in https://github.com/huggingface/smolagents/pull/286 * Add huggingface-hub as required dependency by @albertvillanova in https://github.com/huggingface/smolagents/pull/288 * Make e2b optional dependency by @albertvillanova in https://github.com/huggingface/smolagents/pull/292 * Remove package json files by @albertvillanova in https://github.com/huggingface/smolagents/pull/314 * Update README instructions to run tests by @albertvillanova in https://github.com/huggingface/smolagents/pull/328 * Move torchvision to the torch extra by @nonsleepr in https://github.com/huggingface/smolagents/pull/297 ## New Contributors * @tandiapa made their first contribution in https://github.com/huggingface/smolagents/pull/274 * @keetrap made their first contribution in https://github.com/huggingface/smolagents/pull/279 * @sanjeed5 made their first contribution in https://github.com/huggingface/smolagents/pull/287 * @davidberenstein1957 made their first contribution in https://github.com/huggingface/smolagents/pull/306 * @clefourrier made their first contribution in https://github.com/huggingface/smolagents/pull/296 * @nbroad1881 made their first contribution in https://github.com/huggingface/smolagents/pull/303 * @vladiliescu made their first contribution in https://github.com/huggingface/smolagents/pull/282 * @Killian-pit made their first contribution in https://github.com/huggingface/smolagents/pull/308 * @antoinejeannot made their first contribution in https://github.com/huggingface/smolagents/pull/281 * @touseefahmed96 made their first contribution in https://github.com/huggingface/smolagents/pull/293 * @Deng-Xian-Sheng made their first contribution in https://github.com/huggingface/smolagents/pull/327 * @nonsleepr made their first contribution in https://github.com/huggingface/smolagents/pull/297 * @merveenoyan made their first contribution in https://github.com/huggingface/smolagents/pull/220 **Full Changelog**: https://github.com/huggingface/smolagents/compare/v1.4.1...v1.5.0