v1.74.0

pydantic/pydantic-aiv1.74.0Mar 31, 2026by DouweM

AI Summary

Introduces online evaluation infrastructure and new text content handling features, while deprecating a `Dataset` parameter and fixing tracing and embedding issues.

Key Highlights

  • Added online evaluation infrastructure for pydantic-evals.
  • Added `TextContent` for user prompts with metadata not sent to model.
  • Deprecated `Dataset` without `name` parameter.
  • Fixed `CallDeferred` and `ApprovalRequired` tracing errors.
  • Fixed batch embeddings generation with `gemini-embedding-2-preview`.

New Features

  • Online evaluation infrastructure
  • `TextContent` with metadata

Full Release Notes

<!-- Release notes generated using configuration in .github/release.yml at main -->

## What's Changed
### 🚀 Features
* feat: online evaluation infrastructure for pydantic-evals by @dmontagu in https://github.com/pydantic/pydantic-ai/pull/4782
* feat: Add `TextContent` for user prompts with `metadata` not sent to model by @thisisarko in https://github.com/pydantic/pydantic-ai/pull/4432
* Make run ID time-sortable; add agent name and run ID span attrs to all agent run child spans by @adriangb in https://github.com/pydantic/pydantic-ai/pull/4876
* Add `AbstractToolset.get_instructions` method and `include_instructions` arg to MCP Servers by @DougTrajano in https://github.com/pydantic/pydantic-ai/pull/4123
* deprecate: `Dataset` without `name` parameter by @Kludex in https://github.com/pydantic/pydantic-ai/pull/4862

### 🐛 Bug Fixes
* Fix(tracing): prevent `CallDeferred`/`ApprovalRequired` from marking tool spans as errors by @jaiwinshah3 in https://github.com/pydantic/pydantic-ai/pull/4661
* fix: `service_tier` validation failure for OpenAI-compatible providers by @majdalsado in https://github.com/pydantic/pydantic-ai/pull/4911
* Fix batch embeddings generation with `gemini-embedding-2-preview` by @DouweM in https://github.com/pydantic/pydantic-ai/pull/4913
* fix(output): respect `ToolOutput.max_retries` parameter by @JasonCZMeng in https://github.com/pydantic/pydantic-ai/pull/4687

## New Contributors
* @jaiwinshah3 made their first contribution in https://github.com/pydantic/pydantic-ai/pull/4661
* @thisisarko made their first contribution in https://github.com/pydantic/pydantic-ai/pull/4432
* @adriangb made their first contribution in https://github.com/pydantic/pydantic-ai/pull/4876
* @JasonCZMeng made their first contribution in https://github.com/pydantic/pydantic-ai/pull/4687

**Full Changelog**: https://github.com/pydantic/pydantic-ai/compare/v1.73.0...v1.74.0