v0.6.0

ogx-ai/ogxv0.6.0Mar 11, 2026by cdoern

AI Summary

Focuses on API consistency, security, and expanding inference capabilities with new parameters, providers, and tooling.

Key Highlights

  • Security fix for arbitrary file write
  • OpenResponses conformance
  • New llama.cpp server provider
  • Enhanced Responses API parameters (truncation, cache keys)

Breaking Changes

  • Improve consistency of post-training API endpoints
  • Arbitrary file write via a non-default configuration
  • New URL for AWS Bedrock and model list support

New Features

  • OpenResponses conformance with integration tests
  • Llama.cpp server remote inference provider
  • OCI GenAI service integration
  • Structured error handling
  • Prompt cache key parameter support

Full Release Notes

## What's Changed
* chore: update convert_tooldef_to_openai_tool to match its usage by @mattf in https://github.com/llamastack/llama-stack/pull/4837
* feat!: improve consistency of post-training API endpoints by @eoinfennessy in https://github.com/llamastack/llama-stack/pull/4606
* fix: Arbitrary file write via a non-default configuration by @VaishnaviHire in https://github.com/llamastack/llama-stack/pull/4844
* chore: reduce uses of models.llama.datatypes by @mattf in https://github.com/llamastack/llama-stack/pull/4847
* docs: add technical release steps and improvements to RELEASE_PROCESS.md by @cdoern in https://github.com/llamastack/llama-stack/pull/4792
* chore: bump fallback version to 0.5.1 by @cdoern in https://github.com/llamastack/llama-stack/pull/4846
* fix: Exclude null 'strict' field in function tools to prevent OpenAI … by @gyliu513 in https://github.com/llamastack/llama-stack/pull/4795
* chore(test): add test to verify responses params make it to backend service by @mattf in https://github.com/llamastack/llama-stack/pull/4850
* chore: revert "fix: disable together banner (#4517)" by @mattf in https://github.com/llamastack/llama-stack/pull/4856
* fix: update together to work with latest api.together.xyz service (circa feb 2026) by @mattf in https://github.com/llamastack/llama-stack/pull/4857
* chore(github-deps): bump astral-sh/setup-uv from 7.2.0 to 7.3.0 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/4867
* chore(github-deps): bump github/codeql-action from 4.32.0 to 4.32.2 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/4861
* chore(github-deps): bump actions/cache from 5.0.2 to 5.0.3 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/4859
* chore(github-deps): bump llamastack/llama-stack from 76bcb6657de312160c726fbe069275cd5537b702 to c518b35a65f8bd1370c938c688dfb2e2a00cceab by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/4858
* fix(ci): ensure oasdiff is available for openai-coverage hook by @EleanorWho in https://github.com/llamastack/llama-stack/pull/4835
* fix: Deprecate items when create conversation by @gyliu513 in https://github.com/llamastack/llama-stack/pull/4765
* chore: refactor chunking to use configurable tiktoken encoding and document tokenizer limits by @mattf in https://github.com/llamastack/llama-stack/pull/4870
* chore: prune unused parts of models packages (checkpoint, tokenizer, prompt templates, datatypes) by @mattf in https://github.com/llamastack/llama-stack/pull/4871
* chore: prune unused utils from utils.memory.vector_store by @mattf in https://github.com/llamastack/llama-stack/pull/4873
* fix: Escape special characters in auto-generated provider documentati… by @gyliu513 in https://github.com/llamastack/llama-stack/pull/4822
* chore(docs): Use starter for opentelemetry integration test by @gyliu513 in https://github.com/llamastack/llama-stack/pull/4875
* fix: kvstore should call shutdown but not close by @gyliu513 in https://github.com/llamastack/llama-stack/pull/4872
* fix: uvicorn log ambiguity by @cdoern in https://github.com/llamastack/llama-stack/pull/4522
* chore(github-deps): bump actions/checkout from 4.2.2 to 6.0.2 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/4865
* chore: cleanup mypy excludes by @mattf in https://github.com/llamastack/llama-stack/pull/4876
* feat: add integration test for max_output_tokens by @gyliu513 in https://github.com/llamastack/llama-stack/pull/4825
* chore(test): add test to verify responses params make it to backend s… by @gyliu513 in https://github.com/llamastack/llama-stack/pull/4852
* ci: add Docker image publishing to release workflow by @cdoern in https://github.com/llamastack/llama-stack/pull/4882
* feat: add ProcessFileRequest model to file_processors API by @alinaryan in https://github.com/llamastack/llama-stack/pull/4885
* docs: update responses api known limitations doc by @jaideepr97 in https://github.com/llamastack/llama-stack/pull/4845
* fix(vector_io): align Protocol signatures with request models by @skamenan7 in https://github.com/llamastack/llama-stack/pull/4747
* fix: add _ExceptionTranslatingRoute to prevent keep-alive breakage on Linux by @iamemilio in https://github.com/llamastack/llama-stack/pull/4886
* docs: add release notes for version 0.5 by @rhuss in https://github.com/llamastack/llama-stack/pull/4855
* fix(ci): disable uv cache cleanup when UV_NO_CACHE is set by @cdoern in https://github.com/llamastack/llama-stack/pull/4889
* feat: Add truncation parameter support by @gyliu513 in https://github.com/llamastack/llama-stack/pull/4813
* chore(ci): bump pinned action commit hashes in integration-tests.yml by @cdoern in https://github.com/llamastack/llama-stack/pull/4895
* docs: Add README for running observability test by @gyliu513 in https://github.com/llamastack/llama-stack/pull/4884
* fix: update rerank routing to match params by @mattf in https://github.com/llamastack/llama-stack/pull/4900
* feat: Add prompt_cache_key parameter support by @gyliu513 in https://github.com/llamastack/llama-stack/pull/4775
* chore: add rerank support to recorder by @mattf in https://github.com/llamastack/llama-stack/pull/4903
* feat: add rerank support to vllm inference provider by @mattf in https://github.com/llamastack/llama-stack/pull/4902
* fix(inference): use flat response message model for chat/completions by @cdoern in https://github.com/llamastack/llama-stack/pull/4891
* feat: add llama cpp server remote inference provider by @Bobbins228 in https://github.com/llamastack/llama-stack/pull/4382
* fix: Remove pillow as direct dependency by @VaishnaviHire in https://github.com/llamastack/llama-stack/pull/4901
* fix: pre-commit run -a by @mattf in https://github.com/llamastack/llama-stack/pull/4907
* fix(ci): Removed kotlin from preview builds by @gyliu513 in https://github.com/llamastack/llama-stack/pull/4910
* feat: Add service_tier parameter support by @gyliu513 in https://github.com/llamastack/llama-stack/pull/4816
* chore(github-deps): bump github/codeql-action from 4.32.2 to 4.32.3 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/4918
* chore(github-deps): bump docker/login-action from 3.4.0 to 3.7.0 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/4916
* chore(github-deps): bump llamastack/llama-stack from c7cdb40d34d057166cd5d883a070a72ef4490f4b to 4c1b03b55000cc5dca52b0458543815f3837b5b7 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/4915
* chore(github-deps): bump stainless-api/upload-openapi-spec-action from 1.10.0 to 1.11.6 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/4913
* chore(github-deps): bump docker/build-push-action from 6.15.0 to 6.19.2 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/4912
* fix(vertexai): raise descriptive error on auth failure instead of silent empty string by @major in https://github.com/llamastack/llama-stack/pull/4909
* fix: resolve StorageConfig default env vars at construction time by @major in https://github.com/llamastack/llama-stack/pull/4897
* feat: Add incomplete_details response property by @gyliu513 in https://github.com/llamastack/llama-stack/pull/4812
* feat(client-sdks): add OpenAPI Generator tooling by @aegeiger in https://github.com/llamastack/llama-stack/pull/4874
* fix(vector_io): eliminate duplicate call for vector store registration by @r3v5 in https://github.com/llamastack/llama-stack/pull/4925
* test(vertexai): add unit tests for VertexAI inference adapter by @major in https://github.com/llamastack/llama-stack/pull/4927
* feat: introduce new how-to blog by @cdoern in https://github.com/llamastack/llama-stack/pull/4794
* chore: remove reference to non-existent WeaviateRequestProviderData by @mattf in https://github.com/llamastack/llama-stack/pull/4937
* feat: standardized error types with HTTP status codes by @iamemilio in https://github.com/llamastack/llama-stack/pull/4878
* feat: add opentelemetry-distro to core dependencies by @Artemon-line in https://github.com/llamastack/llama-stack/pull/4935
* feat(ci): Add nightly job for doc build by @gyliu513 in https://github.com/llamastack/llama-stack/pull/4911
* fix: Ensure user isolation for stored conversations and responses  by @jaideepr97 in https://github.com/llamastack/llama-stack/pull/4834
* fix: align chat completion usage schema with OpenAI spec by @cdoern in https://github.com/llamastack/llama-stack/pull/4930
* fix: allow conversation item type to be omitted by @mattf in https://github.com/llamastack/llama-stack/pull/4948
* feat: Enable inline PyPDF file_processors provider by @alinaryan in https://github.com/llamastack/llama-stack/pull/4743
* feat: add support for /responses background parameter by @cdoern in https://github.com/llamastack/llama-stack/pull/4824
* feat(vector_io): Implement Contextual Retrieval for improved RAG search quality by @r-bit-rry in https://github.com/llamastack/llama-stack/pull/4750
* chore: use SecretStr for x-llamastack-provider-data keys by @mattf in https://github.com/llamastack/llama-stack/pull/4939
* chore: remove unused vector store utils by @mattf in https://github.com/llamastack/llama-stack/pull/4961
* feat: auto-identify embedding models for vllm by @mattf in https://github.com/llamastack/llama-stack/pull/4975
* chore(github-deps): bump llamastack/llama-stack from 4c1b03b55000cc5dca52b0458543815f3837b5b7 to 7d9786b0a0017fa44262c40b6aa42c6a28539c26 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/4971
* chore(github-deps): bump actions/checkout from 6.0.1 to 6.0.2 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/4969
* chore(github-deps): bump actions/cache from 4.2.0 to 5.0.3 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/4963
* chore(github-deps): bump github/codeql-action from 4.32.3 to 4.32.4 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/4964
* chore(github-deps): bump actions/stale from 10.1.1 to 10.2.0 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/4966
* fix: fix connector_id resolution in agent provider by @jaideepr97 in https://github.com/llamastack/llama-stack/pull/4853
* build: bump fallback_version to 0.5.2.dev0 post 0.5.1 release by @cdoern in https://github.com/llamastack/llama-stack/pull/4959
* fix: pass request objects to Files API in Responses content conversion by @mattf in https://github.com/llamastack/llama-stack/pull/4977
* fix: test_prepend_prompt_with_mixed_variables mock by @mattf in https://github.com/llamastack/llama-stack/pull/4979
* feat: enforce max upload size for Files and File Processors APIs by @alinaryan in https://github.com/llamastack/llama-stack/pull/4956
* feat: add OpenResponses conformance CI job with replay recordings by @cdoern in https://github.com/llamastack/llama-stack/pull/4981
* feat(client-sdks): add hierarchical SDK build pipeline by @aegeiger in https://github.com/llamastack/llama-stack/pull/4932
* feat: add top_p parameter support to responses API by @EleanorWho in https://github.com/llamastack/llama-stack/pull/4820
* fix(docs): Updated llamastack pod metadata by @gyliu513 in https://github.com/llamastack/llama-stack/pull/4983
* chore: move parse_data_url to common package by @mattf in https://github.com/llamastack/llama-stack/pull/4982
* feat: record and replay provider exceptions in inferencing integration tests by @iamemilio in https://github.com/llamastack/llama-stack/pull/4880
* feat: Use Structured Errors in Responses and Conversations API by @iamemilio in https://github.com/llamastack/llama-stack/pull/4879
* fix: strip inline:: prefix from model in vector io tests by @mattf in https://github.com/llamastack/llama-stack/pull/4993
* refactor: consolidate dynamic provider config parsing by @mattf in https://github.com/llamastack/llama-stack/pull/4985
* feat: auto-merge PRs on stable release branches via Mergify + CI gate by @leseb in https://github.com/llamastack/llama-stack/pull/4992
* refactor: use OpenAIErrorResponse model for consistent error responses by @iamemilio in https://github.com/llamastack/llama-stack/pull/4883
* fix: populate required OpenResponses fields with non-null defaults by @cdoern in https://github.com/llamastack/llama-stack/pull/4994
* feat: auto-merge dependabot github-deps PRs via Mergify by @leseb in https://github.com/llamastack/llama-stack/pull/4995
* feat: Add top_logprobs parameter support by @gyliu513 in https://github.com/llamastack/llama-stack/pull/4814
* feat: add support for 'frequency_penalty' param to Responses API by @nathan-weinberg in https://github.com/llamastack/llama-stack/pull/4823
* feat: add support for 'presence_penalty' param to Responses API by @nathan-weinberg in https://github.com/llamastack/llama-stack/pull/4830
* fix: correct PYPDF adapter method signature to match FileProcessors protocol by @alinaryan in https://github.com/llamastack/llama-stack/pull/4998
* fix(responses): achieve full OpenResponses conformance by @cdoern in https://github.com/llamastack/llama-stack/pull/4999
* fix(docs): Updated health check endpoint by @gyliu513 in https://github.com/llamastack/llama-stack/pull/5000
* test: Add responses structured output integration tests by @msager27 in https://github.com/llamastack/llama-stack/pull/4940
* feat: structured error handling in Responses API streaming by @iamemilio in https://github.com/llamastack/llama-stack/pull/4942
* feat(client-sdks): add LlamaStackClient, httpx, and streaming by @aegeiger in https://github.com/llamastack/llama-stack/pull/5001
* feat: accept list content blocks in Responses API function_call_output by @mattf in https://github.com/llamastack/llama-stack/pull/4978
* refactor(PGVector): wrap gin index creation into a separate function by @r3v5 in https://github.com/llamastack/llama-stack/pull/4980
* chore: consolidate backend-forwarded param tests into unified parametrized test by @mattf in https://github.com/llamastack/llama-stack/pull/5003
* test: add integration tests for Responses and Conversations API errors by @iamemilio in https://github.com/llamastack/llama-stack/pull/4881
* feat: allow stream usage from ollama when telemetry enabled by @mattf in https://github.com/llamastack/llama-stack/pull/5011
* feat: allow stream usage from vllm when telemetry enabled by @mattf in https://github.com/llamastack/llama-stack/pull/5010
* fix(registry): loosen register() idempotent checks for server restarts by @max-svistunov in https://github.com/llamastack/llama-stack/pull/4976
* feat: add integration test for prompt_cache_key with openai client by @gyliu513 in https://github.com/llamastack/llama-stack/pull/5016
* chore(github-deps): bump actions/github-script from 7.0.1 to 8.0.0 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/5025
* chore(github-deps): bump astral-sh/setup-uv from 7.3.0 to 7.3.1 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/5027
* chore(github-deps): bump actions/setup-java from 4.5.0 to 5.2.0 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/5019
* ci: add merge_group trigger to all PR-gating workflows by @cdoern in https://github.com/llamastack/llama-stack/pull/5017
* feat(ci): automate post-release and pre-release version management by @cdoern in https://github.com/llamastack/llama-stack/pull/4938
* test: Add prompt template test cases to the responses integraton test… by @msager27 in https://github.com/llamastack/llama-stack/pull/4950
* fix(stainless): handle [DONE] SSE terminator in streaming responses by @dtmeadows in https://github.com/llamastack/llama-stack/pull/5012
* fix(security): pin google-cloud-aiplatform to >=1.131.0 by @derekhiggins in https://github.com/llamastack/llama-stack/pull/5037
* feat(inference): bidirectional reasoning token passthrough for chat completions by @cdoern in https://github.com/llamastack/llama-stack/pull/5038
* chore: remove unreachable tool_choice check in vllm adapter by @mattf in https://github.com/llamastack/llama-stack/pull/5009
* feat(api): support extra_body pass-through in responses API by @codefromthecrypt in https://github.com/llamastack/llama-stack/pull/4893
* docs: additional references to Docker Hub by @nathan-weinberg in https://github.com/llamastack/llama-stack/pull/5044
* fix: add missing shutdown method to PyPDF file processor adapter by @alinaryan in https://github.com/llamastack/llama-stack/pull/5047
* fix(llama-guard): less strict parsing of safety categories by @asimurka in https://github.com/llamastack/llama-stack/pull/5045
* fix: OCI26ai sql query patches by @rhdedgar in https://github.com/llamastack/llama-stack/pull/5046
* fix(conversations): validate conv_ prefix consistently on all endpoints by @iamemilio in https://github.com/llamastack/llama-stack/pull/5058
* fix(conversations): add ExceptionTranslatingRoute to conversations router by @iamemilio in https://github.com/llamastack/llama-stack/pull/5057
* feat: allow model registration without provider API keys by @NickGagan in https://github.com/llamastack/llama-stack/pull/5014
* chore: Rename test_openai_response.py to test_openai_responses.py by @gyliu513 in https://github.com/llamastack/llama-stack/pull/5061
* fix: (pypdf) Possible infinite loop when loading circular /Prev entries in cross-reference streams by @eoinfennessy in https://github.com/llamastack/llama-stack/pull/5063
* chore: bump fallback_version to 0.5.3.dev0 after 0.5.2 release by @cdoern in https://github.com/llamastack/llama-stack/pull/5065
* feat: passthrough safety provider for forwarding to downstream /v1/moderations by @skamenan7 in https://github.com/llamastack/llama-stack/pull/5004
* feat: add conditional authentication provider configuration by @derekhiggins in https://github.com/llamastack/llama-stack/pull/5002
* fix: NLTK Zip Slip Vulnerability by @eoinfennessy in https://github.com/llamastack/llama-stack/pull/5062
* fix: use semantic JSON comparison for MCP approval argument matching by @iamemilio in https://github.com/llamastack/llama-stack/pull/5080
* feat(vertexai): rewrite provider on google-genai with dynamic model listing by @major in https://github.com/llamastack/llama-stack/pull/4951
* ci: temporarily disable CodeQL workflow on pull requests by @leseb in https://github.com/llamastack/llama-stack/pull/5079
* chore: fix post-release workflow and remove broken docker image by @cdoern in https://github.com/llamastack/llama-stack/pull/5064
* fix: Revert "temporarily disable CodeQL workflow on pull requests" by @cdoern in https://github.com/llamastack/llama-stack/pull/5085
* fix: use canonical config loading in backward compat test by @leseb in https://github.com/llamastack/llama-stack/pull/5081
* fix!: add content capture via otel by @gyliu513 in https://github.com/llamastack/llama-stack/pull/5060
* feat!: add integration test for safety_identifier with openai client by @gyliu513 in https://github.com/llamastack/llama-stack/pull/5018
* fix: poll test PyPI before building Docker images to avoid race condition by @cdoern in https://github.com/llamastack/llama-stack/pull/5090
* feat: add regex pattern support to access_policy and route_policy by @derekhiggins in https://github.com/llamastack/llama-stack/pull/4991
* feat: add integration test for truncation with openai client by @gyliu513 in https://github.com/llamastack/llama-stack/pull/5084
* feat: integration test for top_p with openai client by @gyliu513 in https://github.com/llamastack/llama-stack/pull/5083
* chore(github-deps): bump oven-sh/setup-bun from 2.1.2 to 2.1.3 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/5068
* chore(github-deps): bump github/codeql-action from 4.32.4 to 4.32.6 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/5070
* chore(github-deps): bump llamastack/llama-stack from 7d9786b0a0017fa44262c40b6aa42c6a28539c26 to 6c700dac1e9798297d056b731f257a2736189aeb by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/5075
* chore(github-deps): bump actions/setup-node from 6.2.0 to 6.3.0 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/5067
* chore(github-deps): bump actions/download-artifact from 7.0.0 to 8.0.0 by @dependabot[bot] in https://github.com/llamastack/llama-stack/pull/5020
* fix: process hang on exit with aiosqlite >= 0.22 by @shanemcd in https://github.com/llamastack/llama-stack/pull/4589
* fix: treat hallucinated tool names as client-side function calls by @mattf in https://github.com/llamastack/llama-stack/pull/5043
* test: add streaming web_search test cases to responses integration test suite by @msager27 in https://github.com/llamastack/llama-stack/pull/4960
* feat(PGVector): implement ef_search parameter for HNSW vector index in PGVector by @r3v5 in https://github.com/llamastack/llama-stack/pull/4933
* feat: improve inference performance via cached ssl context by @mattf in https://github.com/llamastack/llama-stack/pull/4486
* ci: update Mergify config with auto-update, auto-approve, and fix merge method by @leseb in https://github.com/llamastack/llama-stack/pull/5091
* feat: Add additional Tool runtime metrics by @gyliu513 in https://github.com/llamastack/llama-stack/pull/4904
* feat: Add integration test for parallel_tool_calls with openai client by @gyliu513 in https://github.com/llamastack/llama-stack/pull/5093
* feat: Enable Filters in OpenAI Search API by @franciscojavierarceo in https://github.com/llamastack/llama-stack/pull/4471
* chore: Move background integration test to test_open_responses.py by @gyliu513 in https://github.com/llamastack/llama-stack/pull/5094
* refactor(vertexai): extract network helper functions into utils module by @major in https://github.com/llamastack/llama-stack/pull/5095
* feat!: new URL for AWS Bedrock and model list support by @are-ces in https://github.com/llamastack/llama-stack/pull/4946

## New Contributors
* @major made their first contribution in https://github.com/llamastack/llama-stack/pull/4909
* @aegeiger made their first contribution in https://github.com/llamastack/llama-stack/pull/4874
* @Artemon-line made their first contribution in https://github.com/llamastack/llama-stack/pull/4935
* @max-svistunov made their first contribution in https://github.com/llamastack/llama-stack/pull/4976
* @dtmeadows made their first contribution in https://github.com/llamastack/llama-stack/pull/5012
* @NickGagan made their first contribution in https://github.com/llamastack/llama-stack/pull/5014
* @shanemcd made their first contribution in https://github.com/llamastack/llama-stack/pull/4589

**Full Changelog**: https://github.com/llamastack/llama-stack/compare/v0.5.2...v0.6.0