v0.8.0
ogx-ai/ogxv0.8.0May 1, 2026by cdoern
AI Summary
This release features the project rebranding from Llama Stack to OGX, the addition of native Anthropic Messages API support, and significant improvements to OpenAPI conformance and VertexAI integration.
Key Highlights
- Renamed project from llama-stack to ogx
- Added native Anthropic Messages API (/v1/messages)
- Improved OpenAI API conformance score to 91.2%
- Added Google Interactions API front-end
- Wired up service_tier parameter to Gemini API
Breaking Changes
- refactor!: remove deprecated Eval API and related APIs
- fix!: remove nullable annotations from Responses fields to match OpenAI spec
- chore!: remove deprecated providers
- chore!: rename project from llama-stack to ogx
New Features
- feat(messages): add native Anthropic Messages API (/v1/messages)
- feat(vertexai): wire up service_tier parameter to Gemini API
- feat(bedrock): add AWS SigV4 and STS web identity authentication
- feat(models): add 'all' and 'auto' model aliasing for Claude Code compatibility
- feat(interactions): add Gemini tool-calling and passthrough support
- feat(letsgo): add llama stack letsgo command
- feat(file_processors): add remote docling-serve provider
Full Release Notes
## What's Changed
* chore: bump fallback_version to 0.7.1.dev0 by @cdoern in https://github.com/ogx-ai/ogx/pull/5414
* ci: remove starter-gpu and dell from Docker image build matrix by @cdoern in https://github.com/ogx-ai/ogx/pull/5413
* docs: add release notes for version 0.7.0 by @Artemon-line in https://github.com/ogx-ai/ogx/pull/5408
* docs: fix documentation inconsistencies, stale references, and broken links by @leseb in https://github.com/ogx-ai/ogx/pull/5411
* fix(security): Pin tornado>=6.5.5 (GHSA-qjxf-f2mg-c6mc) by @nathan-weinberg in https://github.com/ogx-ai/ogx/pull/5425
* docs: comprehensive documentation overhaul and starter extra by @leseb in https://github.com/ogx-ai/ogx/pull/5423
* fix(vector_io): wire file_processors provider into vector store file insertion by @alinaryan in https://github.com/ogx-ai/ogx/pull/5339
* fix(vector_io): honor default_search_mode config and fix sqlite-vec BM25 score inversion by @franciscojavierarceo in https://github.com/ogx-ai/ogx/pull/5445
* docs: blog post for mlflow observability by @gyliu513 in https://github.com/ogx-ai/ogx/pull/5444
* feat(messages): add native Anthropic Messages API (/v1/messages) by @cdoern in https://github.com/ogx-ai/ogx/pull/5386
* docs: enhance landing page and docs theme by @leseb in https://github.com/ogx-ai/ogx/pull/5461
* ci: auto-bump client versions if they already exist on PyPI/npm by @cdoern in https://github.com/ogx-ai/ogx/pull/5463
* refactor!: remove deprecated Eval API and related APIs by @leseb in https://github.com/ogx-ai/ogx/pull/5290
* chore(github-deps): bump actions/github-script from 7.1.0 to 8.0.0 by @dependabot[bot] in https://github.com/ogx-ai/ogx/pull/5433
* chore(github-deps): bump github/codeql-action from 4.32.6 to 4.35.1 by @dependabot[bot] in https://github.com/ogx-ai/ogx/pull/5434
* chore(github-deps): bump actions/upload-artifact from 6.0.0 to 7.0.0 by @dependabot[bot] in https://github.com/ogx-ai/ogx/pull/5439
* chore(github-deps): bump actions/download-artifact from 8.0.0 to 8.0.1 by @dependabot[bot] in https://github.com/ogx-ai/ogx/pull/5440
* docs: split landing page endpoints into OpenAI, Anthropic, and native sections by @leseb in https://github.com/ogx-ai/ogx/pull/5465
* chore(github-deps): bump llamastack/llama-stack from 2b0ece2628d4edc18912ffb7fbbb014da08a37ad to 725a0c3fc90d4551a56f7b6cc8180075fbc0e39b by @dependabot[bot] in https://github.com/ogx-ai/ogx/pull/5437
* fix: remove orphan OpenAPI tags for deleted eval/scoring/dataset APIs by @leseb in https://github.com/ogx-ai/ogx/pull/5467
* fix: remove empty sidebar categories breaking docs build by @leseb in https://github.com/ogx-ai/ogx/pull/5470
* test: add langchain/langgraph responses integration tests by @msager27 in https://github.com/ogx-ai/ogx/pull/4887
* fix: initialize tool call arguments to "" instead of "{}" in streaming by @NickGagan in https://github.com/ogx-ai/ogx/pull/5462
* docs: update architecture diagram to reflect full API surface by @leseb in https://github.com/ogx-ai/ogx/pull/5468
* docs: add Anthropic SDK example with two-level SDK toggle on landing page by @leseb in https://github.com/ogx-ai/ogx/pull/5473
* fix(ci): map workflow package names to actual PyPI/npm package names by @cdoern in https://github.com/ogx-ai/ogx/pull/5482
* feat(ui): add missing dashboard pages and migrate chat to Responses API by @leseb in https://github.com/ogx-ai/ogx/pull/5481
* docs: comprehensive docs UX improvements by @leseb in https://github.com/ogx-ai/ogx/pull/5475
* fix: filter schemas by references in deprecated spec by @leseb in https://github.com/ogx-ai/ogx/pull/5485
* fix: improve Vector Stores OpenAI API conformance by @leseb in https://github.com/ogx-ai/ogx/pull/5398
* feat: add conversation compaction support to Responses API by @franciscojavierarceo in https://github.com/ogx-ai/ogx/pull/5327
* chore: bump fallback_version to 0.7.2.dev0 by @cdoern in https://github.com/ogx-ai/ogx/pull/5486
* fix(conformance): improve OpenAI API conformance score from 89.1% to 91.2% by @franciscojavierarceo in https://github.com/ogx-ai/ogx/pull/5490
* fix!: remove nullable annotations from Responses fields to match OpenAI spec by @franciscojavierarceo in https://github.com/ogx-ai/ogx/pull/5494
* fix: improve OpenAI API conformance by keeping type object on schemas by @leseb in https://github.com/ogx-ai/ogx/pull/5498
* fix: address unresolved review comments from PyPDF File Processor PR#4743 by @RobuRishabh in https://github.com/ogx-ai/ogx/pull/5173
* fix: improve OpenAI API conformance for Models and Files by @leseb in https://github.com/ogx-ai/ogx/pull/5499
* docs: redesign landing page and align docs with project moat by @leseb in https://github.com/ogx-ai/ogx/pull/5500
* chore: remove broken GitHub Discussions link by @nathan-weinberg in https://github.com/ogx-ai/ogx/pull/5502
* docs: add issue reporting section to docs landing page by @nathan-weinberg in https://github.com/ogx-ai/ogx/pull/5503
* docs: add Docker Hub link to documentation footer Resources section by @nathan-weinberg in https://github.com/ogx-ai/ogx/pull/5505
* docs: improve landing page mobile UX and add animations by @leseb in https://github.com/ogx-ai/ogx/pull/5506
* fix(docs): align dropdown menu background with teal color scheme by @leseb in https://github.com/ogx-ai/ogx/pull/5508
* build(vertexai): add google-genai>=1.69.0 version floor by @major in https://github.com/ogx-ai/ogx/pull/5455
* docs: Updated starter configuration by @rigazilla in https://github.com/ogx-ai/ogx/pull/5495
* feat(vertexai): wire up service_tier parameter to Gemini API by @major in https://github.com/ogx-ai/ogx/pull/5453
* fix(responses): store compacted responses for previous_response_id chaining by @franciscojavierarceo in https://github.com/ogx-ai/ogx/pull/5507
* feat: enable native messages for vllm by @cdoern in https://github.com/ogx-ai/ogx/pull/5510
* feat: add Google Interactions API front-end (v1alpha) by @leseb in https://github.com/ogx-ai/ogx/pull/5488
* fix(docs): fix architecture SVG tagline overlap and update API branding by @leseb in https://github.com/ogx-ai/ogx/pull/5516
* feat(messages): add native count_tokens support for passthrough providers by @cdoern in https://github.com/ogx-ai/ogx/pull/5511
* feat: add Google Interactions API front-end with Gemini passthrough by @leseb in https://github.com/ogx-ai/ogx/pull/5513
* feat(evals): add multitenant security and retrieval quality benchmarks by @varshaprasad96 in https://github.com/ogx-ai/ogx/pull/5515
* feat(docs): add Google Interactions API coverage analyzer by @leseb in https://github.com/ogx-ai/ogx/pull/5519
* test(interactions): add integration tests using Google GenAI SDK by @leseb in https://github.com/ogx-ai/ogx/pull/5517
* feat(docs): add Anthropic Messages API conformance tracking by @leseb in https://github.com/ogx-ai/ogx/pull/5520
* docs(messages): clarify provider description with passthrough and translation modes by @leseb in https://github.com/ogx-ai/ogx/pull/5518
* feat: add mlflow support for llamastack by @gyliu513 in https://github.com/ogx-ai/ogx/pull/5409
* ci: auto-trigger docs site deploy when docs change on main by @leseb in https://github.com/ogx-ai/ogx/pull/5526
* chore(mypy): add type hints to remaining CLI module files by @Elbehery in https://github.com/ogx-ai/ogx/pull/5399
* chore(github-deps): bump llamastack/llama-stack from 725a0c3fc90d4551a56f7b6cc8180075fbc0e39b to e92196d200bca6fc220af5996142c42528df0c56 by @dependabot[bot] in https://github.com/ogx-ai/ogx/pull/5530
* chore(github-deps): bump actions/upload-artifact from 7.0.0 to 7.0.1 by @dependabot[bot] in https://github.com/ogx-ai/ogx/pull/5532
* chore(github-deps): bump docker/login-action from 4.0.0 to 4.1.0 by @dependabot[bot] in https://github.com/ogx-ai/ogx/pull/5533
* chore(github-deps): bump docker/build-push-action from 7.0.0 to 7.1.0 by @dependabot[bot] in https://github.com/ogx-ai/ogx/pull/5534
* docs: remove leftover TODO comments from getting started notebooks by @aymenhmaidiwastaken in https://github.com/ogx-ai/ogx/pull/5514
* build: bump pypdf to ≥6.10.0 in vector_io provider deps by @Ygnas in https://github.com/ogx-ai/ogx/pull/5523
* chore(deps): bump next from 15.5.7 to 15.5.15 in /src/llama_stack_ui by @dependabot[bot] in https://github.com/ogx-ai/ogx/pull/5528
* chore(github-deps): bump pypa/gh-action-pypi-publish from 1.13.0 to 1.14.0 by @dependabot[bot] in https://github.com/ogx-ai/ogx/pull/5529
* docs: clean up footer links and rename OpenAI label by @leseb in https://github.com/ogx-ai/ogx/pull/5524
* docs: add interactive Responses API flow simulator by @leseb in https://github.com/ogx-ai/ogx/pull/5540
* fix(ci): add --group test to unused recordings check by @leseb in https://github.com/ogx-ai/ogx/pull/5541
* docs(telemetry): expand observability docs with metrics reference and setup guide by @leseb in https://github.com/ogx-ai/ogx/pull/5525
* fix(docs): add missing sidebar icons and fix 404s for API tags by @leseb in https://github.com/ogx-ai/ogx/pull/5539
* fix(docs): remove dead API links and add missing OpenAPI tags by @leseb in https://github.com/ogx-ai/ogx/pull/5543
* fix(docs): updated "Get started" commands in README by @nathan-weinberg in https://github.com/ogx-ai/ogx/pull/5547
* docs: expand integration test instructions in AGENTS.md by @franciscojavierarceo in https://github.com/ogx-ai/ogx/pull/5509
* fix(logging): log registry refresh cancel as warning by @nathan-weinberg in https://github.com/ogx-ai/ogx/pull/5548
* fix(ci): pin semgrep for UBI9 glibc 2.34 compatibility by @leseb in https://github.com/ogx-ai/ogx/pull/5552
* fix(docs): consolidate sidebar and polish navbar icons by @leseb in https://github.com/ogx-ai/ogx/pull/5553
* feat(config): allow model registry refresh interval to be configurable by @nathan-weinberg in https://github.com/ogx-ai/ogx/pull/5558
* feat(messages): implement prompt caching metrics tracking by @cdoern in https://github.com/ogx-ai/ogx/pull/5469
* docs: add Codex CLI integration documentation (alpha) by @franciscojavierarceo in https://github.com/ogx-ai/ogx/pull/5545
* fix(docs): fix Ollama commands in Quick Start Guide by @nathan-weinberg in https://github.com/ogx-ai/ogx/pull/5560
* feat(auth): add upstream header auth provider for gateway deployments by @leseb in https://github.com/ogx-ai/ogx/pull/5563
* fix(docs): incorrect model names in "Getting Started" docs by @nathan-weinberg in https://github.com/ogx-ai/ogx/pull/5562
* docs: add RAG benchmark results comparing Llama Stack vs OpenAI by @franciscojavierarceo in https://github.com/ogx-ai/ogx/pull/5559
* feat(file_processors): add remote docling-serve provider by @alinaryan in https://github.com/ogx-ai/ogx/pull/5412
* feat: remove conventional pre-commit hook by @mattf in https://github.com/ogx-ai/ogx/pull/5561
* fix(security): enforce access control on AuthorizedSqlStore update and delete by @leseb in https://github.com/ogx-ai/ogx/pull/5554
* fix(security): use Jinja2 SandboxedEnvironment to prevent SSTI in RAG query generator by @raghotham in https://github.com/ogx-ai/ogx/pull/5549
* docs(vertexai): replace incorrect model identifiers with auto-discovery note by @major in https://github.com/ogx-ai/ogx/pull/5406
* chore(mypy): enable strict type checking for core distribution/stack files by @Elbehery in https://github.com/ogx-ai/ogx/pull/5484
* feat(interactions): add Gemini native passthrough with OAuth and integration tests by @leseb in https://github.com/ogx-ai/ogx/pull/5555
* feat(containers): embed distribution configs as OCI labels by @eoinfennessy in https://github.com/ogx-ai/ogx/pull/5460
* docs: add Docker Hub container image references for distributions by @nathan-weinberg in https://github.com/ogx-ai/ogx/pull/5564
* chore!: remove deprecated providers by @mattf in https://github.com/ogx-ai/ogx/pull/5575
* feat(bedrock): add AWS SigV4 and STS web identity authentication by @skamenan7 in https://github.com/ogx-ai/ogx/pull/5388
* feat(models): add "all" and "auto" model aliasing for Claude Code compatibility by @cdoern in https://github.com/ogx-ai/ogx/pull/5471
* fix(vector_io): persist file errors and fix batch resume logic by @franciscojavierarceo in https://github.com/ogx-ai/ogx/pull/5565
* chore(github-deps): bump github/codeql-action from 4.35.1 to 4.35.2 by @dependabot[bot] in https://github.com/ogx-ai/ogx/pull/5598
* chore(github-deps): bump astral-sh/setup-uv from 8.0.0 to 8.1.0 by @dependabot[bot] in https://github.com/ogx-ai/ogx/pull/5595
* chore(github-deps): bump actions/github-script from 8.0.0 to 9.0.0 by @dependabot[bot] in https://github.com/ogx-ai/ogx/pull/5593
* chore(github-deps): bump actions/cache from 5.0.4 to 5.0.5 by @dependabot[bot] in https://github.com/ogx-ai/ogx/pull/5596
* feat(letsgo): add llama stack letsgo command by @mattf in https://github.com/ogx-ai/ogx/pull/5582
* docs: add detailed comparison report to RAG benchmarks page by @franciscojavierarceo in https://github.com/ogx-ai/ogx/pull/5568
* chore(github-deps): bump llamastack/llama-stack from e92196d200bca6fc220af5996142c42528df0c56 to 2e08be040be2cd15b528d23e39b58b286e02d379 by @dependabot[bot] in https://github.com/ogx-ai/ogx/pull/5592
* chore(ci): update vLLM image to quay.io/opendatahub/vllm-cpu by @derekhiggins in https://github.com/ogx-ai/ogx/pull/5600
* fix(docs): correct typos by @antonkesy in https://github.com/ogx-ai/ogx/pull/5599
* fix(vector_io): Require explicit embedding_dimension instead of defaulting to 768 by @elinacse in https://github.com/ogx-ai/ogx/pull/5590
* fix(vertexai): Prevent event loop mismatch with network config by lazy-initializing httpx client by @elinacse in https://github.com/ogx-ai/ogx/pull/5591
* feat: add spec-compliant streaming error event for Responses API by @gyliu513 in https://github.com/ogx-ai/ogx/pull/5224
* docs: remove Dell distribution references by @nathan-weinberg in https://github.com/ogx-ai/ogx/pull/5578
* feat(responses): add reasoning summary generation for providers that expose reasoning content by @Nehanth in https://github.com/ogx-ai/ogx/pull/5451
* test(messages): add messages-openai suite covering Anthropic↔OpenAI translation by @cdoern in https://github.com/ogx-ai/ogx/pull/5587
* chore!: rename project from llama-stack to ogx by @leseb in https://github.com/ogx-ai/ogx/pull/5613
* feat(vertexai): add integration test recordings for vertexai provider by @Artemon-line in https://github.com/ogx-ai/ogx/pull/5219
* fix(docs): regenerate openai coverage for oasdiff v1.15.0 by @leseb in https://github.com/ogx-ai/ogx/pull/5633
* chore(github-deps): bump actions/setup-node from 6.3.0 to 6.4.0 by @dependabot[bot] in https://github.com/ogx-ai/ogx/pull/5616
* docs: update security reporting to use GitHub Security Advisories by @leseb in https://github.com/ogx-ai/ogx/pull/5632
* docs(building_applications): add Claude Code integration guide by @cdoern in https://github.com/ogx-ai/ogx/pull/5571
* feat(docs): redesign blog with editorial reading experience by @leseb in https://github.com/ogx-ai/ogx/pull/5642
* docs: add blog post about Llama Stack to OGX rename and update community links by @leseb in https://github.com/ogx-ai/ogx/pull/5640
* fix(ci): revert Stainless org/project names to pre-rename values by @leseb in https://github.com/ogx-ai/ogx/pull/5634
* feat(docs): add brand page with OGX logo and replace legacy Llama Stack assets by @leseb in https://github.com/ogx-ai/ogx/pull/5645
* ci: add workflow_dispatch path to force-upload OpenAPI spec from main by @cdoern in https://github.com/ogx-ai/ogx/pull/5647
* fix(benchmarking): fix checkpoint/resume and add vLLM support by @franciscojavierarceo in https://github.com/ogx-ai/ogx/pull/5643
* fix(docs): update README badges and links to use correct ogx-ai org by @leseb in https://github.com/ogx-ai/ogx/pull/5648
* fix: update mlflow port to 5001 by @gyliu513 in https://github.com/ogx-ai/ogx/pull/5644
* fix(docs): increase OGX wordmark size in brand lockup SVGs by @leseb in https://github.com/ogx-ai/ogx/pull/5649
* fix(evals): update multitenant eval tests for OGX rename by @varshaprasad96 in https://github.com/ogx-ai/ogx/pull/5637
* feat(docs): add dynamic versions page and automated versioned docs deployment by @leseb in https://github.com/ogx-ai/ogx/pull/5652
* docs: fix landing page hero command post-rename by @Copilot in https://github.com/ogx-ai/ogx/pull/5651
* fix(docs): remove static versions.html causing infinite redirect by @leseb in https://github.com/ogx-ai/ogx/pull/5654
* fix(docs): clarify versions page labels for main-branch docs by @leseb in https://github.com/ogx-ai/ogx/pull/5656
* fix(docs): remove leseb from rename blog post authors by @leseb in https://github.com/ogx-ai/ogx/pull/5658
* fix(docs): use HTML truncate marker in blog posts by @leseb in https://github.com/ogx-ai/ogx/pull/5660
* fix(storage): validate attribute keys in JSON path construction by @franciscojavierarceo in https://github.com/ogx-ai/ogx/pull/5661
* docs: Update the OpenAI Responses API known limitations document to reflect that the parameter is now fully implemented and supported. by @hmoghani in https://github.com/ogx-ai/ogx/pull/5385
* feat(interactions): add Gemini tool-calling and passthrough support by @leseb in https://github.com/ogx-ai/ogx/pull/5572
* fix(docs): use HTML truncate marker in rename blog post by @leseb in https://github.com/ogx-ai/ogx/pull/5662
* fix(docs): replace `ogx run` with `ogx stack run` across codebase by @leseb in https://github.com/ogx-ai/ogx/pull/5665
* docs(interactions): document ADK limitation and update tool calling status by @leseb in https://github.com/ogx-ai/ogx/pull/5667
* feat(docs): add rename announcement banner to landing page and README by @leseb in https://github.com/ogx-ai/ogx/pull/5668
* fix(file_processors): reject unsupported file types in pypdf processor by @leseb in https://github.com/ogx-ai/ogx/pull/5670
* fix: update remaining `.llama` path references to `.ogx` by @eoinfennessy in https://github.com/ogx-ai/ogx/pull/5653
* docs: add new blog post about using OGX with OpenCode by @nathan-weinberg in https://github.com/ogx-ai/ogx/pull/5657
* fix: llama-stack-client to ogx-client in publishing workflow by @cdoern in https://github.com/ogx-ai/ogx/pull/5676
* feat(benchmarks): add retrieval-only eval and Gemma 31B MultiHOP results by @franciscojavierarceo in https://github.com/ogx-ai/ogx/pull/5672
* chore: update client package references from llama-stack-client to ogx-client by @cdoern in https://github.com/ogx-ai/ogx/pull/5635
## New Contributors
* @RobuRishabh made their first contribution in https://github.com/ogx-ai/ogx/pull/5173
* @aymenhmaidiwastaken made their first contribution in https://github.com/ogx-ai/ogx/pull/5514
* @antonkesy made their first contribution in https://github.com/ogx-ai/ogx/pull/5599
* @Copilot made their first contribution in https://github.com/ogx-ai/ogx/pull/5651
* @hmoghani made their first contribution in https://github.com/ogx-ai/ogx/pull/5385
**Full Changelog**: https://github.com/ogx-ai/ogx/compare/v0.7.1...v0.8.0