v0.40.0

Mesh-LLM/mesh-llmv0.40.0Mar 24, 2026by michaelneale

AI Summary

Introduces the Blackboard MCP server and changes default reasoning behavior for performance.

Key Highlights

  • Thinking disabled by default (`--reasoning-budget 0`) for 2x speed
  • Blackboard MCP server exposes tools (`blackboard_post`, `blackboard_search`)
  • Web UI improvements with automatic retry on 500/502/503 errors
  • Community banner for hosted instances

New Features

  • Thinking disabled by default for agentic workloads
  • Blackboard MCP server integration
  • Web UI automatic retry logic
  • Community banner for hosted meshes
  • Reasoning compatibility test script

Full Release Notes

## What's new

- **Thinking disabled by default** — `--reasoning-budget 0` on all llama-servers. Same answer quality, 2x faster for agentic workloads. API users can still opt in per-request with `chat_template_kwargs: {"enable_thinking": true}`.
- **Blackboard MCP server** — `mesh-llm blackboard --mcp` exposes blackboard as MCP tools (`blackboard_post`, `blackboard_search`, `blackboard_feed`) for agent collaboration across the mesh.
- **Web UI improvements** — no hidden thinking in chat responses, automatic retry with backoff on 500/502/503 errors.
- **Fly community banner** — hosted instances (mesh-llm.com, anarchai.org) show a 'community demo' notice with live busy indicator when the mesh is under load.
- **Reasoning compatibility test** — `tests/test_reasoning_compat.sh` validates the thinking on/off API contract.

### Install (macOS Apple Silicon)

```bash
curl -fsSL https://github.com/michaelneale/decentralized-inference/releases/latest/download/mesh-llm-aarch64-apple-darwin.tar.gz | tar xz && sudo mv mesh-bundle/* /usr/local/bin/
```