Pick your deployment profile.
Solo is the recommended default. All modes share the same vault and MCP stub — they differ in services started, LLM provider, and access pattern.
Two archives — download only what your deployment needs. Linux x86_64. SHA256 and SLSA provenance attestation per archive. Pre-built archives track the latest published tag (v2.5.0).
Contains gradatum-server, gradatum-worker, gradatum-admin.
Core vault store, job queue, admin CLI. Serves MCP natively on /mcp.
gradatum-server-v2.5.0-x86_64-unknown-linux-gnu.tar.gz
Contains gradatum-gateway and gradatum-engine.
Router, circuit-breaker, llama-server supervisor. Required for local inference.
gradatum-llm-v2.5.0-x86_64-unknown-linux-gnu.tar.gz # verify SHA256 (example — server archive)
sha256sum -c SHA256SUMS --ignore-missing
# verify SLSA build provenance (GitHub native)
gh attestation verify \
gradatum-server-v2.5.0-x86_64-unknown-linux-gnu.tar.gz \
--repo gradatum/gradatum
Source is open on GitHub (Apache-2.0). 28 of the 34 workspace crates
are published on crates.io at v2.5.0 — SemVer since v1.0.0, with documented exceptions. The previous minor release renamed a doc-hidden Rust item (ConfigError::PrivacyMaskUnavailable → ConfigError::PrivacyMaskWithoutActivation, in a #[doc(hidden)] module of gradatum-server) — invisible to the public-api surface gate, but still a break for a consumer matching the old variant directly; see the CHANGELOG. v2.5.0 behaviour change: a configured-but-unusable ACL preset now refuses to start the server, instead of silently falling back to deny-all (see the UPGRADING guide). The 2.3.1 → 2.4.0 line made ACL read patterns deny-by-default — see the 2.3.1 → 2.4.0 upgrade guide. Project-map registry operators had breaking changes in v2.2.0 — see the 2.1.0 → 2.2.0 upgrade guide. Moving from 2.0.0 first needs the 2.0.0 → 2.1.0 upgrade guide.
crates.io/crates/gradatum · published (v2.5.0) · Apache-2.0
Clone the repository and compile all workspace crates. Requires recent stable Rust (MSRV).
git clone https://github.com/gradatum/gradatum
cd gradatum && cargo build --release --workspace github.com/gradatum/gradatum · Apache-2.0 · Rust 2024 · MSRV 1.91+
v2.5.0 · Linux x86_64 · SemVer since v1.0.0, with documented exceptions — a doc-hidden Rust API rename in the previous minor release, see the CHANGELOG; v2.5.0 behaviour change: a configured-but-unusable ACL preset now refuses to start the server, see the UPGRADING guide. 28 of the 34 workspace crates published on crates.io; pre-built binary archives track v2.5.0. See docs/DEPLOYMENT.md for the full deployment reference.
| Provider | gateway.toml | Requirement |
|---|---|---|
| Any OpenAI-compatible endpoint (Ollama, llama.cpp, OpenRouter, self-hosted…) | [providers.NAME] | Endpoint reachable, serves /v1/chat/completions |
| Cloud provider requiring a key | api_key_env = "MY_KEY_ENV_VAR" (same block) | Env var set with the key |
| None (no gateway installed) | — | — |
gradatum-admin init --preset hierarchical --root /var/lib/gradatum
gradatum-admin api-key create --root /var/lib/gradatum --owner my-agent
gradatum-admin api-key list --root /var/lib/gradatum
gradatum-admin jobs list --root /var/lib/gradatum
gradatum-admin jobs dlq --root /var/lib/gradatum
gradatum-admin vault rename "old title" "new title" --tenant main # wikilinks stay stable across the rename Single-binary on one box, or scale out: one GPU host serving several models, an app host routing through the gateway with automatic CPU fallback.
consumers (apps · agents · MCP clients)
↓ MCP / HTTP / REST
┌──────────────────── app-host (Linux) ───────────────────────┐
│ gradatum-server ─┐ │
│ gradatum-worker ─┴──────────▶ gradatum-gateway :8436 │
│ (router · circuit-breaker) │
│ │ primary │ fallback │
│ ▼ ▼ │
│ [GPU-HOST] local CPU fallback │
└──────────────────────────────────┼────────────────────────┘
LAN
┌──────────────────── gpu-host (Linux) ───────────────────────┐
│ gradatum-engine · one supervisor binary, one instance/model│
│ chat :8083 · embed :8432 · small :8082 │
│ reason :8081 · vision :8080 (+mmproj) │
│ each instance supervises one llama-server child (loopback) │
│ GGUF bind-mounted ro · /opt/gradatum/models/ │
└─────────────────────────────────────────────────────────────┘
primary → GPU host · fallback → local CPU (circuit-breaker auto) Full deployment guide and configuration reference: docs/DEPLOYMENT.md.