Skip to content

Releases: planetf1/oxllm

0.1.12 - 2026-06-01

Choose a tag to compare

@github-actions github-actions released this 01 Jun 12:34

Release Notes

Fixed

  • Fixed Homebrew formula publish: publish-homebrew-formula job now depends on
    build-global-artifacts where cargo-dist generates the .rb formula file.
    Was incorrectly depending only on build-local-artifacts after the decoupling
    fix in v0.1.11.

Install oxllm 0.1.12

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/planetf1/oxllm/releases/download/v0.1.12/oxllm-installer.sh | sh

Install prebuilt binaries via Homebrew

brew install planetf1/tap/oxllm

Download oxllm 0.1.12

File Platform Checksum
oxllm-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
oxllm-x86_64-apple-darwin.tar.xz Intel macOS checksum
oxllm-aarch64-unknown-linux-gnu.tar.xz ARM64 Linux checksum
oxllm-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum

0.1.11 - 2026-06-01

Choose a tag to compare

@github-actions github-actions released this 01 Jun 11:13

Release Notes

Added

  • OpenAI-compatible JSON error format: All error responses (400, 502, 403) now
    return {"error": {"message": ..., "type": ..., "code": ...}} with
    Content-Type: application/json. Official OpenAI SDKs can parse errors correctly.
  • CORS headers: Access-Control-Allow-Origin: * on all public endpoints
    (/v1/chat/completions, /v1/embeddings, /v1/models). Enables browser-based
    OpenAI SDKs (JavaScript, Vercel AI SDK) to call the proxy directly.
  • x-request-id correlation: Every response now includes an oxllm-<hex>
    x-request-id header, visible in both success and error responses. The ID is
    also attached to all log lines and OTel spans (proxy.request_id attribute)
    for end-to-end request tracing.
  • Provider status OTel gauge: llm_proxy.provider.status (0=Healthy, 1=Cooldown,
    2=Tripped) now emits on every circuit state transition. Previously the gauge was
    defined but never populated.
  • Unit & integration tests: 7 new tests covering CORS preflight, JSON error
    format parsing, and x-request-id presence on both success and error responses.

Changed

  • localhost_only middleware returns JSON error body instead of empty 403.
  • CORS layer registered globally, before all per-route middleware.
  • All upstream-failure warn! log lines now include request_id field.

Documentation

  • Added CORS support, x-request-id, and JSON error format to README features list.
  • Updated architecture doc with CORS subsection, request correlation docs, and
    updated middleware diagram.

Install oxllm 0.1.11

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/planetf1/oxllm/releases/download/v0.1.11/oxllm-installer.sh | sh

Install prebuilt binaries via Homebrew

brew install planetf1/tap/oxllm

Download oxllm 0.1.11

File Platform Checksum
oxllm-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
oxllm-x86_64-apple-darwin.tar.xz Intel macOS checksum
oxllm-aarch64-unknown-linux-gnu.tar.xz ARM64 Linux checksum
oxllm-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum

0.1.10 - 2026-06-01

Choose a tag to compare

@github-actions github-actions released this 01 Jun 10:37

Release Notes

Documentation

  • Updated docs/providers.md to match the actual config.toml — removed Cerebras
    (not in config), updated Groq/SambaNova/OpenRouter model names to verified IDs,
    excluded Gemini 2.5 Pro (paid-only), added second SambaNova tier.
  • Updated docs/architecture.md with missing endpoints (/admin/providers/*,
    /health), corrected rate-limit header parsing claim (only Retry-After),
    documented v0.1.9 mid-stream feedback deferral, marked root-context-synthesis
    as planned-not-implemented, added manual_disabled field to struct diagram,
    and updated admin-route protection to mention dual-stack IPv6 support.

Install oxllm 0.1.10

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/planetf1/oxllm/releases/download/v0.1.10/oxllm-installer.sh | sh

Install prebuilt binaries via Homebrew

brew install planetf1/tap/oxllm

Download oxllm 0.1.10

File Platform Checksum
oxllm-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
oxllm-x86_64-apple-darwin.tar.xz Intel macOS checksum
oxllm-aarch64-unknown-linux-gnu.tar.xz ARM64 Linux checksum
oxllm-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum

0.1.9 - 2026-06-01

Choose a tag to compare

@planetf1 planetf1 released this 01 Jun 10:26

Release Notes

Fixed

  • Hot-reload race: replaced all .find().unwrap() calls on provider state lookups with graceful let Some(...) else { continue; } patterns.
  • Upstream error body passthrough: upstream error message captured in 502 response.
  • Mid-stream feedback deferred: circuit breaker feedback fires after stream completes.

0.1.8 - 2026-06-01

Choose a tag to compare

@github-actions github-actions released this 01 Jun 08:08

Release Notes

Fixed

  • oxllm serve now uses the host config field for IPv4 binding instead of
    hardcoding 127.0.0.1. Set host = "0.0.0.0" to accept connections from
    other machines. Admin and status routes remain protected by localhost_only
    middleware regardless of bind address.

Install oxllm 0.1.8

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/planetf1/oxllm/releases/download/v0.1.8/oxllm-installer.sh | sh

Install prebuilt binaries via Homebrew

brew install planetf1/tap/oxllm

Download oxllm 0.1.8

File Platform Checksum
oxllm-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
oxllm-x86_64-apple-darwin.tar.xz Intel macOS checksum
oxllm-aarch64-unknown-linux-gnu.tar.xz ARM64 Linux checksum
oxllm-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum

0.1.7 - 2026-06-01

Choose a tag to compare

@github-actions github-actions released this 01 Jun 07:56

Release Notes

Fixed

  • oxllm --version now reports the actual crate version from Cargo.toml
    instead of a hardcoded 0.1.0 string (broken since v0.1.5).
    Uses env!("CARGO_PKG_VERSION") via clap derive.

Added

  • Router-ready config with all API keys inlined (no shell variables) and
    Ollama fallback removed — written to /etc/oxllm/config.toml.
  • systemd service file, update script (/usr/local/bin/oxllm-update).

Install oxllm 0.1.7

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/planetf1/oxllm/releases/download/v0.1.7/oxllm-installer.sh | sh

Install prebuilt binaries via Homebrew

brew install planetf1/tap/oxllm

Download oxllm 0.1.7

File Platform Checksum
oxllm-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
oxllm-x86_64-apple-darwin.tar.xz Intel macOS checksum
oxllm-aarch64-unknown-linux-gnu.tar.xz ARM64 Linux checksum
oxllm-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum

0.1.6 - 2026-05-30

Choose a tag to compare

@github-actions github-actions released this 30 May 21:31
v0.1.6
c0ece72

Release Notes

Added

  • Admin API: POST /admin/providers/{name}/offline|online|reset — runtime provider management.
  • CLI: oxllm provider list|offline|online|reset subcommands — manage providers without curl.
  • oxllm provider list — condensed provider status table.
  • Friendly error messages when server not running (all CLI commands).
  • XDG config path support (~/.config/oxllm/config.toml with ./config.toml fallback).
  • Provider guide: docs/providers.md — free-tier services, model names verified live (2026-05-30).
  • Token counting from upstream JSON responses (non-streaming).

Fixed

  • Corrected model names for all 6 providers (verified via each provider's /v1/models endpoint).
  • Gemini 2.5 Pro excluded (paid-only on free tier, quota = 0).
  • Table column widths widened to fit 45-character model names.
  • Last Request column width fixed (12 chars).
  • Cleaned up debug println! statements from error paths.

Changed

  • Model names: updated to verified values (e.g. llama-4-scoutmeta-llama/llama-4-scout-17b-16e-instruct).
  • Ollama defaults: granite4:microgranite4.1:3b.
  • Default config searches XDG path before current directory.

Documentation

  • Full README overhaul: binary size, routing algorithm, CLI examples, telemetry section.
  • Provider guide with snapshot date and research methodology.
  • API endpoint table includes admin routes.

Install oxllm 0.1.6

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/planetf1/oxllm/releases/download/v0.1.6/oxllm-installer.sh | sh

Install prebuilt binaries via Homebrew

brew install planetf1/tap/oxllm

Download oxllm 0.1.6

File Platform Checksum
oxllm-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
oxllm-x86_64-apple-darwin.tar.xz Intel macOS checksum
oxllm-aarch64-unknown-linux-gnu.tar.xz ARM64 Linux checksum
oxllm-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum

0.1.4 - 2026-05-30

Choose a tag to compare

@github-actions github-actions released this 30 May 17:26
v0.1.4
a4fff89

Release Notes

Added

  • Local per-provider request/success/token counters visible via GET /status and oxllm status — no external collector needed.
  • upstream_timeout_secs config field in [server] section (default 5 seconds).
  • Multi-tier config.toml with smart/basic virtual models and local Ollama fallback.
  • Token counting from upstream JSON responses (non-streaming).
  • crates.io publish workflow (tag-triggered, idempotent).

Fixed

  • Removed println! debug statements from error paths.
  • Removed invalid crates-io value from dist-workspace.toml.

Documentation

  • Overhauled README with endpoint table, status output example, and quick start guide.

Install oxllm 0.1.4

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/planetf1/oxllm/releases/download/v0.1.4/oxllm-installer.sh | sh

Install prebuilt binaries via Homebrew

brew install planetf1/tap/oxllm

Download oxllm 0.1.4

File Platform Checksum
oxllm-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
oxllm-x86_64-apple-darwin.tar.xz Intel macOS checksum
oxllm-aarch64-unknown-linux-gnu.tar.xz ARM64 Linux checksum
oxllm-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum