voidllm

Give every user and agent its own key to your Ollama
— and a log of who used what.

Ollama gives every caller the same unlimited access and keeps no record. voidllm sits in front and issues scoped, revocable keys — with per-key daily quotas and a tamper-evident usage log you can verify. One file, no database.

Download voidllm.py Quickstart Imagine ↗

60-second quickstart

# 1. grab it — one file, no dependencies
curl -fL https://voidllm.talleyit.com/voidllm.py -o voidllm.py

# 2. mint yourself a key (printed once)
python3 voidllm.py keygen me

# 3. run the gateway (loopback:8111, in front of your Ollama)
python3 voidllm.py serve

# 4. use it like any OpenAI endpoint
curl http://127.0.0.1:8111/v1/chat/completions \
  -H "Authorization: Bearer vllm-..." \
  -d '{"model":"qwen2.5-coder:1.5b","messages":[{"role":"user","content":"hi"}]}'

Why this one

One file, zero deps

Pure Python standard library. No pip, no Node, no Docker, no database. Copy it and run it.

Tamper-evident log

Every request is appended to an HMAC hash-chained ledger. Edit history and usage --verify catches it.

Per-key everything

Scope each key to specific models, paths, a daily quota, and an expiry. Revoke one without touching the rest.

Fail-closed

Missing, unknown, expired, out-of-scope, or over-quota → rejected. If config can't load, nothing is served.

Two-man rule

Optionally require a second, different key (X-Void-Key-2) on sensitive models or paths — no single key can call them alone.

Nothing to phone home to

No SaaS, no telemetry, no account. It runs on your machine, in front of your Ollama, and answers only to keys you mint.

What it is not

Not a multi-provider router. It fronts one Ollama. For fan-out across providers, use a full gateway like LiteLLM.
Not a firewall. It's an auth layer — put it behind TLS, don't bind it straight to the open internet.
Not a hosted service. You run it on your own machine. No SaaS, no telemetry, no account.

License

Source-available under PolyForm Noncommercial 1.0.0. Free for personal, hobby, research, education, nonprofit, and government use. Using it in a for-profit business? Buy a commercial license — $100, one-time, per company, perpetual.