Skip to content
← all work

Inferlock

Exclusive GPU leases for cooperating local inference engines.

activeopen source

now

Keeping GPU coordination conservative, inspectable and small enough to fit local inference stacks.

what's there

  • Exclusive leases stop cooperating engines from fighting over one GPU.
  • The API is intentionally narrower than a general scheduler.
  • Started as homelab glue between a llama.cpp router and a vLLM server.

limits

  • Cooperating clients are required; Inferlock does not police arbitrary GPU processes.