inference-server Tools

SIE is an open-source inference server and production cluster that allows developers to run all the models their AI agents need—from embeddings and rerankers to large language models—entirely within their own infrastructure. It solves the problem of vendor lock-in, data privacy concerns, and high costs associated with proprietary model APIs by providing a performant, self-hosted alternative. It's built for teams building production AI agents who require control, data sovereignty, and the ability to compose the best open models.

oMLX is a macOS-native LLM inference server built for Apple Silicon. It solves the slow, repetitive nature of coding agents by persisting KV cache blocks to SSD, eliminating recomputation and slashing response times from 90 seconds to under 5. It's designed for developers using AI coding tools like Claude Code, Cursor, and OpenClaw who need fast, persistent, and locally managed AI on their Mac.