local-ai Tools

ODS transforms your personal computer into a powerful, self-hosted AI platform. It solves the problem of privacy, cost, and latency by bringing LLM inference, chat, voice agents, and image generation directly to your local machine. It's ideal for developers, researchers, and privacy-conscious users who want full control over their AI tools without relying on cloud services.

Soup is a CLI tool that automates the entire fine-tuning stack for large language models. It solves the complexity of configuring training runs by automatically generating optimal settings, handling data preparation, and enabling training of large models on limited hardware through layer streaming. It's for ML engineers and researchers who want to fine-tune models efficiently without vendor lock-in or manual hyperparameter tuning.