DreamServer
Light-Heart-Labs
One-command installer that turns your own machine into a private AI server (LLM, voice, RAG, image gen).
What is DreamServer?
A one-command installer and orchestrator that turns a personal Linux, Windows (via WSL2/Docker) or Apple Silicon machine into a private, self-hosted AI server. It bundles and wires together open-source components: llama.cpp for inference, Open WebUI chat, Whisper STT and Kokoro TTS, n8n workflows, Qdrant/SearXNG RAG and ComfyUI image generation, with GPU auto-detection and a dream CLI, all running locally with no cloud.
Pros & Cons
Pros
- A genuinely all-in-one local AI stack (LLM, voice, RAG, workflows, image gen) with one install command
- Hardware and GPU auto-detection, with a bootstrap mode that gets you chatting on a small model in under a minute
- Permissive Apache-2.0, broad OS and distro coverage, active maintenance
Cons
- Mostly orchestration of existing OSS (llama.cpp, Open WebUI, n8n, ComfyUI); the value is integration, not new technology
- A heavy footprint: Docker, large model downloads and GPU expectations
- The public homepage is only a Discord invite, and headline accolades are unverified project claims
License
Apache-2.0 (OSI-open)
When it is interesting
You want a private, no-cloud AI suite on your own hardware without manually stitching together a dozen tools.
When it is too early
If you need a lightweight single-purpose inference setup, or cannot run Docker or a capable GPU.
This repo featured in the 2026-07 edition of the Open-Source AI Radar.
oMLX
jundot
macOS-native LLM inference server for Apple Silicon with continuous batching and SSD-tiered caching.
apfel
Arthur-Ficial
Expose the on-device Apple Intelligence model on macOS 26 as a zero-setup OpenAI-compatible local API.
shimmy
Michael-A-Kuykendall
Pure-Rust local inference engine with an OpenAI-compatible API, shipped as one binary.