Technology

LocalGPT: a local-first AI assistant in Rust with persistent memory

Feb 08, 2026 06:12

LocalGPT is a Rust-built, single-binary AI assistant that stores memory in markdown and supports multiple LLM providers. It’s positioned as a privacy-friendly, local-first alternative inspired by OpenClaw’s workspace pattern.

LocalGPT is an open-source, local device–focused AI assistant written in Rust. **Highlights** - Single-binary distribution (no Docker/Python runtime required). - Persistent memory stored as markdown files (SOUL / MEMORY / HEARTBEAT pattern). - SQLite-based indexing: FTS5 for keyword search and sqlite-vec for semantic search. - Multiple LLM backends (Anthropic, OpenAI, Ollama). **Why it matters** Local-first assistants are gaining momentum as teams balance productivity with privacy and deployment simplicity. A Rust-based single binary can be easier to roll out across developer machines and servers. **Tags:** AI, Open Source, Developer Tools

Source: GitHub