Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
Main features
Run open-weight LLMs locally from HuggingFace — Llama, Gemma, Qwen, Mistral, Phi, and others
Multi-Token Prediction (MTP) speculative decoding — 30–70% throughput boost on supported models, up to 3× on Gemma 4
DFlash block-diffusion decoding — up to 6× faster on Qwen 3.6, Gemma 4, Kimi K2.5
Flash Attention toggle (on / off / auto)
Automatic reasoning-context tracking for chain-of-thought models
Auto context-window expansion with overflow notifications
Requirements
Node.js ≥ 20.0.0
Yarn ≥ 4.5.3
Make ≥ 3.81
Rust (for Tauri)
Apple Silicon) MetalToolchain xcodebuild -downloadComponent MetalToolchain
Control panel for VLLM, Sglang, llama.cpp, exllamav3
Built on T3 Code by Theo Browne, Julius Marminge and the T3 Tools team, used under the MIT License (Copyright (c) 2026 T3 Tools Inc.). Local Studio is a thin fork that tracks upstream…
Personal AI agent harness for macOS, Windows, Linux, Android & iOS. New: Skales Scout, lasting AI agents that keep working on your desk, each optionally in its own virtual machine. Chat, coding (Skales Code), Flow, automations, computer…
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
AnythingLLM: The all-in-one AI app you were looking for. Chat with your docs, use AI Agents, hyper-configurable, mu…
AutomationLocal AI toolsUnverifiedOpen sourceRuns locally
Source control for agents. Use multiple coding agents, track their changes and query them in one place
Atlas is source control for coding agents. Every agent run produces checkpoints: commits are linked back to the session that made it…