AI Tools Directory

Shimmy

Local AI toolsEducationUnverifiedOpen sourceRuns locally
DownloadGitHub repository

Description

Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Shimmy is independently maintained and free forever. Sponsorship funds certification, compatibility work, and releases.

Main features

  • TurboShimmy INT4 KV Cache — About 7× lower KV-cache memory in tested configurations. Run Llama-3.2-3B on 4 GB GPUs
  • OpenAI SDK Compatibility — Chat completions, text completions, streaming, and model endpoints. Works with OpenAI SDKs and tools using that surface
  • Extended Context — YaRN RoPE scaling via SHIMMY_MAX_CTX
  • Migrating from v1.x — llama.cpp, MLX, HuggingFace, and RustChain backends removed in v2.0+. Shimmy is now a pure Airframe product
  • Certification — Every model passes a 3-box certification regimen (MATH + INFERENCE + DETERMINISM). See docs/CERTIFICATION.md
  • MOE support — Mixture-of-Experts CPU offloading is on the Airframe roadmap

Alternative tools

New

ThinkRail

Source: GitHub · verified on Nov 2, 2026

Vibe code with pi in a lightweight, real IDE that customises itself around the way you work — The Vibe You Need ThinkRail is the agentic IDE that gets better every time you use it — learning your project through living specs today, and…

AutomationEducationFreeOpen sourceRuns locally
LinuxmacOSWindows
New

Soup

Source: GitHub · verified on Nov 2, 2026

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU. Fine-tune and post-train LLMs in one command. No SSH, no config hell.

Local AI toolsEducationFreeOpen source
Terminal / CLI
New

Atomic Agent

Source: GitHub · verified on Nov 2, 2026

Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp. Drives your browser, edits files, runs approved commands, and remembers context across sessions. Open source, running on our TurboQuant l…

Local AI toolsAutomationFreeOpen sourceRuns locally
macOSLinuxWindowsTerminal / CLI
New

Claude devtools

Source: GitHub · verified on Nov 2, 2026

The missing DevTools for Claude Code — inspect session logs, tool calls, token usage, subagents, and context window in a visual UI. Free, open source.

Local AI toolsFreeOpen sourceRuns locally
LinuxmacOSWindowsTerminal / CLI