The Best Self-Hosted AI Stack for Small Teams in 2026
An opinionated reference architecture for self-hosted team AI in 2026: vLLM, Open WebUI, LiteLLM, Qdrant, and Langfuse on one GPU box, with honest alternatives at every layer.
Billy C
New tools added weeklyThe AI Tools Directory
The AI Tools Directory
for People Who Actually Build
Discover the best open-source and developer-focused AI tools. LLMs, agents, image generation, RAG, and more, curated and rated for indie makers and power users.
872+AI tools
27categories
100%free to browse
Curated
Featured Tools
Editor's pick
AnythingLLM
All-in-one desktop and Docker app for private LLM chat with your documents.
Open SourceSelf HostedOffline
Beginner
Featured
Featured
Feature-rich web UI for Stable Diffusion with extensive extension ecosystem.
Open SourceSelf HostedOfflineGPU 4GB+
Easy
Featured
Week of Sep 28 to Oct 4, 2026
Tools of the Week
One tool from every category, reshuffled every Monday.
3D Model Generation
Generates high-fidelity 3D meshes from single images with a 1.5B rectified flow transformer.
Open SourceSelf HostedOfflineGPU 8GB+
Intermediate
AI Agents & Orchestration
Terminal coding agent that runs commands in native sandboxes, optimized for low-cost models.
Open SourceSelf Hosted
Easy
AI Animation & Motion
Animates a still human photo with 3D SMPL parametric motion guidance extracted from a driving video.
Open SourceSelf HostedOfflineGPU 20GB+
Advanced
AI Code Assistants
Self-hosted alternative to GitHub Copilot using open-source models.
Open SourceSelf HostedOfflineGPU 8GB+
Intermediate
AI Deployment & MLOps
Open-source orchestrator for AI training and inference across clouds, Kubernetes, and bare metal.
Open SourceSelf HostedOffline
Advanced
AI Frameworks & Libraries
Gradient boosting library by Yandex with native categorical feature handling.
Open SourceSelf HostedOffline
Easy
Start here
Guides and comparisons
Inference
The State of Open Source LLM Inference Engines
Agents
Agent Framework Landscape: A Buyers Guide
Coding
Best AI Coding Assistants
Vector DBs
Vector Database Benchmarks: Qdrant, Milvus, Weaviate, LanceDB
Documents
PDF Parsing for RAG: MinerU, Docling, Marker Compared
Speech
Open Weight Text to Speech Models
The live index
Explore the directory
Official Apache-2.0 SandBase CLI and local MCP bridge that connects AI coding agents to 2,000+ AI models through one account. It supports Cursor, Claude Code, Codex, Windsurf, Gemini CLI, OpenCode, an
Open Source
Intermediate
Browse Categories
27 categories3D Model Generation
29 tools
AI Agents & Orchestration
58 tools
AI Animation & Motion
19 tools
AI Code Assistants
37 tools
AI Deployment & MLOps
24 tools
AI Frameworks & Libraries
48 tools
AI Image/Video Editing
26 tools
AI Observability & Evaluation
28 tools
Audio & Speech
17 tools
Computer Vision & Object Detection
39 tools
Data Labeling & Annotation
13 tools
Datasets & Training
12 tools
Diffusion Model Tools & UIs
18 tools
Image Generation
49 tools
Large Language Models (LLMs)
66 tools
LLM Inference & Serving
47 tools
Model Training & Fine-Tuning
34 tools
Music & Audio Generation
31 tools
Natural Language Processing
26 tools
OCR & Document Processing
31 tools
RAG & Document Retrieval
30 tools
Speech-to-Text / Speech Recognition
34 tools
Text-to-Speech (TTS)
52 tools
UI & Chat Interfaces
18 tools
Vector Databases & Embeddings
31 tools
Video Generation
44 tools
Voice Cloning & Voice Conversion
7 tools
From the Blog
View all articles →Best Local LLM Setups by GPU Budget: 8GB, 16GB, 24GB, Multi-GPU
Exact model, quant, and engine picks for every VRAM tier in 2026, from an 8GB laptop GPU to a dual-3090 tower, with honest notes on what each setup cannot do.
Billy C
The Best Open-Source Video Generation Stack in 2026
Wan 2.2, LTX-2, and HunyuanVideo 1.5 lead the open-weight video field in 2026. What actually runs on your GPU, and which model to pick for each job.
Billy C
Know a great AI tool?
Help the community discover amazing tools by submitting your favorites. Every submission is reviewed before publishing.
Submit a Tool