Ollama

A self-hosted, open-source AI coding assistant that provides an alternative to GitHub Copilot. It allows teams to keep their code on-premise while still benefiting from AI-powered completions.

An open-source autopilot for VS Code and JetBrains that allows you to build your own custom AI coding experience. You can easily plug in any LLM from any provider.

An on-device AI deployment and research platform that makes local AI production-ready. Nexa provides a powerful SDK for running state-of-the-art models locally on CPU, GPU, or NPU across various consumer hardware.

An open-source, local-first autonomous agent that allows LLMs to run code on your computer. It features a natural language interface for controlling your terminal, apps, and file system securely.

A new programming language built from the ground up for AI development. It combines the ease of use of Python with the performance of C++, delivering massive speed gains for AI hardware and software.

A cloud-native application development platform that allows developers to run a full AWS environment locally. Its AI features automate the creation of cloud infrastructure and help debug complex cloud-native architectures.

A high-speed re-implementation of OpenAI's Whisper model using CTranslate2. Faster-Whisper provides up to 4x faster transcription speeds with significantly lower memory usage, optimized for both CPU and GPU execution.

A decentralized AI network that allows you to run local agents and connect them to your private data without ever touching the cloud.

An easy-to-use desktop application for discovering and running open-source LLMs locally. Features a clean UI and one-click model downloads.

An open-source, local-first AI assistant that runs entirely on your own hardware. Features a clean, ChatGPT-like interface and supports various local model backends.

A home server operating system that allows you to run local AI models, host your own cloud services, and manage your data privately. It features a one-click app store for Ollama, Nextcloud, and more.

A desktop application that allows users to run Large Language Models locally with absolute privacy and zero censorship. It ensures that all data stays on your machine and that interactions are completely private and uncensored.

A sovereign home server operating system designed to host private AI models and cloud services locally. It features a one-click app store for Ollama, Nextcloud, and other privacy-first utilities.

A distributed local AI inference engine that allows you to run Large Language Models across multiple consumer devices. Exo creates a decentralized 'home cloud' for AI, ensuring your data never leaves your hardware while utilizing all available compute.

An air-gapped AI research assistant that lives entirely on your hardware. It handles document analysis and complex reasoning without an internet connection, ensuring the highest level of information security.

An open-source framework for building, shipping, and scaling machine learning applications. It simplifies the process of turning models into production-ready APIs and managing their entire lifecycle.

A high-performance Rust library for building scalable, modular, and ergonomic LLM-powered applications. Rig provides a unified interface for 20+ model providers and 10+ vector stores, optimized for type-safe agentic workflows.

Meta's standardized API and toolchain for building applications with Llama models. Llama Stack provides a pluggable provider architecture, enabling a unified interface for inference, RAG, and agentic orchestration across various infrastructures.

Best Local LLM Runtimes 2026: Ollama vs LM Studio vs llama.cpp

Master AI Automation 2026 and Generative Engine Optimization. Comparing Ollama, LM Studio, and llama.cpp for running open models locally — speed, ease of use, and API serving.

Best Local LLM Models 2026: Llama vs Qwen vs DeepSeek

Master AI Automation 2026 and Generative Engine Optimization. Comparing Llama, Qwen, and DeepSeek open-weight models for local deployment — benchmarks, licensing, and hardware fit.