Awesome Ai Agents 2026
Section: Local LLM Runners · Run LLMs locally. 162k+ stars. Dead simple CLI.
ActiveScore 74
Entry
Ollama
Appears in 12 awesome lists
Ollama is a tool for running large language models locally, offering easy setup for macOS, Windows, Linux, and Docker, along with a library of models and quickstart guides for customization and integration github | github profile
Open github.comollama/ollama
Found in these lists
awesome-ChatGPT-repositories
Section: Langchain · Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.
FreshScore 87
Awesome Generative AI Data Scientist
Section: LLM Providers · Get up and running with large language models locally.
SlowScore 52
Awesome Homelab
Section: AI · Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
FreshScore 84
Awesome LLM Resources
Section: 推理 Inference · Get up and running with Llama 3, Mistral, Gemma, and other large language models.
FreshScore 87
Awesome local LLM
Section: Inference engines · get up and running with LLMs
FreshScore 87
Awesome Open Source AI
Section: 3. Inference Engines & Serving · Dead-simple local LLM runner with a one-line install, model registry, and OpenAI-compatible API.
FreshScore 89
Awesome Production Machine Learning
Section: Industry Strength Natural Language Processing · Get up and running with large language models, locally.
FreshScore 92
Awesome Prompts
Section: Tools & Libraries · Run LLMs locally — desktop app, multimodal, structured outputs
FreshScore 90
Awesome AI Agents: Tools, Resources, and Projects
Section: Repositories · Ollama is a tool for running large language models locally, offering easy setup for macOS, Windows, Linux, and Docker, along with a library of models and quickstart guides for customization and integration github | github profile
SlowScore 68
Awesome Generative AI
Section: Local LLM Deployment · Get up and running with large language models locally.
FreshScore 90
awesome-go
Section: LLM and Inference · Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
FreshScore 81
Often listed next to it
LangChain
Langchain integrates various providers like Anthropic, AWS, and OpenAI, and offers tools for components such as LLMs, chat models, and data analysis, supporting functionalities from Alpha Vantage to YouTube github | docs
In 20 listsDetails
LiteLLM
Unified proxy and SDK that routes to 100+ LLM providers behind a single OpenAI-compatible interface, with a Router handling retry/fallback across deployments, per-project cost and rate-limit tracking, and OTEL callback integrations. The right infrastructure layer when your harness needs provider…
In 16 listsDetails
LlamaIndex
(MIT) provides modules for structured outputs at different levels of abstraction, including output parsers for text completion endpoints, Pydantic programs for mapping prompts to structured outputs using function calling or output parsing, and pre-defined Pydantic programs for specific output types.
In 14 listsDetails
LocalAI
robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video,…
In 14 listsDetails
vLLM
State-of-the-art serving engine with PagedAttention and continuous batching. Currently the fastest production-grade LLM server.
In 11 listsDetails
Flowise
Flowise simplifies the creation of applications leveraging large language models (LLMs) by providing a drag-and-drop interface for customizing AI workflows, offering easy installation, Docker support, development tools, and documentation for integrating various functionalities such as…
In 12 listsDetails
Open WebUI
Open WebUI is an extensible, feature-rich, and user-friendly self-hosted AI platform designed to operate entirely offline. It supports various LLM runners like Ollama and OpenAI-compatible APIs, with built-in inference engine for RAG, making it a powerful AI deployment solution.
In 11 listsDetails
LM Studio
LM Studio offers a platform for running various local LLMs like LLaMa, Falcon, MPT, and others offline, featuring a Chat UI, OpenAI-compatible server, and model downloads from Hugging Face, with support for Mac, Windows, and Linux, emphasizing privacy and no data collection, free for personal use…
In 11 listsDetails