Awesome Ai Agents 2026
Section: Tracing and Monitoring · OSS LLM observability. Traces, evals, prompts.
ActiveScore 74
Entry
Langfuse
Appears in 10 awesome lists
The most widely adopted self-hostable LLM observability platform: traces every agent step, manages prompt versions, and runs evals in one tool. Preferred over cloud-only alternatives when data residency or cost control is a constraint.
Open github.comlangfuse/langfuse
Found in these lists
Awesome Ai Sdks
Section: Links
ActiveScore 70
awesome-ChatGPT-repositories
Section: Prompts · 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
FreshScore 87
Awesome Harness Engineering
Section: Observability & Tracing · The most widely adopted self-hostable LLM observability platform: traces every agent step, manages prompt versions, and runs evals in one tool. Preferred over cloud-only alternatives when data residency or cost control is a constraint.
FreshScore 88
Awesome LLMOps
Section: LLMOps · Open Source LLM Engineering Platform: Traces, evals, prompt management and metrics to debug and improve your LLM application.
ActiveScore 75
Awesome local LLM
Section: Testing, Evaluation and Observability · an open-source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more
FreshScore 87
Awesome Open Source AI
Section: 8. MLOps / LLMOps & Production · #1 open-source LLM observability platform.
FreshScore 89
Awesome Production Machine Learning
Section: Evaluation and Monitoring · Langfuse is an observability & analytics solution for LLM-based applications.
FreshScore 92
Awesome Prompts
Section: Eval & Observability · Open-source LLM engineering platform — tracing, evals, prompt management, A/B experiments.
FreshScore 90
Awesome AI Agents: Tools, Resources, and Projects
Section: Repositories · Langfuse, an open-source LLM engineering platform, offers debugging, prompt management, metrics for LLM apps improvement, and won the #1 Golden Kitty in the AI Infra Category from Product Hunt github | website | twitter | discord
SlowScore 68
Often listed next to it
promptfoo
Test your prompts, models, RAGs. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality. LLM evals for OpenAI/Azure GPT, Anthropic Claude, VertexAI Gemini, Ollama, Local & private models like Mistral/Mixtral/Llama with CI/CD
In 11 listsDetails
Langfuse
LLM engineering platform for model tracing, prompt management, and application evaluation. Langfuse helps teams collaboratively debug, analyze, and iterate on their LLM applications such as chatbots or AI agents. (Demo, Source Code, Clients) MIT Docker
In 10 listsDetails
Prompt Engineering Guide
🐙 Guides, papers, lecture, notebooks and resources for prompt engineering
In 11 listsDetails
Phoenix
Open-source AI observability & evaluation platform (Arize) — OpenTelemetry-native tracing for agents, LLM-as-judge evals, versioned datasets & experiments for prompt regression testing, prompt management with version control and replay, plus an MCP endpoint so Claude Code/Cursor can query traces…
In 10 listsDetails
DocsGPT
Private AI platform for building intelligent agents and assistants with enterprise search. Features Agent Builder, deep research tools, multi-format document analysis, and multi-model support. MIT licensed.
In 10 listsDetails
DemoGPT
DemoGPT enables you to create quick demos by just using prompt. It applies ToT approach on Langchain documentation tree.
In 9 listsDetails
Helicone
Open-source LLM observability proxy (YC W23) with the largest open-source pricing database (300+ models). One-line proxy integration provides cost tracking, token monitoring, session tracing, and prompt versioning across providers. The AI Gateway component handles request routing and caching with…
In 8 listsDetails
Portkey AI Gateway
🟢🟠 — Open AI gateway with provider routing, fallback and retry controls, guardrail integrations, observability, and MCP traffic support for model and agent applications. (Portkey) — note: the gateway is general infrastructure rather than a standalone security scanner; model-provider…
In 6 listsDetails