Awesome AI Tools
Section: Developer tools · Evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.
SlowScore 67
Entry
Opik
Appears in 6 awesome lists
Open source engineering platform to debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. (Source Code)
Found in these lists
Awesome Big Data
Section: Applications · Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
ActiveScore 84
Awesome Developer-First
Section: Monitoring · Evaluate, test, and ship LLM applications across your dev and production lifecycles.
FreshScore 84
Awesome Machine Learning
Section: C++ · Open source engineering platform to debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. (Source Code)
FreshScore 93
Awesome OpenTelemetry
Section: Vendors
ActiveScore 70
Awesome-Selfhosted
Section: Software Development - API Management · ⚠ - Evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle. (Source Code) Apache-2.0 Docker/Python
FreshScore 94
Often listed next to it
Langfuse
LLM engineering platform for model tracing, prompt management, and application evaluation. Langfuse helps teams collaboratively debug, analyze, and iterate on their LLM applications such as chatbots or AI agents. (Demo, Source Code, Clients) MIT Docker
In 10 listsDetails
gpt4all
is an ecosystem of open-source chatbots trained on a massive collections of clean assistant data including code, stories and dialogue based on LLaMa.
In 11 listsDetails
Plandex
Terminal-based AI coding agent with REPL mode for planning and executing complex tasks across multiple files, 2M token context.
In 9 listsDetails
Ollama
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models. (Source Code) MIT Docker/Python
In 8 listsDetails
Pinecone
The Pinecone vector database makes it easy to build high-performance vector search applications. Developer-friendly, fully managed, and easily scalable without infrastructure hassles.
In 8 listsDetails
Maxim AI
The agent simulation, evaluation, and observability platform helping product teams ship their AI applications with the quality and speed needed for real-world use.
In 8 listsDetails
Keploy
Keploy is an open-source testing platform that helps developers automate and streamline their testing process. It provides API, and integration testing agents, generating tests, mocks/stubs for APIs that actually work. Additionally, Keploy offers an AI-powered Unit Testing Agent that generates…
In 8 listsDetails