Skip to content

Entry

Kiln

Appears in 5 awesome lists

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

Open github.comkiln-ai/kiln

Found in these lists

awesome-ChatGPT-repositories

Section: Prompts · The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.

FreshScore 87

Awesome LLM Resources

Section: 微调 Fine-Tuning · The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.

FreshScore 87

Awesome local LLM

Section: Training and Fine-tuning · the easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets

FreshScore 87

Awesome Production Machine Learning

Section: Deployment and Serving · Kiln is an OSS tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.

FreshScore 92

awesome-python

Section: LLM and Inference · Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

FreshScore 81

promptfoo

Test your prompts, models, RAGs. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality. LLM evals for OpenAI/Azure GPT, Anthropic Claude, VertexAI Gemini, Ollama, Local & private models like Mistral/Mixtral/Llama with CI/CD

In 11 listsDetails

Prompt Engineering Guide

🐙 Guides, papers, lecture, notebooks and resources for prompt engineering

In 11 listsDetails

Phoenix

Open-source AI observability & evaluation platform (Arize) — OpenTelemetry-native tracing for agents, LLM-as-judge evals, versioned datasets & experiments for prompt regression testing, prompt management with version control and replay, plus an MCP endpoint so Claude Code/Cursor can query traces…

In 10 listsDetails

Langfuse

The most widely adopted self-hostable LLM observability platform: traces every agent step, manages prompt versions, and runs evals in one tool. Preferred over cloud-only alternatives when data residency or cost control is a constraint.

In 10 listsDetails

DocsGPT

Private AI platform for building intelligent agents and assistants with enterprise search. Features Agent Builder, deep research tools, multi-format document analysis, and multi-model support. MIT licensed.

In 10 listsDetails

DemoGPT

DemoGPT enables you to create quick demos by just using prompt. It applies ToT approach on Langchain documentation tree.

In 9 listsDetails

unsloth

Fine-tuning & Reinforcement Learning for LLMs. Train OpenAI gpt-oss, DeepSeek-R1, Qwen3, Gemma 3, TTS 2x faster with 70% less VRAM.

In 8 listsDetails

Helicone

Open-source LLM observability proxy (YC W23) with the largest open-source pricing database (300+ models). One-line proxy integration provides cost tracking, token monitoring, session tracing, and prompt versioning across providers. The AI Gateway component handles request routing and caching with…

In 8 listsDetails