Awesome LLM Resources
Section: 知识库 RAG · RAG AutoML tool for automatically finding an optimal RAG pipeline for your data.
FreshScore 87
Entry
AutoRAG
Appears in 5 awesome lists
RAG AutoML tool for automatically finding optimal RAG pipelines. Evaluates and optimizes retrieval-augmented generation with AutoML-style automation for your own data and use-case. Apache 2.0 licensed.
Open github.commarker-inc-korea/autorag
Found in these lists
Awesome LLMOps
Section: AutoML · AutoML tool for RAG - Boost your LLM app performance with your own data
ActiveScore 75
Awesome Open Source AI
Section: 9. Evaluation, Benchmarks & Datasets · RAG AutoML tool for automatically finding optimal RAG pipelines. Evaluates and optimizes retrieval-augmented generation with AutoML-style automation for your own data and use-case. Apache 2.0 licensed.
FreshScore 89
Awesome Production Machine Learning
Section: Industry Strength Information Retrieval · AutoRAG is a RAG AutoML tool for automatically finds an optimal RAG pipeline for your data.
FreshScore 92
awesome-python
Section: LLM and Inference · AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.
FreshScore 81
Often listed next to it
Dify
February 2026 release making human oversight a native workflow primitive: suspend execution at critical decision points, expose review-and-edit UI mid-flow, and route subsequent execution based on human action (approve/reject/escalate). Demonstrates how HITL transitions from bolt-on approval gates…
In 14 listsDetails
DeepEval
The most complete open-source LLM/agent eval framework: 20+ built-in metrics (hallucination, answer relevancy, RAGAs, tool correctness), pytest integration, and a CI-friendly runner. Removes the need to hand-roll eval infrastructure when you need structured, repeatable agent quality gates.
In 9 listsDetails
Optuna
Optuna is an automatic hyperparameter optimization software framework, particularly designed for machine learning.
In 8 listsDetails
OpenAI Evals
Framework for evaluating LLMs and LLM systems with an open-source registry of 100+ community-contributed benchmarks. MIT licensed.
In 8 listsDetails
AnythingLLM
Open-source ChatGPT equivalent experience for both open and close source LLMs, embedders, and vector databases. Supports unlimited documents, threads, and concurrent users and management all in a very clean UI.
In 8 listsDetails
LM Evaluation Harness
Language Model Evaluation Harness is a framework to test generative language models on a large number of different evaluation tasks.
In 7 listsDetails
RAGFlow
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
In 7 listsDetails
DB-GPT
DB-GPT GraphRAG integrates both triplet-based knowledge graphs and document structure graphs while leveraging community and document retrieval mechanisms to enhance RAG capabilities, achieving comparable performance while consuming only 50% of the tokens required by Microsoft's GraphRAG. Refer to…
In 7 listsDetails