Entry

Harbor

Appears in 4 awesome lists

Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI. Apache-2.0 Docker/Shell

Open github.comav/harbor

Found in these lists

Awesome AI Tools

Section: Other · run LLM backends, APIs, frontends, and services with one command

SlowScore 67

Awesome-Selfhosted

Section: Generative Artificial Intelligence (GenAI) · Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI. Apache-2.0 Docker/Shell

FreshScore 94

Awesome AI Agents: Tools, Resources, and Projects

Section: Tools · Effortlessly run LLM backends, APIs, frontends, and services with one command.

SlowScore 68

Awesome Generative AI

Section: Local LLM Deployment · A containerized toolkit for running local LLM backends, UIs, and supporting services with one command. #opensource

FreshScore 90

DemoGPT

DemoGPT enables you to create quick demos by just using prompt. It applies ToT approach on Langchain documentation tree.

In 9 listsDetails

Ollama

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models. (Source Code) MIT Docker/Python

In 8 listsDetails

Local Deep Research achieves ~95% on SimpleQA benchmark (tested with GPT-4.1-mini). Supports local and cloud LLMs (Ollama, Google, Anthropic, ...). Searches 10+ sources - arXiv, PubMed, web, and your private documents. Everything Local.

In 7 listsDetails