Skip to content

Entry

whisper.cpp

Appears in 6 awesome lists

is a high-performance inference of OpenAI's Whisper automatic speech recognition (ASR) model.

Open github.comggerganov/whisper.cpp

Found in these lists

awesome-ChatGPT-repositories

Section: Openai · Port of OpenAI's Whisper model in C/C++

FreshScore 87

Awesome Generative AI

Section: Speech-to-text (STT) and spoken content analysis · Port of OpenAI's Whisper model in C/C++. It can be executed locally.

SlowScore 62

Awesome LLMOps

Section: Large Model Serving · Port of OpenAI's Whisper model in C/C++

ActiveScore 75

Awesome Whisper

Section: Model variants · Port of Whisper in C++.

FreshScore 85

Awesome Privacy

Section: Artificial Intelligence · High-performance inference of OpenAI's Whisper automatic speech recognition (ASR) model.

ActiveScore 84

Table of Contents

Section: Text-To-Speech Synthesis (TTS) · is a high-performance inference of OpenAI's Whisper automatic speech recognition (ASR) model.

SlowScore 61

vLLM

State-of-the-art serving engine with PagedAttention and continuous batching. Currently the fastest production-grade LLM server.

In 11 listsDetails

Flowise

Flowise simplifies the creation of applications leveraging large language models (LLMs) by providing a drag-and-drop interface for customizing AI workflows, offering easy installation, Docker support, development tools, and documentation for integrating various functionalities such as…

In 12 listsDetails

FunASR

industrial-grade ASR toolkit; 170× realtime on GPU, 50+ languages, built-in VAD, punctuation, speaker diarization, and emotion detection. Includes non-autoregressive SenseVoice and LLM-based Fun-ASR-Nano models.

In 9 listsDetails

AutoGPT

AutoGPT provides accessible AI tools for building and using AI agents, offering a comprehensive framework including Forge for agent creation, agbenchmark for performance evaluation, a leaderboard for competition, a user-friendly UI, and CLI for seamless integration and management github | github…

In 10 listsDetails

OpenAI Cookbook

OpenAI's cookbook includes examples of prompt engineering.

In 9 listsDetails

OpenAI Evals

Framework for evaluating LLMs and LLM systems with an open-source registry of 100+ community-contributed benchmarks. MIT licensed.

In 8 listsDetails

shimmy

Python-free Rust inference server with OpenAI API compatibility. Supports GGUF and SafeTensors formats with hot model swap, auto-discovery, and single binary deployment for zero-dependency inference. Apache 2.0 licensed.

In 7 listsDetails

llama.cpp

Ports for inferencing LLaMA in C/C++ running on CPUs, supports alpaca, gpt4all, etc.

In 7 listsDetails