Whisper.cpp

What is whisper.cpp ?

Whisper.cpp is a high-performance inference of OpenAI’s Whisper automatic speech recognition (ASR) model.

Whisper.cpp Features

• Plain C/C++ implementation without dependencies
• Apple Silicon first-class citizen - optimized via ARM NEON, Accelerate framework, Metal and Core ML
• AVX intrinsics support for x86 architectures
• VSX intrinsics support for POWER architectures
• Mixed F16 / F32 precision
• 4-bit and 5-bit integer quantization support
• Zero memory allocations at runtime
• Support for CPU-only inference
• Efficient GPU support for NVIDIA
• Partial OpenCL GPU support via CLBlast
• OpenVINO Support
• C-style API

Whisper.cpp supported platforms

• Mac OS (Intel and Arm)
• iOS
• Android
• Java
• Linux / FreeBSD
• WebAssembly
• Windows MSVC and MinGW
• Raspberry Pi
• docker

Quick start

First clone the repository:

git clone https://github.com/ggerganov/whisper.cpp.git

Then, download one of the Whisper models converted in ggml format. For example:

bash ./models/download-ggml-model.sh base.en

Now build the main example and transcribe an audio file like this:

# build the main example
make

# transcribe an audio file
./main -f samples/jfk.wav