Wyoming Whisper STT docker container with Nvidia GPU support for Home-Assistant
https://github.com/rhasspy/wyoming-faster-whisper
docker pull ghcr.io/slackr31337/wyoming-whisper-gpu:latest
Models:
- tiny-int8
- tiny.en
- tiny
- base-int8
- base.en
- base
- small-int8
- small.en
- small
- medium-int8
- medium.en
- medium
- large-v1
- large-v2
- large-v3
- large
- distil-large-v2
- distil-medium.en
- distil-small.en
Environment variables:
MODEL=base-int8 (Name of faster-whisper model to use)
LANGUAGE=en (Default language to set for transcription)
COMPUTE_TYPE=int8 (float16, int8, etc.)
BEAM_SIZE=5 (Size of beam during decoding. 0 for auto)
wyoming-whisper:
image: slackr31337/wyoming-whisper-gpu:latest
container_name: wyoming-whisper
environment:
- MODEL=base-int8
- LANGUAGE=en
- COMPUTE_TYPE=int8
- BEAM_SIZE=5
ports:
- 10300:10300
volumes:
- /path/to/persistent/data:/data
restart: unless-stopped
runtime: nvidia
deploy:
resources:
reservations:
devices:
- driver: nvidia
count: 1
capabilities:
- gpu
- utility
- compute