Skip to content

Commit

Permalink
add some scripts for downloading a model, starting the program
Browse files Browse the repository at this point in the history
  • Loading branch information
rubyu committed Nov 10, 2024
1 parent 8dc1f27 commit 83e893c
Show file tree
Hide file tree
Showing 3 changed files with 23 additions and 0 deletions.
5 changes: 5 additions & 0 deletions scripts/prepare_turbo.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
from huggingface_hub import snapshot_download

repo_id = "deepdml/faster-whisper-large-v3-turbo-ct2"
local_dir = "faster-whisper-large-v3-turbo-ct2"
snapshot_download(repo_id=repo_id, local_dir=local_dir, repo_type="model")
9 changes: 9 additions & 0 deletions scripts/start-turbo.bat
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
set PATH=%PATH%;C:\Program Files\NVIDIA GPU Computing Toolkit\cudnn-windows-x86_64-8.9.7.29_cuda12-archive\bin
set PATH=%PATH%;C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.6\bin

cd ..
call .venv\Scripts\activate

python whisper_online_server.py --host 0.0.0.0 --port 43007 --task transcribe --model faster-whisper-large-v3-turbo-ct2 --language en --backend faster-whisper --min-chunk-size 1

deactivate
9 changes: 9 additions & 0 deletions scripts/start.bat
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
set PATH=%PATH%;C:\Program Files\NVIDIA GPU Computing Toolkit\cudnn-windows-x86_64-8.9.7.29_cuda12-archive\bin
set PATH=%PATH%;C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.6\bin

cd ..
call .venv\Scripts\activate

python whisper_online_server.py --host 0.0.0.0 --port 43007 --task transcribe --model large-v3 --language en --backend faster-whisper --min-chunk-size 1

deactivate

0 comments on commit 83e893c

Please sign in to comment.