perf: STT optimization — distil-large-v3 + 8 threads (2x faster)
- Switched from large-v3 (1.56B) to distil-large-v3 (~756M) — 2x faster transcription - Increased CPU threads from 4 to 8 (Ryzen 5800X3D has 8c/16t) - French language quality preserved (~5% accuracy tradeoff for 2x speed) - Expected pipeline latency: 4-5s total (down from ~15s)
This commit is contained in:
@@ -6,11 +6,11 @@ services:
|
||||
ports:
|
||||
- "8200:8200"
|
||||
environment:
|
||||
- MODEL_SIZE=large-v3
|
||||
- MODEL_SIZE=distil-large-v3
|
||||
- DEVICE=cpu
|
||||
- COMPUTE_TYPE=int8
|
||||
- LANGUAGE=fr
|
||||
- CPU_THREADS=4
|
||||
- CPU_THREADS=8
|
||||
- INACTIVITY_TIMEOUT=300
|
||||
volumes:
|
||||
# Cache pour les modèles (évite de re-télécharger)
|
||||
|
||||
Reference in New Issue
Block a user