llama-tts built the mtmd context from mtmd_context_params_default(), which hardcodes 4 threads, and never copied n_threads over, so -t never reach the mtmd side. Copy params.cpuparams.n_threads into mtmd_params.n_threads, as mtmd-cli and the server do; with no -t this now follows the resolved default. Verified: -t 1 now runs single-threaded, -t 4 is unchanged, and the produced WAV is identical. Assisted-by: Claude
llama.cpp TTS
This is a tool to demonstrate audio generation capability in llama.cpp via libmtmd. It was added via PR #26254
Note: this tool used to serve as a demo for OuteTTS, but it was converted to a more model-agnostic tool.
Common usage
Simple usage:
llama-tts -hf ggml-org/Qwen3-TTS-12Hz-1.7B-Base-GGUF -p "Hello world" --output out.wav
Note: it's highly recommended to always provide a speaker reference voice (via --tts-speaker-file); otherwise, the model's performance may be degraded.
Common params:
- Sampling params such as
--top-k,--top-p,--temp, etc.--tempalso sets the temperature of the audio frames for models that support it, without it they use the model default -n <number_of_frames>limits the output length, e.g.-n 500(default: the limit of the model, 512 frames for most models). Note that how many milliseconds each frame represents varies by model--tts-speaker-text(optional) gives the transcript of--tts-speaker-file, some models put it in the prompt (e.g. Fish Audio S2 Pro)- Core inference params such as
-ngl,-b,-ub, etc.
Supported models
See docs/multimodal/tts.md for the list of supported models, their params and GGUF conversion notes.