Files
llama.cpp/tests/fusion
varunandvarun 98d67c8d53 model:add Zaya1 8B (Zyphra) (#32071)
* model:add Zaya1 8B (Zyphra)
- Added the support for Zaya.
- Fixed the SSM_CONV case, so the model runs on cuda without abort.

 Please enter the commit message for your changes. Lines starting

* Made the following changes based on the bot reviewer feedback:
1) Added runtime asserts when loading wrong KV head size, unsupported conv kernel size.
2) Removed the static cast usage.
3) Fixed double load of tokenizer.
4) Updated res_scale_in to be input tensor.

* - Moved the res_scale_in back to layer 0 to fix the cuda bug

* i)  Removed the EOS addition.Team agreed that updating Tokenizer is the right move.
ii) Fixed formatting

* Fixed the comment to make it clear

---------

Co-authored-by: varun <varun_subramanian@zyphra.com>
2026-11-18 15:46:49 +01:00
..
2026-11-18 15:46:49 +01:00

Fusion baselines

Per-device baselines for test-fusion, one CSV per backend (e.g. MTL.csv). Rows are arch,moe,mode,label,count. Regenerate a CSV whenever fusion patterns change.

Update a baseline

cmake -B build -DCMAKE_BUILD_TYPE=Release -DGGML_METAL=ON   # enable the target backend
cmake --build build --config Release --target test-llama-archs --target test-fusion -j

rm -rf build-ci-models && mkdir -p build-ci-models
./build/bin/test-llama-archs -o build-ci-models

./build/bin/test-fusion --models build-ci-models --device MTL0 --record MTL.csv

Validate

./build/bin/test-fusion --models build-ci-models --device MTL0 --check MTL.csv

Non-zero exit means a row differs from the baseline. Use --model FILE to run a single architecture. --check also reports baseline rows that the run no longer produces, so a fusion that stops matching fails the run instead of silently dropping out of the CSV.