* model:add Zaya1 8B (Zyphra) - Added the support for Zaya. - Fixed the SSM_CONV case, so the model runs on cuda without abort. Please enter the commit message for your changes. Lines starting * Made the following changes based on the bot reviewer feedback: 1) Added runtime asserts when loading wrong KV head size, unsupported conv kernel size. 2) Removed the static cast usage. 3) Fixed double load of tokenizer. 4) Updated res_scale_in to be input tensor. * - Moved the res_scale_in back to layer 0 to fix the cuda bug * i) Removed the EOS addition.Team agreed that updating Tokenizer is the right move. ii) Fixed formatting * Fixed the comment to make it clear --------- Co-authored-by: varun <varun_subramanian@zyphra.com>
Fusion baselines
Per-device baselines for test-fusion, one CSV per backend (e.g. MTL.csv). Rows are
arch,moe,mode,label,count. Regenerate a CSV whenever fusion patterns change.
Update a baseline
cmake -B build -DCMAKE_BUILD_TYPE=Release -DGGML_METAL=ON # enable the target backend
cmake --build build --config Release --target test-llama-archs --target test-fusion -j
rm -rf build-ci-models && mkdir -p build-ci-models
./build/bin/test-llama-archs -o build-ci-models
./build/bin/test-fusion --models build-ci-models --device MTL0 --record MTL.csv
Validate
./build/bin/test-fusion --models build-ci-models --device MTL0 --check MTL.csv
Non-zero exit means a row differs from the baseline. Use --model FILE to run a single
architecture. --check also reports baseline rows that the run no longer produces, so a fusion
that stops matching fails the run instead of silently dropping out of the CSV.