* tests : update the Metal fusion baseline Re-record the MTL fusion baseline with the current build: 276 rows over 131 dummy models. Assisted-by: pi:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB) * tests : fail test-fusion when a baseline row stops matching The report was built from the counters the run produced, and the baseline was only ever used as a lookup table, so a fusion that stopped matching produced no row and was never compared. qwen4exp and mellum lost their fusions this way while the Fusion / metal job stayed green. Report a baseline row that the run does not reproduce as a regression. Scope the pass to the arches that were actually run so --model keeps working. Assisted-by: pi:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB) * pi : never write inline comments unless the user asks Assisted-by: pi:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB) * tests : keep the mellum dummy model softmax-gated mellum reads expert_gating_func from the GGUF since #30578, while the fixture writes sigmoid for every MoE arch, so the Mellum dummy model stopped building the softmax MoE routing fusion. Write softmax for mellum, matching the arch default and the GGUFs that conversion/mellum.py produces. Re-record the MTL baseline: the routing row is back, 277 ok / 0 failed. Assisted-by: pi:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB) * pi : use emoji in the AI stats disclosure Assisted-by: pi:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB) * pi : list the disclosure model after the hardware Assisted-by: pi:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB) * pi : use monochrome symbols in the AI stats disclosure Assisted-by: pi:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB) * tests : add muse-spark to the Metal fusion baseline Assisted-by: pi:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB)
27 lines
942 B
Markdown
27 lines
942 B
Markdown
# Fusion baselines
|
|
|
|
Per-device baselines for `test-fusion`, one CSV per backend (e.g. `MTL.csv`). Rows are
|
|
`arch,moe,mode,label,count`. Regenerate a CSV whenever fusion patterns change.
|
|
|
|
## Update a baseline
|
|
|
|
```sh
|
|
cmake -B build -DCMAKE_BUILD_TYPE=Release -DGGML_METAL=ON # enable the target backend
|
|
cmake --build build --config Release --target test-llama-archs --target test-fusion -j
|
|
|
|
rm -rf build-ci-models && mkdir -p build-ci-models
|
|
./build/bin/test-llama-archs -o build-ci-models
|
|
|
|
./build/bin/test-fusion --models build-ci-models --device MTL0 --record MTL.csv
|
|
```
|
|
|
|
## Validate
|
|
|
|
```sh
|
|
./build/bin/test-fusion --models build-ci-models --device MTL0 --check MTL.csv
|
|
```
|
|
|
|
Non-zero exit means a row differs from the baseline. Use `--model FILE` to run a single
|
|
architecture. `--check` also reports baseline rows that the run no longer produces, so a fusion
|
|
that stops matching fails the run instead of silently dropping out of the CSV.
|