Daniel Bevenius
0ef27309b7
conversion : use original model tensor names in _flush_nvfp4_experts ( #31427 )
...
This commit updates the _flush_nvfp4_experts to take a new parameter
which is a dictionary mapping the key to the original model tensor name.
The motivation for this is that I noticed that the tensor names being
looked up were not the original model tensor names, for example:
```console
model.layers.1.mlp.experts.up_proj.weight
```
But _nvfp4_layer_algo uses the original per-expert names:
```console
(Pdb) p self._nvfp4_layer_algo
{
'backbone.layers.1.mixer.experts.0.up_proj': 'W4A16_NVFP4',
...
```
This means that the lookup will never match for experts and fall back to
_nvfp4_global_algo. If the global algo is W4A16_NVFP4 then this would
go unnoticed, but for a model like
nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4 which is
MIXED_PRECISION, the expert tensors will not get prec_a4=false so they
would use the native W4A4 path on Blackwell even though the original
model tensors declare them as W4A16_NVFP4.
2026-11-03 11:40:51 +01:00
..
2026-11-02 18:37:27 +01:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-09-24 08:57:31 +02:00
2026-08-17 10:15:11 +02:00
2026-11-03 11:40:51 +01:00
2026-10-17 00:07:55 +02:00
2026-10-02 11:56:04 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-10-05 14:02:40 +02:00
2026-11-02 18:37:27 +01:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-10-07 20:07:50 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-10-26 15:52:02 +08:00
2026-10-29 18:14:37 +01:00
2026-08-17 10:15:11 +02:00
2026-08-22 10:35:50 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-10-21 23:26:22 +02:00
2026-10-20 18:33:32 +02:00
2026-09-30 14:20:32 +08:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-10-17 09:14:32 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-10-20 18:54:27 +02:00
2026-09-16 15:18:45 +02:00
2026-09-22 15:04:52 +02:00
2026-09-07 15:20:58 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-10-06 18:42:24 +02:00
2026-09-22 14:38:09 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-10-17 13:00:17 +02:00
2026-08-17 10:15:11 +02:00
2026-10-02 14:56:53 +02:00
2026-10-27 23:36:32 +01:00
2026-10-30 11:52:59 +01:00
2026-08-17 10:15:11 +02:00
2026-10-29 10:13:41 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-10-19 23:01:40 +02:00
2026-10-20 22:48:45 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-09-14 14:04:05 +03:00
2026-10-16 10:20:03 +02:00
2026-09-25 11:15:33 +08:00
2026-10-22 19:22:15 +02:00
2026-09-07 21:10:06 +02:00
2026-10-23 07:31:30 +02:00
2026-10-29 15:43:33 +01:00
2026-06-07 21:41:39 +02:00
2026-08-17 10:15:11 +02:00
2026-10-15 23:27:12 +02:00
2026-10-15 23:27:12 +02:00
2026-08-17 10:15:11 +02:00
2026-10-29 18:14:37 +01:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-05-15 15:18:12 +02:00
2026-10-07 11:34:16 +02:00
2026-08-17 10:15:11 +02:00
2026-11-02 18:39:51 +01:00
2026-10-16 08:56:00 +02:00
2026-10-07 12:57:48 +02:00
2026-10-27 11:49:12 +01:00
2026-10-25 15:23:22 +02:00
2026-10-29 18:14:37 +01:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-10-21 21:54:16 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-10-24 01:09:50 +02:00
2026-09-06 17:43:58 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-10-16 01:46:42 +02:00
2026-10-12 15:01:52 +02:00
2026-10-12 13:39:55 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00
2026-08-17 10:15:11 +02:00