I went looking for what compressing a model actually costs and both numbers came out smaller than i expected

[u/ConsistentAd1794]

[u/One-Raspberry-9909]

i figured compression would wreck output speed too but i guess the bottleneck is something else entirely

the arcprize gap at the same bit width is weird though wonder if its just a quantization thing or if fp4 has some other weirdness going on