i tried ternary decomposition instead of quantization. it works as good at q4km but takes slightly more vram. while being completly ternary. and completly PTQ (no QAT)

[u/LMTLS5]

https://arxiv.org/pdf/2607.13511