Bits of π
Ollama drops three-quarters of a model's bits by default. Squeezing an image that hard yields garbage, yet 4-bit quants retain 95% accuracy. A 64-build experiment showing how block scales and mixed precision work—and why the loss lands on tokens the model was never sure about, starting at digit 813 of π.