SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

Low Precision Arithmetic Simulation in PyTorch

A script to convert floating-point CNN models into generalized low-precision ShiftCNN representation

Low Precision(quantized) Yolov5

Code for DNN feature map compression paper

JAX Scalify: end-to-end scaled arithmetics

LinearCosine: Adding beats multiplying for lower-precision efficient cosine similarity