1-Bit Model

What is a 1-bit model?

A highly compressed large language model natively trained with binary or ternary values instead of standard 16-bit precision, reducing memory and energy use while maintaining capability.