But it sets itself apart from previous research by being "the first open-source, native 1-bit LLM trained at scale," resulting in a 2 billion token model based on a training dataset of 4 trillion ...

Microsoft Releases Largest 1-Bit LLM, Letting Powerful AI Run on Some Older Hardware Your email has been sent Microsoft’s model BitNet b1.58 2B4T is available on Hugging Face but doesn’t run ...