--- title: "BitNet: How Microsoft's 1-Bit LLM Runs AI on a Laptop CPU" url: https://syntaxradar.com/radar/the-1-bit-llm-revolution-bitnet-b158-ternary-addition-vs-multiplication author: "Abdul Rehman, Lead Systems Architect and Technical Director" publishedAt: 2026-10-25T08:20:00.000Z dateModified: 2026-10-28T18:00:00.000Z category: "#LLM-MODELS" topic: "bitnet" primarySource: https://arxiv.org/abs/2402.17764 summary: "BitNet explained in plain English: how Microsoft's 1.58-bit LLM stores weights as -1, 0 or +1, what it saves in memory and energy, and its real limits." --- # BitNet: How Microsoft's 1-Bit LLM Runs AI on a Laptop CPU **Short answer:** Microsoft's BitNet b1.58 stores every model weight as -1, 0 or +1. Its open 2B4T model uses 0.4 GB of memory, and the bitnet.cpp engine runs it on ordinary CPUs faster and with less energy than standard tools. **Takeaway:** BitNet shows a small AI model can work with three-value weights and run cheaply on a normal CPU, but only at 2 billion parameters so far and only with Microsoft's own software. **Key figures (as reported by the source):** - BitNet b1.58 2B4T memory (excluding embeddings): 0.4 GB - bitnet.cpp speedup on x86 CPUs: 2.37x to 6.17x - bitnet.cpp energy cut on x86 CPUs: 71.9% to 82.2% BitNet is Microsoft's attempt to make AI language models far smaller and cheaper to run by storing each of their billions of internal numbers as just -1, 0 or +1. A normal model keeps those numbers as detailed decimals. Microsoft's researchers report that the stripped-down version can match a normal model of similar size on quality while using a fraction of the memory and energy. That matters because memory and electricity are what keep capable AI locked inside data centers. If a model needs far less of both, it can run on the laptop you already own, without a graphics card. By the end of this piece you will know what BitNet actually is, why it is called "1.58-bit", what Microsoft has measured (and what it has not), and whether you can try it today. ### What is BitNet LLM, in plain English? An LLM (large language model) is the kind of AI behind chatbots. Under the hood it is a huge grid of numbers called weights. A weight is a dial that says how strongly one piece of the model should influence another. Training is the process of turning billions of those dials until the model writes useful text. In most models each dial is stored as a 16-bit number, a format with fine-grained decimal values. BitNet throws that precision away. In the [February 2024 paper "The Era of 1-bit LLMs"](https://arxiv.org/abs/2402.17764), Microsoft Research describes BitNet b1.58, a model in which every weight is one of three values: -1, 0 or +1. Think of it like a volume knob replaced by a three-way switch: turn this signal down, ignore it, or turn it up. You lose nuance on each individual switch. The bet is that with billions of switches, the model as a whole still learns what it needs. One detail is easy to miss. These models are trained this way from the start. They are not normal models squeezed down after training, which is the more common shortcut and usually costs quality. ### How does BitNet work, and why is it faster? The expensive part of running an LLM is multiplication. Every word the model produces requires multiplying the incoming data by millions of weights, then adding the results together. Multiplying decimals takes more chip area and more power than adding them. When every weight is -1, 0 or +1, those multiplications mostly disappear. Multiplying by +1 means keep the number. Multiplying by -1 means flip its sign. Multiplying by 0 means skip it. What is left is mostly addition and subtraction, which chips do cheaply. The 2024 paper puts a number on this: it estimates that the arithmetic energy for this core step is 71.4 times lower than in a 16-bit model, based on an energy model for 7-nanometer chips. That is an estimate of one operation, not a measurement of a whole computer, so treat it as a ceiling on the savings rather than what your power meter will show. The second win is memory. A three-value weight takes roughly a tenth of the space of a 16-bit one. Smaller weights mean the model fits in less memory and less data has to move between memory and the processor, which is often the real speed limit for chatbots. (If you want the other half of that memory story, our explainer on the [KV cache](/radar/kv-cache-explained-cloudflare-prompt-leak) covers the working memory a model builds up while it talks.) ![A software engineer at a wooden desk running an AI chatbot on a thin laptop with no external graphics card, a 1-bit LLM test in progress](/uploads/blog/the-1-bit-llm-revolution-bitnet-b158-ternary-addition-vs-multiplication/gemini-supporting.jpg) ### Why is ternary 1.58 bits? "Ternary" just means three possible values. A computer bit can hold two values, so how much information do three values carry? The answer is the base-2 logarithm of 3, which is about 1.58. That is where the name BitNet b1.58 comes from. The history explains the odd label. Microsoft's [first BitNet paper in October 2023](https://arxiv.org/abs/2310.11453) used true 1-bit weights that could only be -1 or +1. The 2024 version added 0 as a third option, so the model can switch a connection off entirely. The paper credits that zero with better results, and the "1-bit LLM" nickname stuck even though the precise figure is 1.58. In practice the weights are packed into memory slots of 2 bits or so, so the real storage is a little above 1.58 bits per weight. The headline number describes information, not the exact bytes on disk. ### Is BitNet as good as a normal model? What Microsoft measured There are two sets of results, and they answer different questions. The 2024 paper trained a ternary model and a standard model of matching size from the same recipe. At 3 billion parameters (a parameter is one weight), the paper reports the ternary model matched the standard model's quality while using 3.55 times less GPU memory and running 2.71 times faster. At 70 billion parameters it reports a 4.1 times speedup than the standard baseline. These were research comparisons on GPUs, and Microsoft did not release those particular research models. The more useful result for most readers came in April 2025, when Microsoft released [BitNet b1.58 2B4T](https://arxiv.org/abs/2504.12285): about 2 billion parameters, trained on 4 trillion tokens (a token is a word or piece of a word). The technical report compares it with popular small open models on a Surface Laptop Studio 2 with an Intel Core i7-13800H processor.
ModelMemory (excluding embeddings)Time per word on CPUEstimated energy per wordAverage benchmark score
BitNet b1.58 2B4T0.4 GB29 ms0.028 J54.19
Qwen2.5 1.5B2.6 GB65 ms0.347 J55.23
Llama 3.2 1B2 GB48 ms0.258 J44.90
Gemma 3 1B1.4 GB41 ms0.186 J43.74
Source: BitNet b1.58 2B4T Technical Report, Table 1. Energy is estimated from an arithmetic model, not measured at the wall. Read that table honestly. Microsoft's model uses about a sixth of Qwen2.5's memory and answers in under half the time, yet Qwen2.5 still scores slightly higher on average. So the claim is not "1-bit beats everything". It is "1-bit gets close to the best models its size at a much lower running cost". ![A woman in a quiet library reading answers from an open-weight BitNet model on an older laptop, coffee cup beside the keyboard](/uploads/blog/the-1-bit-llm-revolution-bitnet-b158-ternary-addition-vs-multiplication/gemini-supporting.jpg) ### What is bitnet.cpp, and can BitNet run on a CPU? Here is the catch that most headlines skip. Standard AI software does not know how to run three-value weights efficiently. The [model card on Hugging Face](https://huggingface.co/microsoft/bitnet-b1.58-2B-4T) warns readers not to expect efficiency gains if they load the model with the usual transformers library. To get the speed, you have to use Microsoft's own engine. That engine is [bitnet.cpp](https://github.com/microsoft/BitNet), an open-source program for running these models on ordinary processors (CPUs) rather than graphics cards. Microsoft says it is 1.37 to 5.07 times faster on ARM chips (the kind in Apple Silicon Macs and most phones) and 2.37 to 6.17 times faster on x86 chips (most Windows laptops). It reports energy cuts of 55.4% to 70.0% on ARM and 71.9% to 82.2% on x86. Those are comparisons against llama.cpp, a popular tool for running models locally, at the same model sizes. They come from the [bitnet.cpp technical report](https://arxiv.org/abs/2410.16144), tested on an Apple M2 Ultra Mac Studio and an Intel Core i7-13700H laptop. You may also have seen the claim that bitnet.cpp runs a 100-billion-parameter model on a single CPU at 5 to 7 words per second, roughly human reading speed. That is in Microsoft's README, but the technical report says the large models it tested were "dummy setups" used to measure speed. No trained 100B model has been released. The best result in the report, 6.58 tokens per second, was on the Apple M2 Ultra; the Intel laptop managed 1.70. The repo has kept moving. Microsoft added a GPU engine in May 2025, and in January 2026 it said a CPU update brought a further 1.15 to 2.1 times speedup. ### Is BitNet open source, and can you use it today? Yes. The 2B4T model weights and code are released under the MIT license, one of the most permissive open-source licenses, and you can download them from Hugging Face. If you are new to the idea of downloadable models, our guide to [open-weight models](/radar/open-weight-models-explained-ibm) explains what you can and cannot do with them. Before you get excited, note the limits Microsoft lists itself: - **It is small.** Two billion parameters is far from the size of the chatbots most people use, and it is mostly English. - **It has a short memory.** The model handles at most 4,096 tokens of context, a few pages of text. - **It is a research release.** The model card advises against using it in commercial or real-world products without further testing. - **It needs the right software.** The efficiency gains only appear with bitnet.cpp or Microsoft's custom GPU kernels. Other groups have built on the idea. The bitnet.cpp repo lists community 1-bit LLM models such as the Falcon3 and Falcon-E families from the Technology Innovation Institute, alongside Microsoft's own. ### What to watch next The open question is scale. Microsoft has shown a 2-billion-parameter model that holds its own against similar-sized models. Its own technical report names training larger native 1-bit models as future work. Until someone releases a trained 30B or 70B ternary model, the big claims remain projections. The second thing to watch is hardware. The 2B4T report notes that today's graphics cards are not built for 1-bit math, and the 2024 paper argues for chips designed around it. If chipmakers take that up, the savings could grow well beyond what software alone delivers. For now, this project is the clearest evidence that AI models do not need detailed numbers to be useful. If you have a recent laptop, you can try it yourself today. ## Frequently asked questions ### What is BitNet in simple terms? BitNet is a family of AI language models from Microsoft Research that store each internal weight as -1, 0 or +1 instead of a detailed decimal number. That makes the model much smaller and turns most of its math into simple addition, so it can run on an ordinary laptop processor while staying close in quality to normal models of the same size. ### Why is it called 1.58-bit and not 1-bit? Each weight can take three values, and the information in three options is the base-2 logarithm of 3, about 1.58 bits. Microsoft's first BitNet paper in 2023 used true 1-bit weights of -1 or +1. The 2024 version added zero so the model can switch connections off, which gave the b1.58 name. ### Can I run BitNet on my own computer? Yes. Microsoft's BitNet b1.58 2B4T model is free on Hugging Face under the MIT license and runs on normal CPUs with the open-source bitnet.cpp engine. You must use bitnet.cpp or Microsoft's GPU kernels to get the speed and memory savings, because the standard transformers library gives no efficiency gain, according to the model card. ### Can BitNet really run a 100B model on one CPU? Microsoft's bitnet.cpp report measured speed for a 100-billion-parameter BitNet setup, reaching 6.58 tokens per second on an Apple M2 Ultra. But the report calls those test models dummy setups, used only to measure speed. No trained 100B BitNet model has been released, so the largest model you can actually use is about 2 billion parameters. ## Source Based on Microsoft Research's BitNet papers and repo. https://arxiv.org/abs/2402.17764 --- Published on SyntaxRadar (https://syntaxradar.com). Canonical URL: https://syntaxradar.com/radar/the-1-bit-llm-revolution-bitnet-b158-ternary-addition-vs-multiplication. Last modified 2026-10-28T18:00:00.000Z.