arXiv.org
arXiv.org is Model quantization has become essential for efficient large language model deployment, yet existing approaches present clear trade-offs: methods such as GPTQ and AWQ achieve practical compression but are lossy, while…. It is ranked #601 on the Dev Radar, in Other, first seen 9 days ago and shared in 4 posts (86k views).
[2605.02404] Statistically-Lossless Quantization of Large Language Models Skip to main content Search Search arXiv Press Enter to search · Advanced search --> Computer Science > Machine Learning arXiv:2605.02404 (cs) [Submitted on 4 May 2026 ( v1 ), last revised 9 Aug 2026 (this version, v2)] Title: Statistically-Lossless Quantization of Large Language Models Authors: Michael Helcig , Eldar Kurtic , Dan Alistarh View a PDF of the paper titled Statistically-Lossless Quantization of Large Language Models, by Michael Helcig and 2 other authors View PDF HTML (experimental) Abstract: Model quantization has become essential for efficient large…
What people said about arXiv.org on X
Introducing statistically-lossless Qwen3.8-27B! Three models, 23.7–30.5 GB: up to 57% smaller weights than BF16. 98–99% measured EAR, versus 97.71% for native FP8. EAR measures overlap with BF16’s next-token probabilities. A 99% EAR means 99% average probability overlap, here, measured over the reference’s top-10…
— @bnjmn_marie, 9 days ago · 791 likes · see the post
Statistically-lossless Qwen3.8-27B 👀 We are going to get new quant's for Qwen3.8-27B ! This looks better than GSQ-RSO as well. Link to collection: https://huggingface.co/collections/kaitchup/qwen38-27b-slq
— @ItsmeAjayKV, 8 days ago · 299 likes · see the post
These models are receiving a lot of love. The GGUF versions I'm making now are even more promising: much lower size for the same target EAR. That's mainly because they use smaller group sizes, which makes the quantization more accurate. For the humming-compatible versions I already released, I mainly tried a group…
— @bnjmn_marie, 7 days ago · 74 likes · see the post
Alternatives to arXiv.org
- Step-5-Preview — Join the countdown
- Google — Argon is rolling out today to Google Ultra and Pro subscribers in the @GeminiApp and Search, and Ultra subscribers in…
- nanbeige4.3-33b — We’re on a journey to advance and democratize artificial intelligence through open source and open science.
- Spark-X2.5 — Healthcare-focused AI just got a little lighter. Same powerful reasoning, less memory to worry about. 🤖
- anymove — Open source
- Ideogram — Live in Ideogram and the API
arXiv.org in numbers
- Rank on the Dev Radar: #601 of 8801
- Shared in 4 posts by 3 accounts: @bnjmn_marie, @ItsmeAjayKV, @u1tra_instinct
- 86k views on those posts
- First seen 9 days ago, last shared 7 days ago
- Pricing seen by AGK Intelligence: free
- Market: Other
FAQ
What is arXiv.org?
Model quantization has become essential for efficient large language model deployment, yet existing approaches present clear trade-offs: methods such as GPTQ and AWQ achieve practical compression but are lossy, while… It was first shared on X 9 days ago and is ranked #601 on the Dev Radar.
Is arXiv.org free?
Yes, it is free to use.
Who shared arXiv.org?
3 accounts on X, including @bnjmn_marie, @ItsmeAjayKV, @u1tra_instinct, in 4 posts totalling 86k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.2k posts from 5k X accounts over the last 21 days, 8.8k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-10-30 21:12 UTC. Full method.