💥逆天！史诗级魔改！仅需24G内存跑通！Qwen3.8-27B全64层变纯线性注意力，262K长文秒杀级神器来了！
This is a dev post classified by AGK Intelligence as Other (a tool drop), kept by the Dev Radar because it carries real work, not commentary.
💥逆天！史诗级魔改！仅需24G内存跑通！Qwen3.8-27B全64层变纯线性注意力，262K长文秒杀级神器来了！ 原版是48层Gated DeltaNet + 16层全注意力的混合架构。这个自定义版本直接把那16层全注意力也转成Gated DeltaNet，做成100%纯GDN模型！ 核心亮点： 🔹全层线性注意力：彻底干掉KV Cache爆炸，显存几乎不随上下文增长（相关版本262K仅~55GB且不OOM） 🔹逐层蒸馏+LoRA(r32)恢复精度，不是粗暴替换 🔹专为书籍/论文/超长报告设计，英日双语，262K位置嵌入配置好 🔹4bit约17GB（24GB卡可上），bf16约54GB 🔹自定义架构qwen3_5_gdn24，需trust_remote_code=True 快速上手： 1️⃣pip install -U transformers accelerate bitsandbytes 2️⃣加载（4bit）： model = AutoModelForCausalLM.from_pretrained( "summerAIO/Qwen3.8-27B-Longbook27-v2", quantization_config=BitsAndBytesConfig(load_in_4bit=True, bnb_4bit_quant_type="nf4", bnb
Posted by SuSu_酥酥👅 (25.6k followers) 1 h ago · 15 likes · 2k views · view the original post on X. Kept by the Dev Radar as Other. Tools mentioned: qwen3.8-27b-longbook27-v2, qwenputer, qwenpu, chipformer.rv.chat, storyrun.py, qwen3.5-4b-qwenputer.
More dev work like this
- 做 App 演示视频，过去得录屏加剪辑，现在一个工具就够。 — @bkdgiffug
- Pi Network's Ecosystem Just Got a Much Needed Boost — @BSCNews
- 1847 Gaussian Machine Learning. #BigData #Analytics #DataScience #MachineLearning #IoT… — @gp_pulipaka
- GPU Parallel! Accelerated Robotics in Milliseconds. - by Glen Chou - Georgia Institute… — @gp_pulipaka
- Been working on this one specifically for @aijoey 😆 so hopefully it works out for what… — @Mr_WestCoast
- What are you adding to your #GitHubUniverse badge? — @github
- This is the music transcription proofreading app I was building. It lets you compare two… — @aug5thmusic
- Infinity Parser! Document Parsing That Goes Beyond Text Recognition to Understand… — @gp_pulipaka
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.3k posts from 5k X accounts over the last 21 days, 9k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-02 07:01 UTC. Full method.