depth-hybrid-attention
depth-hybrid-attention is Project overview & code. It is ranked #225 on the Dev Radar, in Other, first seen 3 h ago and shared in 1 post (3.4k views).
What depth-hybrid-attention says about itself
Contribute to Nanbeige/Depth-Hybrid-Attention development by creating an account on GitHub.
GitHub - Nanbeige/Depth-Hybrid-Attention · GitHub Skip to content Navigation Menu Sign in Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation Depth-Hybrid-Attention Public Notifications You must be signed in to change notification settings Fork 1 ( 1 ) Star 9 ( 9 ) You must be signed in to star a repository About No description, website, or topics provided. Resources Readme…
What people said about depth-hybrid-attention on X
We introduce Depth Hybrid Attention (DHA), which incorporates depth-wise value mixing into hybrid architectures with very little additional compute and cache overhead. By allowing layers to mix information across depth, DHA broadens each layer’s view and increases the model’s expressive capacity. Our DHA method…
— @nanbeige, 3 h ago · 88 likes · see the post
Alternatives to depth-hybrid-attention
- deepseek-v4.1-flash-1017-gguf — Image-Text-to-Text model with 748B parameters. Download, explore files and run it on Hugging Face.
- modelscope.ai — 📄 Technical report
- deepseek-v4.1-flash-1017-uncensored-gsq-rco-gguf — Text Generation model with 552B parameters. Download, explore files and run it on Hugging Face.
- numbat — Machine learning model with 6.8T parameters. Download, explore files and run it on Hugging Face.
- nanbeige4.3-33b — We’re on a journey to advance and democratize artificial intelligence through open source and open science.
- lm_understand-logs — Complete logs of the experiments in the blog post 'LLMs can understand and write neural network weights' -…
depth-hybrid-attention in numbers
- Rank on the Dev Radar: #225 of 9127
- Shared in 1 post by 1 account: @nanbeige
- 3.4k views on those posts
- First seen 3 h ago, last shared 3 h ago
- Pricing seen by AGK Intelligence: open source
- Market: Other
FAQ
What is depth-hybrid-attention?
Project overview & code It was first shared on X 3 h ago and is ranked #225 on the Dev Radar.
Is depth-hybrid-attention free?
It is open source.
Who shared depth-hybrid-attention?
1 account on X, including @nanbeige, in 1 post totalling 3.4k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.4k posts from 5k X accounts over the last 21 days, 9.1k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-03 14:27 UTC. Full method.