Your local model might support a huge context window while Ollama is running it at 4K.
This is a dev post classified by Jev as AI dev tools (a tutorial), kept by the Dev Radar because it carries real work, not commentary.
Your local model might support a huge context window while Ollama is running it at 4K. Ollama’s documented defaults depend on VRAM: • Below 24 GiB: 4K context • 24 to under 48 GiB: 32K • 48 GiB or more: 256K With your model running, enter: ollama ps Check CONTEXT for the allocated window and PROCESSOR for the CPU/GPU split. Those tell you two different things: available context and where the model is running. Ollama recommends at least 64K for agents and coding tools, but increasing it requires more memory. Before switching models, check the configuration you’re actually using. The mode
Posted by Hybrid 🏃🏾 (7.3k followers) 1 h ago · 5 likes · 165 views · view the original post on X. Kept by the Dev Radar as AI dev tools.
More dev work like this
- Transformers has supported loading GGUF files for a few years now, by unquantizing them. — @LysandreJik
- 🚨 THIS IS WHAT JEV LOOKS LIKE IN THE REAL WORLD. — @vicky_grok
- Today we’re launching Freebuff Ads. — @jahooma
- Browserbase (@browserbase) is now available in Merge Agent Handler. — @merge_api
- Long-running coding agents need more than a chat window. — @DanKornas
- Coding agents are great at writing code. Correct Temporal code takes the right context… — @temporalio
- META 🔥: Muse agent is being prepared to get integrations with Telegram, Messenger, and… — @testingcatalog
- Grok 4.7 from SpaceXAI (@SpaceXAI) is now available on Merge. — @shensi
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 20.9k posts from 5k X accounts over the last 21 days, 2.4k tools, 12 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-22 14:12 UTC. Full method.