LiveUpdated 2026-11-03 18:07 UTC

We got OCRia-1 generating tokens nearly 10× faster on a single B200.

Name: We got OCRia-1 generating tokens nearly 10× faster on a single B200.
Uploaded: 2026-11-03T16:49:05.000Z
Channel: LlamaIndex 🦙
Description: We got OCRia-1 generating tokens nearly 10× faster on a single B200. Getting there meant making much better use of the same GPU. We tuned how OCRia-1 runs for the demands of document parsing, testing every change for both speed and accuracy. Some improvements were only 2–5%. Seventeen smaller…

This is a dev post classified by AGK Intelligence as AI dev tools (a launch), kept by the Dev Radar because it carries real work, not commentary.

We got OCRia-1 generating tokens nearly 10× faster on a single B200. Getting there meant making much better use of the same GPU. We tuned how OCRia-1 runs for the demands of document parsing, testing every change for both speed and accuracy. Some improvements were only 2–5%. Seventeen smaller optimizations later, “just a few percent” starts adding up. Our infrastructure team wrote up what worked, how they tested the changes, and what they learned about making document models run faster. We also plan to contribute some of these optimizations back to the open-source vLLM project. Read the fu

Posted by LlamaIndex 🦙 (122.2k followers) 1 h ago · 9 likes · 1.1k views · view the original post on X. Kept by the Dev Radar as AI dev tools. Tools mentioned: Extract V2.6: Max Effort.

More dev work like this

Supervisor-Skills 这个项目已经攒到 7.9K+ Star，它干的事挺妙——把博导十年攒下的科研、顶会发表和审稿经验，直接"炼"成了一整套 AI Skills。 — @bkdgiffug
YouTube firing on all cylinders. — @rileybrown
Example here of invoking ce-compound after a session didn’t result in any forced docs to… — @trevin
October was a big month for Claude Code 🍁 — @ClaudeDevs
Does your coding agent try to do manual JS Date math for lunisolar holidays? 🌕 — @ChromiumDev
Here are 18 Grokbot @bot templates that will change your life if you operate an agentic… — @PixelRainbowNFT
a local model on one GPU read a 2009 SIGGRAPH paper, grew its trees in 28 minutes, then… — @witcheer
Cache hits are only part of the equation. What matters is their impact on production AI. — @Minio

Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.3k posts from 5k X accounts over the last 21 days, 9.2k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-03 18:07 UTC. Full method.