给 RAG 或 Agent 准备网页数据，还在手动清洗 HTML？
This is a dev post classified by AGK Intelligence as AI dev tools (a tool drop), kept by the Dev Radar because it carries real work, not commentary.
给 RAG 或 Agent 准备网页数据，还在手动清洗 HTML？ AnakinScraper OSS 提供了一个自托管抓取接口，一次请求即可将网页转成 Markdown 或结构化 JSON。 它会根据页面难度切换抓取方式：优先普通 HTTP，复杂页面再启用 Camoufox，必要时调用外部接口，还能自动优化代理选择。 支持同步、异步和批量任务，附带 Web 管理面板，本地通过 make up 即可启动。 适合需要持续采集网页、又不想反复编写清洗逻辑的 AI 项目。 GitHub：https://github.com/Anakin-Inc/anakin
Posted by lumxss (34.8k followers) 23 min ago · 0 likes · 55 views · view the original post on X. Kept by the Dev Radar as AI dev tools. Tools mentioned: anakin.
More dev work like this
- Put your RTX 50-series GPU to work as a local AI server. — @DanKornas
- My @opencode subagent router v0.3.0 is live! — @JacobWolf
- apple made a claude code plugin 👀 — @argofowl
- Strata update! An RTX 3060 12GB got 3× faster at processing Qwen3.8-Flash-Next prompts. — @TeksEdge
- AI 工程学了不少，想真正上手，还是得看能运行的项目。 — @bkdgiffug
- It's so funny. I was just vibe coding this game to test GPT-Image-2.6, and after just… — @alexcooldev
- 💥炸了！本地跑Qwen 3.8新巅峰！tqLLM 1.4.4碾压TensorFold/Strata/Splash，27B & Flash-Next速度起飞，Qwen… — @NFT_Chen
- Meet Arete-27B: a fine-tuned Qwen3.5 model built for value alignment and rich… — @HuggingModels
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.8k posts from 5k X accounts over the last 21 days, 9.6k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-07 21:22 UTC. Full method.