今日已更新 420 条资讯 | 累计 20392 条内容
关于我们

A free model that runs 4x faster on your own GPU — and two more shifts for builders

danio 2026年06月11日 21:00 4 次阅读 来源:Dev.to

A free model that runs 4x faster on your own GPU — and two more shifts for builders Three things landed for builders at once: a free open model that generates text far faster, a more autonomous Codex, and Anthropic owning up to a model that was quietly holding back. Two of them you can act on right now. Here's the 2-minute video version if you want the quick pass first: 1. Google shipped DiffusionGemma — a free open model that runs 4x faster Google released DiffusionGemma , an open-weights model that uses text diffusion instead of standard autoregressive decoding. Instead of generating one token at a time, it generates whole blocks in parallel. It writes blocks of 256 tokens at once , for up to 4x faster generation on a dedicated GPU. It hits 700+ tokens per second on a single RTX 5090 , and fits in 18GB of VRAM quantized — inside consumer GPU limits. It's a 26B Mixture-of-Experts (only 3.8B parameters active), ships under Apache 2.0 , and runs natively in vLLM . The tradeoff Google states openly: output quality is lower than standard Gemma 4, so it's a speed play, not a quality play. Why it matters: this is a fast, free, local draft model you can run on your own hardware. Use it for low-latency drafts and agent loops, then route the hard calls to a stronger model. No inference bill for the cheap 80%. 2. OpenAI gave Codex web search and autonomous goals OpenAI shipped a major Codex update that pushes it further toward an autonomous agent. Code mode can now call web search directly , even from nested JavaScript tool calls — so it can look up current API docs mid-implementation. Goal mode is generally available across the Codex app, the IDE extension, and the CLI. Appshots (macOS) attach an app window to a Codex thread with a hotkey, and MCP tool schemas now preserve oneOf / allOf for richer connectors. Why it matters: Codex can research and chase a goal on its own across every surface. Still — hand it a clear, scoped goal in a branch. Full hand-offs go sideways witho

本文内容来源于互联网,版权归原作者所有
查看原文