标签：#openweights

Is the Future of Enterprise AI Local? For the past couple of years, the standard approach to AI has been pure brute force: take the biggest, most expensive cloud-hosted frontier model you can get hold of and throw it at every single problem. But this "one-size-fits-all" approach is not going to last forever. We are approaching a transition phase where the capabilities of local models will soon pass the threshold of "good enough," just as the growing costs of frontier models become impossible for businesses to ignore. Here is why I believe the pendulum is about to swing firmly toward local, controlled hardware. 1. The Looming API Cost vs. Value Reality Check Right now, companies are actively encouraging their staff to jump on the AI bandwagon. But this honeymoon phase will eventually hit a wall. In the near future, businesses are going to start heavily scrutinising the cost-versus-reward ratio of their AI deployments. Consider the typical enterprise token burn: If an engineer is burning through £10,000 worth of tokens each month on API calls, are they actually adding £10,000 worth of value? Or have they just established an expensive new habit to climb the internal AI usage leaderboard? When CFOs eventually demand budget cuts, teams relying entirely on cloud APIs are going to be forced to unlearn those expensive habits overnight, or find alternative options. Beyond raw cost, cloud providers will likely continue introducing workflow friction. We've already seen instances where providers shrink token allowances, enforce dynamic rate-limiting based on the time of day, or push traffic to lower-tier models during peak utilisation. Building your core workflows on a third-party API means you will never truly control the throttle. This is not even considering the data ownership issue, up until now the only powerful models were closed weight and there was not much choice in ownership, however now that open weight models are available that can offer similar performance and can

DeepSeek has previewed its V4 model family, led by a 1.6 trillion-parameter flagship, and made a one-million-token context window the default across all its services. The weights are downloadable and self-hostable, putting frontier-scale long context in reach of smaller labs and individuals without per-token payment to a closed provider. Key facts What: DeepSeek previewed two free-to-download V4 models that can read a million tokens at once, no longer as a premium add-on but as the standard setting. When: 2026-06-29 Primary source: read the source A large language model has no persistent memory. Each time it answers, it re-reads everything in front of it — your question, the conversation so far, any documents you pasted — and that pile of text is the context. The context window is the hard ceiling on how much it can hold at once. For years that ceiling was a few thousand words, then tens of thousands. Pushing it to a million has been possible but expensive, usually sold as a special, pricey tier. DeepSeek's move is to make a million the everyday default. The family comes in two sizes. V4-Pro is the big one — 1.6 trillion parameters in total, but only about 49 billion of them switch on for any given word. That design is called a mixture of experts : instead of running the entire brain for every token, the model routes each piece of text to a small relevant subset of specialists, so it stays affordable to run despite its enormous size. V4-Flash is the smaller, cheaper, faster sibling, meant for everyday chat and quick edits, and DeepSeek says it keeps up with Pro on simpler agent tasks. Making a million-token window affordable comes down to how the model handles its KV cache — the running set of notes it stores about every previous word, which grows steadily the longer the conversation gets. At a million tokens those notes become a mountain of memory, and the model normally has to consult every note for every new word it writes. DeepSeek's approach, which they call sp