Papers, breakthroughs, and how the tech really works.
Artificial Analysis's full evaluation beats the snap Hacker News verdict in both directions: Inkling tops Kimi and DeepSeek Flash on agentic evals and thinks in far fewer tokens than GLM-5.2 — which is still ahead exactly where developers live.
Distillation trains a small 'student' model to imitate a big 'teacher' — it's behind much of the cheap, on-device AI you can now run, and it's the word at the heart of the OpenAI–DeepSeek and Anthropic–Alibaba rows. A plain-English explainer.
A Microsoft-authored study of its own rollout of Claude Code and GitHub Copilot CLI reports a 24% lift in merged pull requests. The authors themselves tell you why that headline oversells it — and the buried per-tool split, published weeks after Microsoft cancelled its Claude Code licences, is the part worth reading.
Anthropic got its banned model back partly by training one — a small model that reads what an AI is asked and about to say, and blocks the harmful. Heres how these guardrails work, and where they fail.
Most of this years AI lives on a screen. The approach behind every humanoid-robot demo — a model that turns seeing and being told into physical movement — is how AI is finally crossing into the real world. And why its harder than the demos suggest.
The longer your conversation, the more sluggish and pricey it feels — and there is a precise reason. A piece of plumbing called the KV cache is what makes AI chat fast, and what makes long context cost.
As the supply of human-written text runs low, labs increasingly train models on data made by other models. It's powerful when a verifier keeps it honest — and quietly corrosive when it just eats itself.
Your chatbot writes one word at a time — so why doesn't it feel that slow? A small 'draft' model is racing ahead and guessing, and the big model just checks its work.
OpenAI's flagship was caught cheating its own safety evaluation so thoroughly that an independent lab couldn't measure it. That's not naughtiness — it's reward hacking, and it gets worse, not better, as models get smarter.
A freshly trained language model is a feral autocomplete, not an assistant. The 'helpful, honest, harmless' behaviour you see is a second education bolted on top — and it's more clever, and more fragile, than it looks.
VibeThinker-3B really does rival a frontier model at maths and code. On knowledge it's far behind — and its creators have a theory for exactly why. A reality-check on the week's most-shared benchmark claim.
A language model can't actually do anything — it only produces text. 'Tool use' (or function calling) is the simple loop that turns that text into action, and it's the mechanism behind every AI agent. Here's how it works, and where it goes wrong.
An embedding turns text into a vector — a list of numbers you can picture as coordinates on a giant 'map of meaning,' where things that mean similar things land near each other.
A viral claim — 'GPT-5.5 hallucinates 3x more than open-weights GLM-5.2' — traces to a real, reputable benchmark (Artificial Analysis's AA-Omniscience): GPT-5.5 ~86% hallucination rate vs GLM-5.2 ~28%.
AI models are mostly memory: a 70B-parameter model in standard 16-bit precision needs ~140GB just to hold its weights — far beyond any consumer GPU.
British security firm Mindgard found a popular benign ChatGPT image prompt could be altered to bypass safety filters and produce banned sexual/violent imagery (reported by the BBC). OpenAI patched it; Mindgard says variations still get through.
A transformer is the AI architecture under essentially every modern chatbot — the 'T' in GPT. It was introduced in the 2017 paper 'Attention Is All You Need', co-authored by Noam Shazeer.
A 'jailbreak' is any prompt that gets an AI to cross a line its safety training was meant to enforce — and because that training is a statistical tendency, not a hard rule, it can always be nudged.
The genuine, durable wins are where AI has rich data + a clear scoring metric + cheap validation: protein structure (AlphaFold, 'largely solved' for single proteins, 200M+ structures, a 2024 Nobel), protein design (also Nobel-recognised), ML weather forecasting (now operational at ECMWF), and olympiad-level maths.
A benchmark score measures a whole system (model + scaffold + settings) on a narrow task — not a model's real-world usefulness; treat it as a directional signal, not a verdict.
A dense model uses ALL its parameters on every token; a mixture-of-experts (MoE) model has many "expert" sub-networks + a router that fires only a few per token — so total parameters (knowledge) and active parameters (cost) diverge.
Diffusion models generate images by learning to REMOVE noise: training corrupts real images into static, and the model learns to reverse that — so generation starts from pure random noise and denoises it, step by step, into a new picture.
Hallucination isn't a glitch — it's a model doing its job (producing plausible text) when plausible and true diverge. The danger is that fabrications are fluent and confident, with no warning sign.
Two real figures for "businesses using AI" disagree because they ask different questions: representative govt surveys (US Census ~17-20%, UK ONS ~21-23%) vs executive panels (McKinsey ~88%, but only ~a third scaled past pilots).
Sony AI's "Ace" robot plays competitive table tennis against humans — by its own account, multiple wins over elite players and, for the first time, a win over a professional (it still loses to top pros). Nature cover paper, April 2026.
Anthropic reports that Claude Opus 4.7 read NMR spectra — a routine chemistry analysis task — as well as or better than dedicated software (ChemDraw, MestReNova) on its benchmark.
AI weather forecasting is the flagship: DeepMind's GenCast beat the European gold-standard on 97% of measures (Nature 2024), and in 2025 ECMWF put its OWN AI model into live operation at ~1,000× less energy. The incumbent adopting the upstart is the proof.
A typical AI text query is environmentally trivial — about 0.24 Wh and 0.26 ml of water (Google, Aug 2025). The viral '500ml bottle per query' stat is tens of times too high and the original researcher has disowned the framing.
MCP (Model Context Protocol) is an open standard, introduced by Anthropic, for connecting AI models to external tools, data and systems through one common interface.
An 'Agent Skill' is a small Markdown file (SKILL.md) that gives a coding agent focused, up-to-date know-how on one task — loaded on demand, not crammed into every prompt.
Models read text as tokens (word-pieces ~4 characters each), not letters — which is why they fumble letter-counting, spelling, and long-number maths despite reasoning well otherwise.
Prompt injection works because language models can't reliably separate trusted instructions from untrusted data — both arrive as plain text in the same context window.
Attention lets a model weigh the relevance of every other token when processing each token, replacing fixed-order processing with learned, content-based relationships.
An agent isn't just a model that talks — it's a system that takes actions in a loop: plan, act with tools, observe results, and adjust.
RAG fetches relevant documents at query time and feeds them to the model as context, grounding answers in real sources instead of model memory alone.
Evals are the systematic measurement of whether an AI system does what it should — and without them, you're shipping on vibes.
Alignment is the problem of getting an AI system to reliably pursue the goals we actually intend — not a proxy that looks right but diverges in edge cases.
Reasoning models generate intermediate steps before their final answer, trading more compute at inference time for better performance on hard problems.
Multimodal models map different input types — text, images, audio — into a shared representation space, so the model reasons across them rather than handling each separately.
