AI Model Releases
4 min read

Google DiffusionGemma Tests 1,000-Token Speed

Google’s 10 June DiffusionGemma release opened an experimental 26B MoE that generates text by diffusion at more than 1,000 tokens per second.

AIENGINE

4 min read

Share

On 10 June 2026, Google announced DiffusionGemma. Google used the Gemma programme to test non-autoregressive text generation at unusually high throughput on server and consumer GPUs.

This release brief was checked against first-party material on 10 August 2026. The date above is the public announcement date, not the date a repository was created or a third-party provider added the model. Where access or weights arrived later, that distinction is recorded below.

Release record

FieldVerified detail
Announcement10 June 2026
Availability or weight release10 June 2026 as experimental Apache 2.0 weights
Release typeexperimental open-weight diffusion language model
AccessApache 2.0 checkpoint, model card and local inference guidance
Architecturea 26B-total, roughly 3.8B-active diffusion MoE for parallel text generation
Maximum stated contextthe experimental context limit documented in the model card

What changed

DiffusionGemma challenges the token-by-token assumption behind most language-model serving. Google reported more than 1,000 tokens per second on an H100 and more than 700 on an RTX 5090, with up to a four-times speed advantage in the tested setup. The release is explicit that quality remains below leading autoregressive models, making it a research and latency experiment rather than a drop-in quality upgrade.

The practical comparison is therefore not simply whether DiffusionGemma has the largest headline score. Teams need to ask whether its architecture, access terms, latency, tool behaviour and evaluation setup match the workload they actually intend to run. A model can lead one harness while losing on cost, refusal behaviour, multilingual quality or repeatability in another.

Benchmarks worth retaining

EvaluationReported resultHow to read it
H100 generationmore than 1,000 tokens per secondVendor throughput in the disclosed setup
RTX 5090 generationmore than 700 tokens per secondConsumer-GPU-class throughput claim
Relative speedup to 4× fasterWorkload-specific comparison, not a quality result

These are release-time results, not independently reproduced guarantees. Speed depends on sequence length, denoising steps, hardware and implementation, and Google labels the model experimental with lower quality than its strongest Gemma peers. Scores should remain attached to the disclosed effort setting, agent harness, tool access, timeout, context-management policy and judge model. Moving a number into a procurement sheet without those conditions creates false comparability.

Architecture and access

DiffusionGemma is described as a 26B-total, roughly 3.8B-active diffusion MoE for parallel text generation with the experimental context limit documented in the model card of stated context. Its access position at verification time is Apache 2.0 checkpoint, model card and local inference guidance. That wording matters: open weights, source-available weights, an API, a product preview and a research demonstration give adopters very different rights and different levels of reproducibility.

Before deployment, record the exact model identifier or checkpoint, inference stack, quantisation, reasoning setting, region, price schedule and supplier terms. If the release uses a custom licence, read the licence itself rather than relying on the word “open” in launch copy. If it is API-only, preserve the dated documentation and change-notice route because the served snapshot can change without a downloadable artefact.

What an evaluation should test next

For DiffusionGemma, a credible internal gate should include:

  • a frozen set of representative tasks with pass, fail and abstain criteria;
  • a matched baseline using the same tools, timeout, prompt budget and reviewer rubric;
  • repeated runs to expose variance rather than reporting a single best attempt;
  • latency, token use and total task cost alongside task success;
  • adversarial, multilingual and long-context cases relevant to the real deployment; and
  • rollback evidence showing the previous model can be restored safely.

The wider model change-control guide explains how to keep model, prompt, tool and corpus changes reconstructable. The AI dependency inventory guide covers the release and supplier records needed after deployment.

AIEngine verdict

DiffusionGemma merits coverage as an architectural release, not as a universal replacement. It is best evaluated on bounded generation tasks where latency matters and errors can be checked automatically.

This is a launch assessment, not a certification. Benchmark leadership is useful evidence of where to test; it is not authorization to place the model in a high-impact workflow without domain evaluation, security review and an accountable owner.

Primary sources

Image provenance

Hero image: Google official DiffusionGemma release artwork. The locally served WebP is a crop of the first-party release or model-card asset recorded in the repository provenance manifest.

TaggedGoogleDiffusionGemmaOpen WeightsDiffusion Language ModelModel Release
Work With Us

Interested in implementing this for your business?

We help UK businesses put these ideas into practice. Book a call to discuss your specific situation.