vLLM (@vllm_project) says DiffusionGemma-Jev now runs on vLLM. The server seeds a canvas with a response template, leaves only answer slots noisy, then reads a probability distribution from every slot in a single denoising step—so yes/no, multiple-choice, or scored questions return both an answer and confidence. Upstream PR: vllm-project/vllm#57250.

Key Takeaways

  • ✓DiffusionGemma-Jev is now servable on the vLLM inference stack.
  • ✓Template canvas plus one denoising step yields confidence distributions over structured answers.
  • ✓Fits yes/no, multiple-choice, and scored decision queries that need calibrated probabilities.
🧭

Not enough VRAM? Compare cloud API and self-hosting costs

Compare 40 dev plans & simulate token costs vs $20/mo subscriptions

Action HubReady to adopt this in production?

Benchmark side-by-side against alternatives, or calculate monthly token cost vs subscription break-even.

Up NextGoogle's Gemma team says Gemini 4 Argon wrote vLLM optimizations that speed up gemma-4-E2B-it 2.85x on an A100
Read Now→