[AINews] Silicon Valley gets Serious about Services

AI News Recap: Silicon Valley Gets Serious

Key Highlights:

1. Gemma 4 MTP Release:

   • Google released Multi-Token Prediction (MTP) drafter checkpoints for Gemma 4, with Hugging Face model cards for various sizes.
   • The MTP setup adds a smaller/faster draft model for speculative decoding, aiming to provide up to 2x decoding speedups while preserving output quality.

2. Llama.cpp MTP Support:

   • Llama.cpp now has beta support for Multi-Token Prediction (MTP) via PR #22673.
   • This feature targets Qwen3.x models and aims to improve token-generation throughput, especially for dense models.

Detailed Breakdown:

1. Gemma 4 MTP Release

• Activity: 1116
• Google released Multi-Token Prediction (MTP) drafter checkpoints for Gemma 4 with Hugging Face model cards for:
  • gemma-4-31B-it-assistant
  • gemma-4-26B-A4B-it-assistant
  • gemma-4-E4B-it-assistant

Read the full article at Latent Space

---

Want to create content about this topic? Use Nemati AI tools to generate articles, social posts, and more.