Skip to content
https://abc.microfintool.com/

Mobile & Accessories

Smartphone Reviews, Specs, Comparisons & Electronics Guides

  • Welcome to ABC Tool: Your Ultimate Portal for Smartphones and Accessories
  • PRIVACY POLICY
  • Blog
  • Contact
Google’s latest trick gets Gemma 4 running 3x faster right on your phone

Google’s latest trick gets Gemma 4 running 3x faster right on your phone

Posted on May 6, 2026October 10, 2026 By Muhammad Safdar No Comments on Google’s latest trick gets Gemma 4 running 3x faster right on your phone
Blog

Everything you need to know about google latest trick gets gemma 4.

[ad_1]

TL;DR

  • Google has introduced new assistant models, called “drafters,” that could significantly speed up Gemma 4.
  • Drafters work by predicting sections of prompts to the main model, which can focus on processing them in bigger batches.
  • This allows the model to use the memory and the compute more efficiently.

Google’s recently launched Gemma 4 edge AI models are especially designed to run locally on consumer-hosted hardware. While favorable from a privacy standpoint, local models can easily hog resources and slow down results, rendering them ineffective. So, Google is now offering a potential solution, which it claims can speed up Gemma 4 models by up to three times.

Google recently released Multi-Token Prediction (MTP) drafters for Gemma 4. These drafters are essentially smaller, assistive models that help the primary model by “predicting” part of the user’s request. These smaller models also work in parallel to the main model to manage the compute more effectively.

Don’t want to miss the best from Android Authority?

google preferred source badge light@2x
google preferred source badge dark@2x

How does MTP improve Gemma 4?

The process uses a technique called “Speculative Decoding,” in which the drafter models predict upcoming words in the prompt even before the main Gemma model has read through it. While the drafter moves on to the next sequence of words, the main model verifies the predicted set of words at the same time.

If the model accepts the drafted version, it moves on to verify the next set. If it disagrees, it replaces the incorrect word or chunk.

While the extra work may sound counterintuitive, it’s actually not. Let me give you an oversimplified explanation of why MTP works.

The speed of processing is not just determined by the processing hardware (typically GPU cores) but by the memory bandwidth (VRAM). That’s because the model has to be referenced with each new request. So, by combining multiple words into a single chunk, the model must be referenced only once rather than multiple times, thus, shifting the load from the memory to the processing unit.

In addition to making these changes, Google says it is also working to optimize Gemma 4 models of different weights for specific hardware, such as the Apple Silicon or the popular Nvidia A100.

The MTP drafters for Gemma 4, alongside the primary model, can use platforms such as HuggingFace or Kaggle, tools like Ollama, or through Google’s own AI Edge Gallery on Android or iOS.

Thank you for being part of our community. Read our Comment Policy before posting.


[ad_2]
Source link

More on google latest trick gets gemma 4

Stay tuned for updates on google latest trick gets gemma 4 as the story develops. Related: 1,700 Free Online Courses from Top Universities.

Frequently Asked Questions

What are Google's drafters for Gemma 4?

New assistant models using Multi-Token Prediction that predict sections of prompts so the main Gemma 4 model can process them in bigger batches, using memory and compute more efficiently.

How much faster can drafters make Gemma 4?

Google claims the technique can speed up Gemma 4 models by up to three times.

What is speculative decoding?

The technique behind MTP drafters: smaller models predict upcoming words before the main model reads them, while the main model verifies the predictions in parallel. If accepted, it moves on to the next sequence.

Why do on-device AI models need this speedup?

Gemma 4 edge AI models are designed to run locally on consumer hardware for privacy, but local models can hog resources and slow down results, rendering them ineffective without optimization.

Views: 63
Tags: Google News

Post navigation

❮ Previous Post: A new leak says Apple’s all-screen iPhone may ditch buttons too
Next Post: The Boring Internet | Terry Godier ❯

You may also like

RugOne Xlink 7 hands-on review
Blog
RugOne Xlink 7 hands-on review
June 22, 2026
‘Euphoria’ Season 3 Release Schedule: When Does Episode 3 Come Out?
Blog
‘Euphoria’ Season 3 Release Schedule: When Does Episode 3 Come Out?
April 26, 2026
LLMs are breaking 20 year old system design — /dev/knill
Blog
LLMs are breaking 20 year old system design — /dev/knill
May 14, 2026
Tesla brings its robotaxi service to Dallas and Houston
Blog
Tesla brings its robotaxi service to Dallas and Houston
April 19, 2026

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Recent Posts

  • OnePlus 16 Launch Date, Price, Specs: Everything Confirmed for 2026
  • Best 5G Phones 2026 for USA, UK & Europe (Every Budget)
  • Best Foldable Phones 2026: Z Fold 8 vs Pixel 11 Pro Fold vs Razr
  • Google Pixel 10 Review (2026): Still Worth $799?
  • iPhone 16 vs iPhone 17: Should You Upgrade in 2026? (Honest Answer)

Recent Comments

  1. I Hiked Using Robot Legs in the Grand Canyon. I Didn’t Even Need My Cane - Mobile & Accessories on Can Using the Hypershell Exoskeleton on a Bike Replace an E-Bike? I Tested It to Find Out
  2. The media starts receiving the first Trump Mobile T1 Phone units, launch is imminent - Mobile & Accessories on The Competitive Moat That AI Can’t Replicate
  3. Samsung’s giant The Frame Pro TV is $1,500 off until midnight - Mobile & Accessories on All Your Wearables Have One Glaring Weakness. What Can You Do About It?
  4. iPhone 18: Everything We Know About Apple's Most Ambitious Lineup Yet - Mobile & Accessories on This magnetic Qi 2.2 power bank is perfect for the iPhone 17 and it’s on sale right now
  5. Do Camera Sensor Sizes Matter? - Mobile & Accessories on Xiaomi 18 Pro set for a screen upgrade that Samsung fans will be very familiar with

Archives

  • October 2026
  • June 2026
  • May 2026
  • April 2026

Categories

  • Blog
  • Mobiles

Copyright © 2026 Mobile & Accessories.

Theme: Oceanly News by ScriptsTown