Google turns Gemma into a faster text generator

Google DeepMind took their Gemma model and turned it into a diffusion model. This method uses only a small fraction of the original training budget. It is a much cheaper way to build new AI tools.
This new version creates 256 tokens at once instead of writing one word at a time. This change allows it to hit speeds of 1,500 tokens per second. It is a big step forward for generation speed.
The model is not perfect yet. It still performs worse than the original version on complex logic and reasoning tasks. It shows that speed and quality are still hard to balance.
Comments (0)
No comments yet. Be the first!
More AI news
NewsNew AI Tool Fixes Mistakes in Financial Research
Researchers developed a new framework to stop AI from learning from its own bad data in financial trading models.
NewsPerplexity adds local AI to Mac apps
The new update lets your Mac handle some AI tasks directly on your computer.
NewsMeta Releases Muse Image Model on Fal
Meta has launched a new AI model on the Fal platform that plans and edits images on its own.