Run Powerful AI on Your Phone with Bonsai 27B
PrismML just launched Bonsai 27B. This project shrinks the popular Qwen 27B model so it can run on laptops and phones instead of needing a giant server. It uses the same architecture as the original but optimizes the weight values to save space.
You can choose between two versions. The ternary version uses three weight values and takes up about 6 gigabytes of space. The binary version uses even less memory for faster performance on mobile hardware.
Both models are available under an Apache 2.0 license. This makes it easy for developers to build private AI tools that work locally on their own machines without a cloud connection.
Comments (0)
No comments yet. Be the first!
More AI news
NewsNew AI Tool Fixes Mistakes in Financial Research
Researchers developed a new framework to stop AI from learning from its own bad data in financial trading models.
NewsPerplexity adds local AI to Mac apps
The new update lets your Mac handle some AI tasks directly on your computer.
NewsMeta Releases Muse Image Model on Fal
Meta has launched a new AI model on the Fal platform that plans and edits images on its own.