Run Powerful AI on Your Phone with Bonsai 27B
PrismML just launched Bonsai 27B. This project shrinks the popular Qwen 27B model so it can run on laptops and phones instead of needing a giant server. It uses the same architecture as the original but optimizes the weight values to save space.
You can choose between two versions. The ternary version uses three weight values and takes up about 6 gigabytes of space. The binary version uses even less memory for faster performance on mobile hardware.
Both models are available under an Apache 2.0 license. This makes it easy for developers to build private AI tools that work locally on their own machines without a cloud connection.
Comments (0)
No comments yet. Be the first!
More AI news
NewsGoogle AI Changes Its Search Advice After Bias Complaints
Google updated its search tool after it incorrectly told users to call emergency services based on a person's nationality.
NewsWhy AI Is Still Failing at Simple Tasks
Researchers gave an AI five thousand dollars to grow, but it could not even open a bank account.
NewsEnovis to Buy eCential Robotics
Enovis is expanding its surgical tech business by purchasing French company eCential Robotics.