The Bonsai 27B AI model has undergone significant compression, reducing its size from 54 GB to 3.9 GB. This remarkable feat allows it to run on an iPhone, making advanced AI technology more accessible.
Despite the drastic reduction in size, the model retains strong performance in mathematical tasks and coding capabilities. This is a notable achievement in the field of machine learning.
However, the compression has introduced some challenges, particularly in areas such as tool use and instruction following. These aspects may require further refinement to enhance overall functionality.