1 Bit Bonsai 1.7B
Overview
1-bit Bonsai 1.7B is PrismML’s smallest Bonsai model, built for extremely fast on-device inference. With a memory footprint of just 0.24GB, PrismML says it can reach 130 tokens per second on an iPhone 17 Pro Max, making it a lightweight edge model aimed at mobile and highly power-constrained applications.
