Apple ships PrismML — on-device models big enough to run locally

Apple announced PrismML, a family of larger AI models designed to run on-device instead of in the cloud. The point is simple: you get the capabilities without sending your data off to a server farm.

Bigger models tend to mean better reasoning and more accurate answers, but they also eat memory and compute. By baking them into the chip architecture, Apple sidesteps the latency and privacy tradeoffs that have pushed most consumer AI toward cloud APIs. It’s a different bet than the open-weight models running on desktop GPUs — this is Apple’s own silicon, tuned for its lineup.

The shift matters because it moves the decision about what AI gets run, and where it runs, away from third-party cloud providers and toward the hardware in your pocket or on your desk. You don’t need a subscription to call an API. You don’t need to worry about what a vendor does with your prompt history. You just run it.

Why this matters for us: when the models live on our devices, our data stays ours and the companies that sell us the phones can’t quietly use our conversations to train their next big thing.