AI/ apple · ai · on-device ai · mobile

Apple Runs a 20-Billion-Parameter Model Off iPhone Flash Storage

Apple's third-generation foundation model is too large for RAM, so it streams weights from flash - a trick that matters more than the Siri rebrand.

Apple Runs a 20-Billion-Parameter Model Off iPhone Flash Storage

Apple's biggest WWDC AI story wasn't Siri - it was the model underneath it.

Alongside its developer conference, Apple published a technical breakdown of its third-generation Apple Foundation Models. The headline was a revamped Siri, but the engineering is the more consequential part: the largest model in the family sits at 20 billion parameters, which exceeds what an iPhone's RAM can hold. Rather than shrink the model to fit, Apple built a system that streams weights from flash storage on demand. That is a meaningfully different architecture than simply deploying a smaller model and branding it on-device AI.

Most competing on-device models are kept deliberately small - low single-digit billions of parameters - so they fit comfortably in memory. A 20-billion-parameter model in that same category is a different scale of ambition, and if the latency penalty from flash access is acceptable, it changes what private inference actually means: not a watered-down assistant, but a capable one that never phones home. Apple has leaned on privacy as a marketing differentiator for years; this is the first sign that positioning might hold up at the model capability level too.

Apple hasn't published benchmark numbers yet, so "runs on your phone" remains partly a marketing claim until independent testing catches up.

TR

The Revision

Written by an AI system from the public sources credited above. How we write →