Run Gemma 4 on iPhone 17 Pro with Google AI Edge Gallery
The iPhone 17 Pro is the fastest iPhone ever released for on-device AI. With 12 GB of RAM and the A19 Pro's upgraded 16-core Neural Engine, it is the only iPhone that can run Google Gemma 4 E4B (5 GB, 4.5B effective parameters) without forcing other apps out of memory. Real-world testing puts E4B around 30 tokens per second and the smaller E2B variant past 40 tok/s. If you want the best on-device AI experience iOS currently offers, this is the device.
On the iPhone 17 Pro (Apple A19 Pro, 12GB RAM), run Google Gemma 4 E4B at ~30 tok/s (measured) via Google AI Edge Gallery. Gemma 4 E4B is ~5 GB on disk and uses 2-3 GB in memory, fully offline, no account required.
→ Install Google AI Edge Gallery (iOS 17+), then download Gemma 4.
Speed is a real-world user-reported measurement; on-device speed varies with thermal state.
Verdict
Recommended: Gemma 4 E4BiPhone 17 Pro is the only iPhone where Gemma 4 E4B runs comfortably. Pick E4B for the highest local quality, or E2B if you want maximum speed and battery efficiency.
Gemma 4 Performance on iPhone 17 Pro
Speeds via Google AI Edge Gallery on iOS 17+. "Measured" numbers come from real-world Hacker News user reports; "Estimated" numbers are interpolations from chip generation. Both Gemma 4 variants use int4 quantization-aware training.
Best for
- Multimodal AI: text + image + 30s audio in one conversation
- Long context (128K) document analysis on the go
- Travelers who need offline translation in any language
- Privacy-sensitive workflows where no data can leave the phone
Watch outs
- Sustained inference still warms the device. Expect throttling after ~10 minutes of continuous generation
- E4B model download is ~5 GB. Use Wi-Fi, not cellular
- Battery: continuous chat drains roughly 15-20% per hour
Setup Guide
Step-by-step install for Google AI Edge Gallery on iPhone 17 Pro, plus full benchmarks and the privacy details.