Apple Quietly Developing On-Device AI to Enhance Siri, Products
-
Apple has been quietly developing its own generative AI models for use in iDevices, likely targeting more conservative uses like improving Siri's ability to parse queries rather than full chatbots.
-
Apple's neural processing units give it an advantage for running AI workloads locally rather than in the cloud, but memory constraints on phones could limit model size.
-
M1 Macs have proven very capable at running larger AI models, suggesting the hardware isn't the limitation.
-
Apple researchers published a paper showing techniques to run models from flash storage, perhaps sidestepping memory limits.
-
Expect Apple to take a conservative approach, using AI to refine existing features rather than chasing the latest fads, having found success with that strategy in the past.