Our state-of-the-art mixture-of-experts model is now available on the Apple app store! The OLMoE app allows anyone to test the model privately and securely on their devices.
It’s Apple’s API for hardware-accelerated machine learning. Their new devices have specialized ML hardware so it’s actually feasible to run on mobile devices. Probably what they also use for Apple Intelligence. https://developer.apple.com/documentation/coreml
Why only iPhone?
according to the linked article, it sounds like it is for performance reasons.
It probably uses Apple’s CoreML. Not sure if Android has an equivalent API.
https://developers.google.com/ml-kit/
Explain it pls
It’s Apple’s API for hardware-accelerated machine learning. Their new devices have specialized ML hardware so it’s actually feasible to run on mobile devices. Probably what they also use for Apple Intelligence. https://developer.apple.com/documentation/coreml
Seems like a good project to implement on the green side