Apple may have seemed late to the game when it comes to AI, especially after the success of ChatGPT in 2022, but recent reports suggest that the company had been patiently waiting its turn. Rumors have indicated that Apple has been in talks with OpenAI and Google to power some of its AI features, while also developing its own model named Ajax. By examining Apple’s published AI research, one can start to understand the company’s approach to AI and how it might come to life in their products.
One area of focus for Apple is creating smaller, more efficient models to improve Siri and other AI features. The company is working on running all AI features on an on-device, fully offline model in iOS 18, a challenging task given the limitations of smartphone hardware. Researchers have developed ways to store model data on SSDs to achieve faster and more efficient performance, as well as compress models to smaller sizes without significant losses in quality. Apple is trying to find the balance between model size, efficiency, and performance to enhance their AI features.
Improving Siri is a key focus for Apple, with research aimed at making the virtual assistant more intuitive and efficient. An innovative approach involves using large language models to process more information quickly, resulting in improved voice trigger detection and communication with users. Apple is also working on systems like STEER to enhance conversations with virtual assistants and better understand ambiguous queries. The goal is to make Siri more responsive, accurate, and user-friendly.
Aside from virtual assistants, Apple sees AI playing a role in various applications such as health monitoring, image editing, and creative tools. AI could help users make sense of health data collected by devices, assist in editing images through descriptions, and enhance the creative process for artists and designers. Apple also envisions AI being useful in music applications, such as separating voices from instruments in songs. The company is looking to integrate AI capabilities across different aspects of its products and services to provide users with practical and creative tools.
In the future, Apple is likely to focus on integrating advanced AI features into its offerings, leveraging its hardware capabilities and privacy-focused approach. Research on projects like Ferret, a multi-modal large language model, suggests that Apple is exploring innovative ways to enhance user experiences and accessibility. Ferret could revolutionize how users interact with their devices, allowing for more intuitive and seamless interactions. While these advancements are still in the research phase, Apple’s commitment to AI innovation suggests that future products may usher in a new era of intelligent and user-centric technology.
Overall, Apple’s foray into AI indicates a strategic shift towards leveraging cutting-edge technology to enhance user experiences and capabilities. By focusing on developing smaller and more efficient models, improving virtual assistants like Siri, and exploring new applications for AI, Apple is poised to make significant advancements in the AI space. The company’s dedication to research and innovation suggests that exciting developments may be on the horizon, with potential unveiling at its annual developer conference, WWDC. Apple’s embrace of AI could lead to transformative changes in how users interact with technology, signaling a new era of intelligent and intuitive devices.