Unveiled first at WWDC 2024, and then launched at Apple's 'Glowtime' event on September 9, 2024, Apple Intelligence marks a push by the Cupertino company into the world of AI, specifically generative AI. New features, launching with iOS 18.1, iPadOS 18.1 and macOS Sequoia, include proofreading and rewriting abilities, summarizing text, Genmoji for making your own emojis, and an Image Playground app for manipulating images. Want to know if your Mac or iPad is compatible? Take a look at our Apple Intelligence compatibility list.
With Apple Intelligence, Apple is exploring how AI can help people in their everyday lives, with a big focus on privacy. It will help you write emails, perform natural language search and create memory movies based on prompts, but unlike the approach from Google and Microsoft, there is no plan to charge for access to Apple Intelligence's better features until at least 2027.
So, for the lowdown on Apple Intelligence, and how it could influence our list of the best AI phones, read on.
What is Apple Intelligence?
Apple Intelligence is Apple's multimodal, cross-platform approach to today's AI computing trend. It's coming to just about every Apple platform and most newer Apple devices. Apple Intelligence includes generative AI features, like writing and image creation, as well as an improved Siri assistant, and much more.
Apple Intelligence takes a decidedly Apple-like approach to privacy, which means that the least information possible is shared with anyone, even Apple itself. Most Apple Intelligence features run on your device. When Apple needs to access the cloud for more power, it has a Power Cloud Compute standard to protect your data and privacy; in a nutshell that means cloud-power without data spreading between a load of servers and platforms.
We mention privacy first because Apple always mention privacy first, and no other AI company talks about your data privacy and how your data is being protected quite as much as Apple does.
Apple is also giving Apple Intelligence unprecedented access to your data, and it will be able to read all of your messages, monitor your calendar, follow your Maps and location, record your phone calls, look at your photos, and understand any other personal data. Apple Intelligence will offer a new level of contextual features, because it will have access to just about all of your personal information.
What does Apple Intelligence do?
One of the most exciting features of Apple Intelligence is the new Visual Intelligence tool, which works with the iPhone 16's new Camera Control button. Once you click the new button on the side of the phone you can use Apple Intelligence's multimodal features to get search results on the fly. Just point your phone at something and you can search for it!
Apple Intelligence offers generative AI tools for writing and editing, image creation, and organization. It will also be able to offer summaries, just like current generative AI tools.
Wherever you can type or input text, Apple Intelligence will offer suggestions to improve your writing. It will rewrite, proofread, and summarize text for you.
Apple Intelligence stays aware of your incoming Mail messages and your notifications, and it will try to prioritize what is important to you. All your notifications can be summarized by Apple Intelligence, so instead of an email notification showing you a partial part of the email, which might not be that helpful, you'll get a nice little summary instead.
A new Reduce Interruptions Focus mode uses Apple Intelligence to only offer high-priority messages that need your immediate attention.
Apple Intelligence also summarizes conversations and messages for you, and it can even summarize audio recordings. You can record phone calls and have Apple Intelligence summarize the conversation, or you can record in the Notes app and get a summary of the audio recording there.
For image creation, Apple has a new Image Playground app and tool that is part of Apple Intelligence. With Image Playground, you can either enter your own prompt or use a suggested one, and the suggestions will be personalized based on what you're doing at the time. So for example if you message a friend about hiking in a forest, then 'forest' might be one of the prompts.
You can select from several styles for your image, and you can also turn people in photos into cartoon-like images.
Besides the Image Playground, Apple will have an image generator that focuses on emoji as well. The generative Emoji will be called Genmoji. You type a description, and an emoji appears.
Apple has applied its generative AI tools to editing photos as well. There is a Magic Eraser-style tool called Photo Clean Up that removes unwanted objects in photos and replaces them with a natural background. All you need to do is open a photo, then tap on Clean Up in the photo editor. Now tap, circle or brush over whatever part of the photo you'd like to remove with your finger, and let AI work its magic. If you do it on a person then it's as if they were never there.
Otherwise, Apple is using Apple Intelligence to assist in searching photos and videos so you can relive moments you'd thought you'd lost. You'll be able to search for a specific scene in a video, for instance. So, if you want a picture, or video, you took of your child wearing a blue t-shirt you can just type in their name and blue t-shirt to find it. You can also search for a category of photos and Apple Intelligence will put together a video presentation that fits your search. It will include photos and videos, as well as background music it selects.
If you want a full rundown of all the Apple Intelligence features, here's what we know is coming so far and when you can use them.
When will I get Apple Intelligence?
After the September 9 launch event, we finally have a better idea of when Apple Intelligence is being released. iOS 18, which will be on the iPhone 16 when it launches, will sadly have no Apple Intelligence features at all. This might come as a shock to many, but it won't be long before iOS 18.1 is released in October.
iOS 18.1 still won't contain the main Siri upgrades. For that you'll have to wait until early 2025, when we can expect the last of the announced Apple Intelligence features, like the ChatGPT integration, to launch in iOS 18.2.
But what about macOS? For macOS Sequoia, it is likely that the final version of the platform will be available around the same time as iOS 18.1 and iPadOS 18.1, in October, 2024.
Will Siri get Apple Intelligence?
Of course Siri is getting a massive upgrade thanks to Apple Intelligence. Siri is no longer just a virtual balloon that sits at the bottom of your phone screen. Now, when you activate Siri, your entire home screen will ripple, to show that Siri has completely taken over.
Siri is getting better all around. It will have "richer language-understanding capabilities," according to Apple. It will be more natural, and more contextually relevant. When you start a conversation with Siri, it will remember what you were talking about when you make your next request, so you won't have to start over every time.
Also, Siri will finally accept typing instead of just speech. If you never use Siri, it may surprise you to learn you couldn't type to Siri, but it's true. Now you can use the keyboard to give Siri commands and queries.
Siri is going to do a better job explaining how to use your device. Whether you use an iPhone, iPad, or a Mac computer, Siri will be able to answer thousands more questions about how to do things on your Apple product. Siri will also know what is happening on screen, and it will make suggestions based on what it sees.
Apple Intelligence is a major upgrade for Siri that will enable far more third-party actions. Using Apple's new App Intent API, app developers will be able to program commands that you can use with Siri.
Siri will also know you. It will know much more of the information you have on your device. You'll be able to ask Siri to "play that song Edgar mentioned" and it will know because it read your iMessage conversation with Edgar. If you ask "when is Dad landing at Laguardia" it will look up his flight details from the message he sent and give you real-time tracking info. That's cool, but it's a lot more than we're used to a computer knowing about us.
Based on what we've seen so far it looks like iOS 18.4 will finally deliver the Siri we've been waiting for.
How will Apple Intelligence protect my privacy?
Privacy is a key feature that sets Apple's AI apart from its competitors.
For a start, Apple is running everything it can on your device. While Siri may know everything you said in your text messages, it won't be sharing that information with anyone, not Apple or anyone else. At least, according to Apple.
When you create an image in the Image Playground, Apple doesn't know what image you've created. Even if your iPhone needs some help from the cloud when it summarizes the last phone call you made, it won't report anything to Apple.
Apple is keeping more complex cloud requests locked in a Private Cloud Compute environment, which 'cryptographically ensures that iPhone, iPad, and Mac do not talk to a server unless its software has been publicly logged for inspection,' according to the Apple Intelligence news release.
Will Apple Intelligence use ChatGPT?
Apple Intelligence offers free access to ChatGPT, in some way. We know that there will be a direct link to ChatGPT so that Apple owners can use ChatGPT to understand documents and images. We also know that Siri will be able to route a request through ChatGPT, if you ask nicely.
Apple is adding a level of privacy to these ChatGPT requests. According to Apple, when you access ChatGPT through Apple Intelligence, your IP address is obscured, and OpenAi won't store your request. Otherwise, ChatGPT's data-use policies apply.
ChatGPT is coming to all three major platforms – macOS Sequoia, iPadOS 18, and iOS 18 early next year, powered by GPT-4. However, Apple has also said that other AI models will become partners in the future as well. ChatGPT may not be the exclusive large-language model (LLM) partner for Apple Intelligence for long, if ever.
We've had a look at the iOS 18.2 beta, which includes ChatGPT integration in Siri, so we've seen it working and it's impressive. From what we've seen the integration is entirely opt-in, and Siri will flag when ChatGPT is answering a request.
Which Apple devices will get Apple Intelligence?
Apple Intelligence includes features across almost every Apple platform, including macOS 15 Sequoia, iOS 18, and iPadOS 18. Unfortunately, not every device that can run those operating systems will be able to use Apple Intelligence features.
Apple describe the iPhone 16 as the "first iPhone designed from the ground up for Apple Intelligence", and it will work with all its different models, the iPhone 16, iPhone 16 Plus, iPhone 16 Pro and iPhone 16 Pro Max.
Apple Intelligence is coming to devices that use the Apple M1, M2, M3, and M4 chips, as well as the A17 Pro chipset. That means even devices you can buy brand new today will not get the features later this year.
The current iPad Pro and iPad Air devices, as well as previous iPad devices that used the M1 and M2 chips, will all be supported. The base model iPad 10.9 and the iPad mini will not be supported, as they use older Apple Bionic chips.
The only older iPhone models that will work with Apple Intelligence are the iPhone 15 Pro and iPhone 15 Pro Max. The iPhone 15 and iPhone 15 Plus use the A16 Bionic chipset, and not the A17 Pro chips.
If you have a Macbook Air, Macbook Pro, iMac, Mac Studio or Mac mini with an M1 chip or newer inside, you should be fine. Apple computers with an Intel processor on board will likely not be supported.
You might also like...
