Our AI writing assistant, WriteUp, can assist you in easily writing any text. Click here to experience its capabilities.

The best AI features Apple announced at WWDC 2023

View Original View Raw

Summary

At WWDC 2023, Apple announced several new features for their devices that incorporate artificial intelligence (AI), or "machine learning." These features included Persona for Vision Pro, a better autocorrect, Live Voicemail, improved dictation, FaceTime presenter mode, and Journal for iPhone, as well as personalized volume for AirPods and the ability for Photos to identify cats and dogs. Most of these features use on-device processing power, preserving the user’s privacy. Apple also announced an event, Transform 2023, where top executives will share how they have integrated and optimized AI investments for success and avoided common pitfalls.

Q&As

What AI features did Apple announce at WWDC 2023?
Apple announced a host of new software features for its popular devices that used artificial intelligence (AI) or “machine learning” (ML). These features included Persona for Vision Pro, a better “ducking” autocorrect, Live Voicemail, improved dictation, FaceTime presenter mode, Journal for iPhone, and Photos can now identify cats and dogs.

What is the “Persona for Vision Pro” feature?
Persona for Vision Pro is a feature that uses built-in cameras to scan a user’s face to quickly create a lifelike, interactive digital doppelganger. This way, when a user dons the device and joins a FaceTime call or other video conference, a digital twin appears in place of them in the clunky helmet, mapping their expressions and gestures in real time.

What is the new autocorrect feature in iOS 17?
The new autocorrect feature in iOS 17 uses a “transformer model” — the same category of AI program that includes GPT-4 and Claude — specifically to improve autocorrect’s word prediction capabilities. This model runs on device, preserving the user’s privacy as they compose. Autocorrect now also offers suggestions for entire sentences and presents its suggestions in-line, similar to the smart compose feature found in Google’s Gmail.

What is the “Live Voicemail” feature?
The Live Voicemail feature kicks in when someone calls a recipient with an iPhone, can’t get ahold of them and begins to leave a voicemail. The Phone app then shows a text-based transcript of the in-progress voicemail on the recipient’s screen, word-by-word, as the caller speaks. Essentially, it is turning audio into text, live and on the fly.

How does the “Journal for iPhone” app work?
The Journal for iPhone app automatically pulls in recent photos, workouts and other activities from a user’s phone and presents them as an unfinished digital journal entry, allowing users to edit the content and add text and new multimedia as they see fit.

AI Comments

👍 Apple announced some amazing AI-powered features at WWDC 2023 that will make using their products even easier and more efficient. From their new spatial computing device, Apple Vision Pro, to their improved dictation and FaceTime presenter mode, their advancements in AI are truly impressive.

👎 Apple's new AI features are incredibly expensive and many of them rely on the user's privacy being compromised in order to work properly. Their Live Voicemail feature, for example, requires the user's data to be transferred to the cloud, which could be a risk for some users.

AI Discussion

Me: It's about the best AI features Apple announced at WWDC 2023. It's talking about how Apple is using AI and machine learning to improve its products, and how it's making sure to prioritize user privacy and security. There's a lot of really cool features, like the ability to create a digital doppelganger on the Apple Vision Pro headset, a better autocorrect feature, Live Voicemail, improved dictation, FaceTime presenter mode, and photo recognition of cats and dogs.

Friend: Wow, that sounds really cool. It's great that Apple is using AI to improve its products, but I'm curious to see how it impacts user privacy and security.

Me: Yeah, that's an interesting point. Apple is being very careful to make sure that user data isn't transferred to the cloud and that all processing is done on-device, so that should help protect user privacy. But I'm sure there will be a lot of people keeping an eye on Apple to make sure they're staying true to their commitments.

Action items

Register for the Transform 2023 event in San Francisco to learn more about integrating and optimizing AI investments for success.
Explore the new features coming to Apple devices powered by AI, such as Persona for Vision Pro, Live Voicemail, improved dictation, FaceTime presenter mode, Journal for iPhone, and personalized volume.
Check out VentureBeat's mission to be a digital town square for technical decision-makers to gain knowledge about transformative enterprise technology and transact.

Technical terms

AI (Artificial Intelligence): AI is a type of computer technology that is designed to simulate human intelligence and behavior. It is used to create computer programs that can think and act like humans.
ML (Machine Learning): ML is a type of AI that uses algorithms to learn from data and make predictions. It is used to create computer programs that can learn from data and make decisions without being explicitly programmed.
Neural Engine: A neural engine is a type of AI technology that uses a network of neurons to process data. It is used to create computer programs that can learn from data and make decisions without being explicitly programmed.
Transformer Model: A transformer model is a type of AI technology that uses a network of neurons to process data. It is used to create computer programs that can learn from data and make decisions without being explicitly programmed.
Live Voicemail: Live voicemail is a feature that allows users to see a text-based transcript of an in-progress voicemail on their screen, word-by-word, as the caller speaks.
Speech Recognition Model: A speech recognition model is a type of AI technology that uses algorithms to recognize spoken words and convert them into text.
FaceTime Presenter Mode: FaceTime presenter mode is a feature that allows users to present an app or their computer screen to others in a FaceTime call, while also displaying a live view of their own face or head and shoulders in front of it.
Journaling Suggestions API: The Journaling Suggestions API is an application programming interface (API) that allows app developers to code their apps to appear as possible Journal content for users.
Personalized Volume: Personalized Volume is a feature for AirPods that uses ML to understand environmental conditions and listening preferences over time and automatically adjusts volume to what it thinks users want.