A Look at Apple's Assistant Interface for the New iPhone

Apple has been rumored to be working on advanced speech recognition technology for some time.

After Apple's acquisition of Siri, TechCrunch reported in May that negotiations were ongoing with Nuance to integrate their speech recognition technology into iOS. Earlier this week, 9to5mac detailed much of what is expected to be the major new feature in the next generation iPhone to be release on October 4th. The story was met with some skepticism in our forums, but we were especially confident in the report as we had privately heard the exact same story from our sources.

The Siri/Nuance-based voice recognition Assistant will be the major new feature in the next generation iPhone and will be an iPhone 4S/5 exclusive feature. As detailed, the Assistant will allow users to speak to their iPhones in order to schedule appointments, send text messages, retrieve information and much more. Voice recognition happens on the fly and reportedly with great accuracy.

assistant
Assistant interface, artist rendition

We've created this artist rendition (above) of what the Assistant interface looks like based on sources with knowledge of the feature. After a long press on the home button, the screen fades and slides up, just like with the multitasking interface. Revealed is a silver icon with an animated orbiting purple flare which indicates a ready state. From what we've been told, this image is a close representation of the actual Assistant interface.

From there, the user may be taken to a conversation view that somewhat mimics Siri's original interface, but in Apple's own styling.

Based on this knowledge, we contracted Jan-Michael Cart to put together a video representation of the Assistant workflow. Cart had been responsible for a number of iOS concept videos in the past, but we wanted to mock up what the actual Assistant interface looked like. Due to the short turnaround, we know that not all elements in the video represent actual look/feel of the Assistant interface, but should show off the general workflow.


After receiving spoken commands, the Assistant shows you back the recognized text and then takes the next step. This could involve sending a text message (with confirmation) or pulling data from Wolfram Alpha. The feature is said to be one of the major differentiators for the next generation iPhone.

Apple is hosting a media event on October 4th, where they will introduce the next iPhone and these new features.

Popular Stories

Generic iOS 18

iOS 18.1 With Apple Intelligence: New Features, Release Date, and More

Thursday October 10, 2024 8:26 am PDT by
iOS 18.1 will be released to the public in the coming weeks, and the software update introduces the first Apple Intelligence features for the iPhone. Below, we outline when to expect iOS 18.1 to be released. iOS 18.1: Apple Intelligence Features Here are some of the key Apple Intelligence features in the iOS 18.1 beta so far: A few Siri enhancements, including improved understanding...
top stories 12oct2024

Top Stories: iOS 18.1 Release Date, New Macs Incoming, and More

Saturday October 12, 2024 6:00 am PDT by
Things are firming up for a big Halloween week for Apple, with the company's next operating system updates reportedly coming early in the week and hardware launches coming a few days later. Ahead of those hardware launches, we've recently seen what appears to be one of the most significant physical product leaks in years, while some of the new features in Apple's recent software updates have ...
ipad mini 7

Apple Unveils New iPad Mini With A17 Pro Chip and Apple Intelligence

Tuesday October 15, 2024 6:07 am PDT by
Apple today announced a significant upgrade to the iPad mini, now featuring an A17 Pro chip and support for the company's new Apple Intelligence system. The refreshed seventh-generation tablet maintains its compact 8.3-inch design while offering notable performance improvements and new capabilities. Subscribe to the MacRumors YouTube channel for more videos. The A17 Pro chip brings a 30%...
maxresdefault

The MacRumors Show: Apple's Shocking M4 MacBook Pro Leak

Friday October 11, 2024 8:27 am PDT by
On this week's episode of The MacRumors Show, we discuss the unprecedented leak of Apple's M4 MacBook Pro models and the company's rumored move to more staggered hardware and software releases. Subscribe to The MacRumors Show YouTube channel for more videos Multiple leaks surrounding Apple's unannounced 14-inch MacBook Pro with the M4 chip recently surfaced online. The leaks began with unboxin...
Apple Intelligence Feature 2

Apple Seeds Seventh Developer Betas of iOS 18.1 and iPadOS 18.1 With Apple Intelligence [Update: Public Beta Available]

Monday October 14, 2024 10:10 am PDT by
Apple today provided developers with the seventh betas of iOS 18.1 and iPadOS 18.1 to continue testing Apple Intelligence features. The seventh betas come a week after Apple seeded the sixth iOS 18.1 and iPadOS 18.1 betas. The updates can be downloaded from the Settings app on a compatible device by going to General > Software Update. Note that Apple Intelligence features still an iPhone 15...
16 pro

iPhone 17 Pro Models Rumored to Introduce These 5 New Features

Friday October 11, 2024 8:55 am PDT by
While the iPhone 16 series was released just a few weeks ago, there are already many rumored features for the iPhone 17 models, and especially for the Pro models. Below, we recap five key new features rumored for the iPhone 17 Pro and Pro Max so far: 24MP front camera for all iPhone 17 models: All four iPhone 17 models will feature an upgraded 24-megapixel front-facing camera, according...
iPad mini review thumb

iPad Mini 7 Coming Next Month: What to Expect

Tuesday October 8, 2024 6:16 am PDT by
Rumors strongly suggest Apple will release the seventh-generation iPad mini in November, nearly three years after the last refresh. Here's a roundup of what we're expecting from the next version of Apple's small form factor tablet, based on the latest rumors and reports. Design and Display The new iPad mini is likely to retain its compact 8.3-inch display and overall design introduced with...

Top Rated Comments

robbieduncan Avatar
170 months ago
Have they solved the problem of feeling like a complete idiot when you use these sort of interfaces?
Score: 49 Votes (Like | Disagree)
theperipheral Avatar
170 months ago
Hopefully this will be for the iphone 4 as well.. Otherwise we will all have to continue texting while driving.

I don't see a problem with texting while driving. I do it almost every day, and I've never h
Score: 35 Votes (Like | Disagree)
arn Avatar
170 months ago
If you activate it by holding down the home button, how will you rearrange your apps?

by long pressing on the app icon as usual. :)

long press home button is already occupied by voice control.

arn
Score: 34 Votes (Like | Disagree)
DrJohnnyN Avatar
170 months ago
Pretty cool! Tuesday cannot come fast enough!!
Score: 25 Votes (Like | Disagree)
euphlyusUNO Avatar
170 months ago
This is the fundamental difference between the Android and the Apple camps.

Androidies think and talk in terms of features, hardware specs

Applelites think in terms of experience


Case In Point:

For those comparing WP7 Tell Me and Google Voice Actions with Apple Assistant:

WP7 and Tell Me are not "Assistants". They perform actions based on voice inputs. WP7 implementation does simpler things (invoking apps, calling a cell phone number). Voice Action packs in more capability (though I haven't worked with either of those, this is based purely on watching videos)

However, if iOS Assistant is anything close to what's described in the Video and something akin the App Siri, then, the Assistant won't simply be "voice commands". You can have conversations, do more things than just call or send text. The assistant will also be more accurate by the virtue of understanding the context of a conversation (you'll understand this if you've carefully observed Siri mobile apps).

Just recognizing voice accurately is not enough. There has to be a simple and logical flow, like a conversation. I'm hoping Apple will nail that (as they've done sometimes before)
Score: 22 Votes (Like | Disagree)
gugy Avatar
170 months ago
this thing looks cool
Score: 20 Votes (Like | Disagree)