A Look at Apple's Assistant Interface for the New iPhone

Apple has been rumored to be working on advanced speech recognition technology for some time.

After Apple's acquisition of Siri, TechCrunch reported in May that negotiations were ongoing with Nuance to integrate their speech recognition technology into iOS. Earlier this week, 9to5mac detailed much of what is expected to be the major new feature in the next generation iPhone to be release on October 4th. The story was met with some skepticism in our forums, but we were especially confident in the report as we had privately heard the exact same story from our sources.

The Siri/Nuance-based voice recognition Assistant will be the major new feature in the next generation iPhone and will be an iPhone 4S/5 exclusive feature. As detailed, the Assistant will allow users to speak to their iPhones in order to schedule appointments, send text messages, retrieve information and much more. Voice recognition happens on the fly and reportedly with great accuracy.

assistant
Assistant interface, artist rendition

We've created this artist rendition (above) of what the Assistant interface looks like based on sources with knowledge of the feature. After a long press on the home button, the screen fades and slides up, just like with the multitasking interface. Revealed is a silver icon with an animated orbiting purple flare which indicates a ready state. From what we've been told, this image is a close representation of the actual Assistant interface.

From there, the user may be taken to a conversation view that somewhat mimics Siri's original interface, but in Apple's own styling.

Based on this knowledge, we contracted Jan-Michael Cart to put together a video representation of the Assistant workflow. Cart had been responsible for a number of iOS concept videos in the past, but we wanted to mock up what the actual Assistant interface looked like. Due to the short turnaround, we know that not all elements in the video represent actual look/feel of the Assistant interface, but should show off the general workflow.


After receiving spoken commands, the Assistant shows you back the recognized text and then takes the next step. This could involve sending a text message (with confirmation) or pulling data from Wolfram Alpha. The feature is said to be one of the major differentiators for the next generation iPhone.

Apple is hosting a media event on October 4th, where they will introduce the next iPhone and these new features.

Top Rated Comments

robbieduncan Avatar
164 months ago
Have they solved the problem of feeling like a complete idiot when you use these sort of interfaces?
Score: 49 Votes (Like | Disagree)
theperipheral Avatar
164 months ago
Hopefully this will be for the iphone 4 as well.. Otherwise we will all have to continue texting while driving.

I don't see a problem with texting while driving. I do it almost every day, and I've never h
Score: 35 Votes (Like | Disagree)
arn Avatar
164 months ago
If you activate it by holding down the home button, how will you rearrange your apps?

by long pressing on the app icon as usual. :)

long press home button is already occupied by voice control.

arn
Score: 34 Votes (Like | Disagree)
DrJohnnyN Avatar
164 months ago
Pretty cool! Tuesday cannot come fast enough!!
Score: 25 Votes (Like | Disagree)
euphlyusUNO Avatar
164 months ago
This is the fundamental difference between the Android and the Apple camps.

Androidies think and talk in terms of features, hardware specs

Applelites think in terms of experience


Case In Point:

For those comparing WP7 Tell Me and Google Voice Actions with Apple Assistant:

WP7 and Tell Me are not "Assistants". They perform actions based on voice inputs. WP7 implementation does simpler things (invoking apps, calling a cell phone number). Voice Action packs in more capability (though I haven't worked with either of those, this is based purely on watching videos)

However, if iOS Assistant is anything close to what's described in the Video and something akin the App Siri, then, the Assistant won't simply be "voice commands". You can have conversations, do more things than just call or send text. The assistant will also be more accurate by the virtue of understanding the context of a conversation (you'll understand this if you've carefully observed Siri mobile apps).

Just recognizing voice accurately is not enough. There has to be a simple and logical flow, like a conversation. I'm hoping Apple will nail that (as they've done sometimes before)
Score: 22 Votes (Like | Disagree)
gugy Avatar
164 months ago
this thing looks cool
Score: 20 Votes (Like | Disagree)

Popular Stories

iOS 18 Apple Music Messages and Notes Feature 1

iOS 18 Rumored to Add New Features to These 16 Apps on Your iPhone

Tuesday April 30, 2024 10:44 am PDT by
Apple is expected to announce iOS 18 during its WWDC keynote on June 10, and new features have already been rumored for many apps, including Apple Music, Apple Maps, Calculator, Messages, Notes, Safari, and others. Below, we recap iOS 18 rumors on a per-app basis, based on reports from MacRumors, Bloomberg's Mark Gurman, and others: Apple Maps: At least two new Apple Maps features are...
maxresdefault

Apple Event Rumors: iPad Pro With M4 Chip and New Apple Pencil With Haptic Feedback

Sunday April 28, 2024 6:19 am PDT by
In his Power On newsletter today, Bloomberg's Mark Gurman outlined some of the new products he expects Apple to announce at its "Let Loose" event on May 7. Subscribe to the MacRumors YouTube channel for more videos. First, Gurman now believes there is a "strong possibility" that the upcoming iPad Pro models will be equipped with Apple's next-generation M4 chip, rather than the M3 chip that...
iPad Pro OLED Feature 2

Apple to Use 'Best OLED Panels on the Market' for Upcoming iPad Pro

Monday April 29, 2024 10:04 am PDT by
Apple's upcoming iPad Pro models will feature "by far the best OLED tablet panels on the market," according to Display Supply Chain Consultants. Set to be announced on May 7, the OLED iPad Pro models will feature LTPO (a more power efficient form of OLED), a 120Hz ProMotion refresh rate, and a tandem stack and glass thinning that will bring "ultra-thin and light displays" that support high...
iOS 18 General Notes Feature 2

iOS 18 Rumored to 'Overhaul' Notes, Mail, Photos, and Fitness Apps

Sunday April 28, 2024 6:44 am PDT by
Bloomberg's Mark Gurman today said that iOS 18 will "overhaul" many of Apple's built-in apps, including Notes, Mail, Photos, and Fitness. Gurman did not reveal any specific new features planned for these apps. It was previously rumored that the Notes app will gain support for displaying more math equations, and a built-in option to record voice memos, but this is the first time we have...
iPad Air 5 Colors

Apple's M1 iPad Air Drops to New Low Price of $399.99 at Best Buy

Monday April 29, 2024 7:12 am PDT by
Best Buy today has discounted Apple's M1 iPad Air (64GB Wi-Fi) to a new all-time low price of $399.99 in the Starlight color option, down from $599.99. Best Buy says this deal will last through the end of the day, and it's only available in one color at this record low price. Note: MacRumors is an affiliate partner with Best Buy. When you click a link and make a purchase, we may receive a...
maxresdefault

Apple Announces 'Let Loose' Event on May 7 Amid Rumors of New iPads

Tuesday April 23, 2024 7:11 am PDT by
Apple has announced it will be holding a special event on Tuesday, May 7 at 7 a.m. Pacific Time (10 a.m. Eastern Time), with a live stream to be available on Apple.com and on YouTube as usual. The event invitation has a tagline of "Let Loose" and shows an artistic render of an Apple Pencil, suggesting that iPads will be a focus of the event. Subscribe to the MacRumors YouTube channel for more ...
ios 17 5 repair state

iOS 17.5 Includes 'Repair State' Option That Doesn't Require Turning Off Find My for Service

Tuesday April 30, 2024 1:24 pm PDT by
With iOS 17.5, Apple is adding a "Repair State" feature that is designed to allow an iPhone to be sent in for service without deactivating Find My and Activation Lock. The fourth iOS 17.5 beta that came out today adds a "Remove This Device" option for all devices in Find My, and using it with an iPhone puts that iPhone into the new Repair State. Right now, sending an iPhone to Apple to be...