Apple Makes New On-Screen Game Controller Available to Developers on iOS 15 and iPadOS 15

During the Platforms State of the Union at WWDC this week, Apple unveiled a new API for iOS 15 and iPadOS 15 that enables developers to implement an on-screen virtual game controller in their iPhone and iPad games with just a few lines of code.

apple virtual game controller ios 15
While many iPhone and iPad games already offer on-screen controls, Apple's new virtual game controller is available to all developers, easy to add, and can be customized on a per-game basis. Apple said the on-screen controller can be adjusted to a variety of layouts, with up to four buttons and a thumbstick, d-pad, or touchpad available per left and right side.

"These new on-screen controls for iPhone and iPad look amazing, and they're carefully tuned for grip locations across hand sizes and for a great responsiveness and feel," said Nat Brown, an Apple engineer working on Game Technologies.

Apple offers a WWDC session and developer documentation with more details.

Related Roundup: iPadOS 15
Related Forum: iOS 15

Top Rated Comments

dannyyankou Avatar
17 months ago
On screen game controllers have never worked and will never work. It’s very difficult to keep your eyes on the gameplay and controls at the same time. You need physical buttons.
Score: 25 Votes (Like | Disagree)
TheDailyApple Avatar
17 months ago
I find the best on screen controllers are the ones designed from the ground up for touch screen instead on those trying to replicate standard game controls.
Score: 10 Votes (Like | Disagree)
TheDailyApple Avatar
17 months ago

On screen game controllers have never worked and will never work. It’s very difficult to keep your eyes on the gameplay and controls at the same time. You need physical buttons.
While I tend to agree with you, this could help with that. If multiple games share the same on screen controls then it will be easier to memorize button location and placement. Similar to how I can type on the 12.9” iPad’s software keyboard without looking just like I do on a real one (albeit more slowly) because the key placement is the same.

Obviously a heavy gamer should buy a real controller just as a coder or writer should buy a real keyboard. But as light/infrequent gamers are unlikely to invest in one, it’s worth optimizing the on screen interface.
Score: 9 Votes (Like | Disagree)
RadioHedgeFund Avatar
17 months ago

On screen game controllers have never worked and will never work. It’s very difficult to keep your eyes on the gameplay and controls at the same time. You need physical buttons.
I don’t know, Caster (http://www.elecorn.com/caster3d/) largely nailed the core aspects of it in 2009 by just using the position of your thumb from the first point it hits the screen. It is entirely possible to use the orientation of your character or vehicle as a visual cue for where you need to go to next. Controlling a camera using the same method is no different to using a mouse.

Meteor Blitz (https://toucharcade.com/2009/09/16/meteor-blitz-dual-stick-space-shooting-goodness/) also showed how you can use orientation and visual cues to make up for a lack of buttons. Geometry Wars 3 on iOS was and still is a fantastic port.

Where touchscreen controls do fall down is when devs tried to port over console titles to a phone and have to shoehorn touchscreen controls into games not designed for them. This does not work.

There are exceptions, for example games with a largely static camera like FFVII but this pales in comparison to proper ports like FFIX which have been redesigned with the host platform in mind. See also titles like Horizon Chase and Oceanhorn 1.
Score: 7 Votes (Like | Disagree)
LFC2020 Avatar
17 months ago
This is why they must of released a 16gb ram iPad ?? since the ram is useless for anything else on iPadOS at the moment.
Score: 5 Votes (Like | Disagree)
Joniz Avatar
17 months ago
Yeah, I can see someone making a game where these are a set of boobs or something.
Score: 5 Votes (Like | Disagree)

Related Stories

microsoft purchases Activision

Microsoft to Acquire Game Studio Activision Blizzard for $68.7 Billion

Tuesday January 18, 2022 6:18 am PST by
Microsoft today announced that it will purchase the game studio Activision Blizzard, the maker of hit games such as Call of Duty, Candy Crush, World of Warcraft, and more, for almost $70 billion. Microsoft says this purchase will help it "bring the joy and community of gaming to everyone, across every device." The seismic purchase for Microsoft will see several of Activision's games move to...
ios 15

Apple Seeds Second Betas of iOS 15.3 and iPadOS 15.3 to Developers

Wednesday January 12, 2022 10:08 am PST by
Apple today seeded the second betas of upcoming iOS 15.3 and iPadOS 15.3 updates to developers for testing purposes, with the new software coming three weeks after the launch of the first betas and a month after the launch of iOS 15.2 and iPadOS 15.2. iOS and iPadOS 15.3 can be downloaded through the Apple Developer Center or over the air after the proper profile has been installed on an...
xbox series x controller microsoft

Some Users Experiencing Issues With Game Controllers in macOS Monterey 12.3

Wednesday March 23, 2022 4:30 pm PDT by
Following the macOS 12.3 update that was released on March 14, some Mac users have run into issues with game controllers after installing the new software. Complaints on the Apple Developer Forums and Reddit suggest that some Xbox, PlayStation, and other third-party controllers are not functioning over Bluetooth. Not all users appear to be affected, as some people have said that their...
maxresdefault

Hands On: Testing Fortnite on iOS Using GeForce NOW

Thursday February 17, 2022 11:54 am PST by
Fortnite has been unavailable to play on the iPhone and iPad since Apple banned it from the App Store in August 2020 amid an ongoing legal battle with Epic Games, but the battle royale game is coming back to iOS devices thanks to Nvidia's GeForce NOW gaming service. Subscribe to the MacRumors YouTube channel for more videos. GeForce NOW is a browser-based gaming service that will allow iPhone ...
iOS 15

Apple Seeds Fourth Betas of iOS 15.4 and iPadOS 15.4 to Developers [Update: Public Beta Available]

Tuesday February 22, 2022 10:07 am PST by
Apple today seeded the fourth betas of upcoming iOS 15.4 and iPadOS 15.4 updates to developers for testing purposes, with the new software coming one week after Apple seeded the third betas of iOS 15.4 and iPadOS 15.4. Developers can download iOS 15.4 and iPadOS 15.4 through the Apple Developer Center or over the air after the proper profile has been installed on an iPhone or iPad. iOS...
apple virtual game controller ios 15

Apple Gaming Controller Arrives in Unexpected Way

Friday June 18, 2021 3:10 am PDT by
Apple has long been rumored to be developing on a gaming controller, and at WWDC this month, a form of Apple's gaming controller appears to have emerged, albeit not quite in the way that some users had hoped for. Apple has clearly expanded its interest in gaming controllers over the past year, integrating full support for even the latest Xbox and PlayStation controllers into iOS, iPadOS, macO...
iOS 15 General Feature Purple

Apple Seeds First Betas of iOS 15.4 and iPadOS 15.4 to Developers

Thursday January 27, 2022 10:18 am PST by
Apple today seeded the first betas of upcoming iOS 15.4 and iPadOS 15.4 updates to developers for testing purposes, with the new software coming just a day after the launch of iOS 15.3 and iPadOS 15.3. Developers can download iOS 15.4 and iPadOS 15.4 through the Apple Developer Center or over the air after the proper profile has been installed on an iPhone or iPad. The updates add new...
fortnite apple logo geforce feature

Fortnite Coming Back to iOS Soon Thanks to Nvidia's GeForce NOW Service

Thursday January 13, 2022 11:19 am PST by
With the Apple vs. Epic Games lawsuit continuing on, there are no signs that Apple has any intention of allowing popular battle royale game Fortnite to return to the App Store on iPhone and iPad. Epic Games has found a workaround though, by partnering up with Nvidia. GeForce NOW, Nvidia's streaming gaming service, will soon add Fortnite support, allowing Fortnite to be played through a...

Popular Stories

apple watch ultra hammer test

YouTuber Tests Apple Watch Ultra Durability With a Hammer: Table Breaks Before the Watch

Sunday September 25, 2022 2:27 pm PDT by
A YouTuber has put Apple's claims for the durability of the Apple Watch Ultra to the test by putting it up against a drop test, a jar of nails, and repeated hits with a hammer to test the sapphire crystal protecting the display. TechRax, a channel popular for testing the durability of products, first tested the Apple Watch Ultra by dropping it from around four feet high. The Apple Watch...
tim cook spring loaded event

Six Major Products to Expect From Apple in 2023

Sunday September 25, 2022 10:57 am PDT by
As we approach the end of a busy product release season for Apple with only new iPads and Macs left to be announced over the next month or so, we're also setting our sights on 2023. Apple is rumored to have several major products in the pipeline for next year, including new Macs, a new HomePod, a VR/AR headset, and so much more. Other than new iPhones and Apple Watches, which are expected...
apple watch ultra deuglify 1

Apple Watch Ultra User Mods Titanium Casing to 'Deuglify' Design

Tuesday September 27, 2022 8:05 am PDT by
An Apple Watch Ultra user has modified their new device's casing to add a brushed finish and remove the orange color of the Action Button in an effort to make it more visually appealing. The Apple Watch Ultra offers the first complete redesign of the Apple Watch since the product line's announcement in 2014, and while the design has been met with praise from many users, some have criticized...
General iOS 16 Feature Yellow

Some iOS 16 Users Continue to Face Unaddressed Bugs and Battery Drain Two Weeks After Launch

Monday September 26, 2022 7:34 am PDT by
Today marks exactly two weeks since Apple released iOS 16 to the public. Besides the personalized Lock Screen, major changes in Messages, and new features in Maps, the update has also seen its fair share of bugs, performance problems, battery drain, and more. After major iOS updates, it's normal for some users to report having issues with the new update, but such reports usually subside in...
iPhone 14 Pro Sports Scores Dynamic Island

iPhone 14 Pro Features Live Sports Scores in Dynamic Island on iOS 16.1

Monday September 26, 2022 7:52 am PDT by
Earlier this month, Apple announced that iOS 16.1 will enable a new Live Activities feature that allows iPhone users to stay on top of things that are happening in real time, such as a sports game or a food delivery order, right from the Lock Screen. On the iPhone 14 Pro and Pro Max, Live Activities also integrate with the Dynamic Island. Premier League match in Dynamic Island via Paul Bradford ...
iPhone 14 Pros in Hand Black Background Feature

Verizon iPhone 14 Pro Customers Reporting Cellular Connection Issues

Monday September 26, 2022 6:23 am PDT by
iPhone 14 Pro customers on the Verizon network in the U.S. are reporting issues with slow and unreliable 5G cellular connections and calls randomly dropping. Several threads on Reddit (1,2,3) and the MacRumors forums chronicle issues faced by Verizon customers and Apple's latest iPhone. According to user reports, signal strength on the iPhone 14 Pro is unreliable and weak, while other...
Tim Cook Apple Event

Gurman: New iPads and Macs May Be Announced Through Press Releases, No October Event

Sunday September 25, 2022 6:50 am PDT by
Apple may decide to release its remaining products for 2022, which include updated iPad Pro, Mac mini, and 14-inch and 16-inch MacBook Pro models, through press releases on its website rather than a digital event, according to Bloomberg's Mark Gurman. In his latest Power On newsletter, Gurman said that Apple is currently "likely to release its remaining 2022 products via press releases,...
Stage Manager Extension Thumb 1

New iPadOS 16.1 Beta Expands Stage Manager to Older iPad Pro Models, Delays External Display Support

Tuesday September 27, 2022 10:24 am PDT by
The most recent beta of iPadOS 16.1 expands the controversial Stage Manager feature to older iPads, allowing it to work with iPad Pro models that have an A12X or A12Z chip, according to information Apple provided to Engadget. The beta also removes the external display support from Stage Manager for the current time, with the feature set to return in a later iPadOS 16 update. Apple's...
iOS 16

Everything New in the Latest iOS 16.1 and iPadOS 16.1 Betas: Stage Manager Expansion, Wallpaper Tweaks and More

Tuesday September 27, 2022 11:36 am PDT by
Apple today released new betas of iOS 16.1 and iPadOS 16.1 to developers, tweaking some of the functionality that's been introduced in prior betas and in the case of iPadOS 16.1, adding a major new feature to Stage Manager. We've rounded up everything new in both betas below. Wallpaper Updates Apple has updated the Wallpaper section of the Settings app to allow users to swap between...
john meyer ultra

Apple Watch Ultra Praised by Watch World Tastemaker John Mayer

Monday September 26, 2022 4:42 am PDT by
Apple Watch Ultra has been endorsed by American musician and famous watch collector John Mayer, who has been showing off the new device on his Instagram account. "Been wearing the Apple Watch Ultra for a week... and it's great," writes Mayer over a photo of the watch. "The first Apple Watch that excited me as a mechanical watch collector." "It's loaded with capability and what I call...