Apple Makes New On-Screen Game Controller Available to Developers on iOS 15 and iPadOS 15

During the Platforms State of the Union at WWDC this week, Apple unveiled a new API for iOS 15 and iPadOS 15 that enables developers to implement an on-screen virtual game controller in their iPhone and iPad games with just a few lines of code.

apple virtual game controller ios 15
While many iPhone and iPad games already offer on-screen controls, Apple's new virtual game controller is available to all developers, easy to add, and can be customized on a per-game basis. Apple said the on-screen controller can be adjusted to a variety of layouts, with up to four buttons and a thumbstick, d-pad, or touchpad available per left and right side.

"These new on-screen controls for iPhone and iPad look amazing, and they're carefully tuned for grip locations across hand sizes and for a great responsiveness and feel," said Nat Brown, an Apple engineer working on Game Technologies.

Apple offers a WWDC session and developer documentation with more details.

Related Roundups: iOS 15, iPadOS 15
Related Forum: iOS 15

Top Rated Comments

dannyyankou Avatar
18 weeks ago
On screen game controllers have never worked and will never work. It’s very difficult to keep your eyes on the gameplay and controls at the same time. You need physical buttons.
Score: 25 Votes (Like | Disagree)
TheDailyApple Avatar
18 weeks ago
I find the best on screen controllers are the ones designed from the ground up for touch screen instead on those trying to replicate standard game controls.
Score: 10 Votes (Like | Disagree)
TheDailyApple Avatar
18 weeks ago

On screen game controllers have never worked and will never work. It’s very difficult to keep your eyes on the gameplay and controls at the same time. You need physical buttons.
While I tend to agree with you, this could help with that. If multiple games share the same on screen controls then it will be easier to memorize button location and placement. Similar to how I can type on the 12.9” iPad’s software keyboard without looking just like I do on a real one (albeit more slowly) because the key placement is the same.

Obviously a heavy gamer should buy a real controller just as a coder or writer should buy a real keyboard. But as light/infrequent gamers are unlikely to invest in one, it’s worth optimizing the on screen interface.
Score: 9 Votes (Like | Disagree)
RadioHedgeFund Avatar
18 weeks ago

On screen game controllers have never worked and will never work. It’s very difficult to keep your eyes on the gameplay and controls at the same time. You need physical buttons.
I don’t know, Caster (http://www.elecorn.com/caster3d/) largely nailed the core aspects of it in 2009 by just using the position of your thumb from the first point it hits the screen. It is entirely possible to use the orientation of your character or vehicle as a visual cue for where you need to go to next. Controlling a camera using the same method is no different to using a mouse.

Meteor Blitz (https://toucharcade.com/2009/09/16/meteor-blitz-dual-stick-space-shooting-goodness/) also showed how you can use orientation and visual cues to make up for a lack of buttons. Geometry Wars 3 on iOS was and still is a fantastic port.

Where touchscreen controls do fall down is when devs tried to port over console titles to a phone and have to shoehorn touchscreen controls into games not designed for them. This does not work.

There are exceptions, for example games with a largely static camera like FFVII but this pales in comparison to proper ports like FFIX which have been redesigned with the host platform in mind. See also titles like Horizon Chase and Oceanhorn 1.
Score: 7 Votes (Like | Disagree)
LFC2020 Avatar
18 weeks ago
This is why they must of released a 16gb ram iPad ?? since the ram is useless for anything else on iPadOS at the moment.
Score: 5 Votes (Like | Disagree)
Joniz Avatar
18 weeks ago
Yeah, I can see someone making a game where these are a set of boobs or something.
Score: 5 Votes (Like | Disagree)

Related Stories

apple virtual game controller ios 15

Apple Gaming Controller Arrives in Unexpected Way

Friday June 18, 2021 3:10 am PDT by
Apple has long been rumored to be developing on a gaming controller, and at WWDC this month, a form of Apple's gaming controller appears to have emerged, albeit not quite in the way that some users had hoped for. Apple has clearly expanded its interest in gaming controllers over the past year, integrating full support for even the latest Xbox and PlayStation controllers into iOS, iPadOS, macO...
appstore

Kids and Teens in China Banned From Playing Online Video Games for More Than 3 Hours Per Week

Monday August 30, 2021 4:38 pm PDT by
China is implementing a new online gaming restriction that will affect children and teenagers who are under 18 years old, reports CNBC. Kids will only be able to play online games for an hour a day (8:00 p.m. to 9:00 p.m.) on weekends and legal holidays. Weekday gaming is prohibited. Companies that provide online game services to minors will need to comply with these rules and will not be...
applearcade

Apple Considered Launching Cloud Gaming Service

Monday October 18, 2021 7:05 am PDT by
Apple has discussed launching a cloud-based gaming service to rival the likes of Xbox Cloud Gaming and Google Stadia, according to Bloomberg's Mark Gurman. In his latest "Power On" newsletter, Gurman explained that Apple has considered launching a cloud-based game streaming service like its competitors (emphasis our own):Apple's gaming service is somewhat unique, relying on games that run on ...
tiny wings plus

Classic iPhone Game 'Tiny Wings' Launches on Apple Arcade This Friday

Tuesday October 12, 2021 9:01 am PDT by
Over a decade after being released on the App Store, the classic hit iPhone game Tiny Wings is coming to Apple Arcade this Friday. Tiny Wings is a casual game that involves tapping and holding the screen to control a bird whose wings are too tiny to fly. The game tasks players with outrunning the sun as they fly a bird across procedurally generated islands. Players must tap on the screen at...
ps5 controller apple online store

iOS 15 and macOS Monterey Introduce Ability to Capture 15-Second Gameplay Recordings Using a Game Controller

Tuesday June 8, 2021 5:23 pm PDT by
Apple's new iOS 15, iPadOS 15, and macOS Monterey software updates unveiled this week introduce the ability to capture and save the last 15 seconds of gameplay at any time by long pressing a designated button on a supported game controller. Instead of having to remember to start and stop a screen recording while playing a game, this optional new feature allows iPhone, iPad, and Mac users to...
apple tv 4k design

Sketchy Report Claims Apple Working on Redesigned Apple TV With Thinner Design and 'Plexiglass' Top

Tuesday October 12, 2021 3:15 am PDT by
Apple is working on a redesigned Apple TV box that will feature a flatter, thinner footprint, and a "plexiglass" top, according to a questionable report from iDropNews. The report, citing "sources," claims that an Apple TV with a thinner and flatter design is in the works, eliminating the "horribly outdated and bulky" design of the current generation Apple TV. According to the sketchy...
playdate1

'Playdate' Handheld Game System Now Available for Pre-Order

Thursday July 29, 2021 10:17 am PDT by
Panic, a company known for its range of apps designed for Apple's iPhones, iPads, and Macs, today announced the launch of pre-orders for its Playdate handheld gaming system. Panic had 20,000 Playdate systems available for preorder for shipping in late 2021, but those quickly sold out and orders placed now will ship out in 2022. Priced at $179, the Playdate is a pocket-sized gaming system ...
maxresdefault

Hands-On With Microsoft's Browser-Based Xbox Cloud Gaming Service on an iPhone

Wednesday June 30, 2021 1:16 pm PDT by
Microsoft earlier this week made its Xbox Cloud Gaming service available on iOS devices, which means iPhone and iPad users can play Xbox games using the Safari browser. Subscribe to the MacRumors YouTube channel for more videos. We decided to test out Xbox Cloud Gaming to see how it works at launch, and whether it's worth the $14.99 subscription price for the Xbox Game Pass Ultimate...
mobile gaming clip magsafe

OtterBox Launches MagSafe-Compatible Mobile Gaming Clip

Tuesday August 3, 2021 3:02 pm PDT by
OtterBox today expanded on its gaming accessory offerings with the launch of the Mobile Gaming Clip for MagSafe, which is designed to work with the iPhone 12, 12 mini, 12 Pro, and 12 Pro Max. Priced at $40, the Mobile Gaming Clip attaches to an Xbox controller using a fitted clip and holds an iPhone with the magnetic mount. It can be used when playing an iPhone game with an Xbox controller,...
apple arcade asphalt 8

Two New Games Coming to Apple Arcade, Including Gameloft's Racing Classic 'Asphalt 8: Airborne'

Tuesday July 27, 2021 10:00 am PDT by
Apple today announced two games that are coming soon to Apple Arcade, including the classic racing game "Asphalt 8: Airborne" from Gameloft and a new Zelda-inspired roleplaying game "Baldo" from Italian game studio NAPS team. Originally released on the App Store in 2013, "Asphalt 8: Airborne" is coming to Apple Arcade, but no specific release date has been announced. The popular racing game...