Apple Makes New On-Screen Game Controller Available to Developers on iOS 15 and iPadOS 15

During the Platforms State of the Union at WWDC this week, Apple unveiled a new API for iOS 15 and iPadOS 15 that enables developers to implement an on-screen virtual game controller in their iPhone and iPad games with just a few lines of code.

apple virtual game controller ios 15
While many iPhone and iPad games already offer on-screen controls, Apple's new virtual game controller is available to all developers, easy to add, and can be customized on a per-game basis. Apple said the on-screen controller can be adjusted to a variety of layouts, with up to four buttons and a thumbstick, d-pad, or touchpad available per left and right side.

"These new on-screen controls for iPhone and iPad look amazing, and they're carefully tuned for grip locations across hand sizes and for a great responsiveness and feel," said Nat Brown, an Apple engineer working on Game Technologies.

Apple offers a WWDC session and developer documentation with more details.

Related Forum: iOS 15

Popular Stories

top stories 2025 12 20

Top Stories: iOS 26.3 Beta, Major Apple Leaks, and More

Saturday December 20, 2025 6:00 am PST by
You'd think things would be slowing down heading into the holidays, but this week saw a whirlwind of Apple leaks and rumors while Apple started its next cycle of betas following last week's release of iOS 26.2 and related updates. This week also saw the release of a new Apple Music integration with ChatGPT, so read on below for all the details on this week's biggest stories! Top Stories i...
iPhone Top Left Hole Punch Face ID Feature Purple

iPhone 18 Pro Features Leaked in New Report, Including Under-Screen Face ID

Tuesday December 16, 2025 8:44 am PST by
Next year's iPhone 18 Pro and iPhone 18 Pro Max will be equipped with under-screen Face ID, and the front camera will be moved to the top-left corner of the screen, according to a new report from The Information's Wayne Ma and Qianer Liu. As a result of these changes, the report said the iPhone 18 Pro models will not have a pill-shaped Dynamic Island cutout at the top of the screen....
ios 18 security update

Don't Want to Upgrade to iOS 26? Here's How to Stay on iOS 18 [Update: Now Unavailable]

Friday December 19, 2025 10:37 am PST by
Since the beginning of December, Apple has been pushing iPhone users who opted to stay on iOS 18 to install iOS 26 instead. Apple started by making the iOS 18 upgrades less visible, and has now transitioned to making new iOS 18 updates unavailable on any device capable of running iOS 26. If you have an iPhone 11 or later, Apple is no longer offering new versions of iOS 18, even though there...
airpods pro 3 new blue

AirPods Pro 3's Static and Noise Issues Haven't Been Resolved

Thursday December 18, 2025 3:44 pm PST by
Since the AirPods Pro 3 launched, there have been complaints from users who have noticed a static-like sound or a crackling issue when using the earbuds, particularly when Active Noise Cancellation is on but no media is playing. Users have also run into strange high-pitched whistling sounds that happen intermittently. We shared the issues back in late October, and despite two subsequent...
apple music chatgpt

ChatGPT's Apple Music Integration Is Now Live

Wednesday December 17, 2025 3:50 pm PST by
There's now a dedicated Apple Music app for ChatGPT, which allows ChatGPT to make music recommendations and build playlists. Apple Music can be added to ChatGPT through the Settings section in the Mac app, website, or iOS app. Apple Music is listed under the apps option, and connecting to it requires signing in with your Apple Account for authorization purposes. ChatGPT can be used to...
apple beta 26 lineup

Apple's 2026 and 2027 Product Roadmap: Foldable iPhone, iPhone 18 Pro, M5 Macs, and More

Tuesday December 16, 2025 4:42 pm PST by
There has been a whirlwind of rumors over the last few days, sourced from leaked internal software designed for the iPhone and the Mac, and news sites like The Information. Below, we have a quick recap of everything we've heard this week, which serves as a guide to Apple's product plans in 2026 and beyond. We've organized the info by likely release date, though there are some products that...
samsung exynos 2600 2nm%402x

Samsung Announces World's First 2nm Mobile Chip Ahead of Apple

Friday December 19, 2025 3:59 am PST by
Samsung has officially unveiled the Exynos 2600, the world's first 2 nanometer mobile system-on-a-chip (SoC), built on the company's Gate-All-Around (GAA) process. The 10-core ARM-based design aims to deliver improved performance and efficiency for flagship devices like the upcoming Galaxy S26 series. The chip uses Arm's latest cores and supports new instructions for improved CPU speed and...
iOS 26 Maps Glass

Apple Quietly Discontinued Flyover City Tours in Apple Maps

Thursday December 18, 2025 1:31 pm PST by
Apple Maps no longer offers a Flyover feature that provides users with automated tours of notable landmarks in major cities. The Flyover option appears to have been nixed around when iOS 26 launched, but its removal went largely unnoticed. Flyover city tours were introduced in 2014 with iOS 8 and OS X Yosemite, using Flyover imagery to generate an aerial tour. Most cities with Flyover...

Top Rated Comments

dannyyankou Avatar
59 months ago
On screen game controllers have never worked and will never work. It’s very difficult to keep your eyes on the gameplay and controls at the same time. You need physical buttons.
Score: 25 Votes (Like | Disagree)
TheDailyApple Avatar
59 months ago
I find the best on screen controllers are the ones designed from the ground up for touch screen instead on those trying to replicate standard game controls.
Score: 10 Votes (Like | Disagree)
TheDailyApple Avatar
59 months ago

On screen game controllers have never worked and will never work. It’s very difficult to keep your eyes on the gameplay and controls at the same time. You need physical buttons.
While I tend to agree with you, this could help with that. If multiple games share the same on screen controls then it will be easier to memorize button location and placement. Similar to how I can type on the 12.9” iPad’s software keyboard without looking just like I do on a real one (albeit more slowly) because the key placement is the same.

Obviously a heavy gamer should buy a real controller just as a coder or writer should buy a real keyboard. But as light/infrequent gamers are unlikely to invest in one, it’s worth optimizing the on screen interface.
Score: 9 Votes (Like | Disagree)
RadioHedgeFund Avatar
59 months ago

On screen game controllers have never worked and will never work. It’s very difficult to keep your eyes on the gameplay and controls at the same time. You need physical buttons.
I don’t know, Caster (http://www.elecorn.com/caster3d/) largely nailed the core aspects of it in 2009 by just using the position of your thumb from the first point it hits the screen. It is entirely possible to use the orientation of your character or vehicle as a visual cue for where you need to go to next. Controlling a camera using the same method is no different to using a mouse.

Meteor Blitz (https://toucharcade.com/2009/09/16/meteor-blitz-dual-stick-space-shooting-goodness/) also showed how you can use orientation and visual cues to make up for a lack of buttons. Geometry Wars 3 on iOS was and still is a fantastic port.

Where touchscreen controls do fall down is when devs tried to port over console titles to a phone and have to shoehorn touchscreen controls into games not designed for them. This does not work.

There are exceptions, for example games with a largely static camera like FFVII but this pales in comparison to proper ports like FFIX which have been redesigned with the host platform in mind. See also titles like Horizon Chase and Oceanhorn 1.
Score: 7 Votes (Like | Disagree)
LFC2020 Avatar
59 months ago
This is why they must of released a 16gb ram iPad ?? since the ram is useless for anything else on iPadOS at the moment.
Score: 5 Votes (Like | Disagree)
Joniz Avatar
59 months ago
Yeah, I can see someone making a game where these are a set of boobs or something.
Score: 5 Votes (Like | Disagree)