OpenAI Employees Warn of Advanced AI Dangers

Several current and former employees of OpenAI and Google DeepMind today shared an open letter warning of the dangers of advanced AI and the current lack of oversight of companies working on AI technology.

open ai logo
The employees suggest there are a number of risks that we are facing from AI development, including further entrenchment of existing inequalities, manipulation and misinformation, and loss of control of autonomous AI systems, which the letter says could lead to human extinction.

AI companies have "strong financial incentives" to forge ahead with development and to avoid sharing information about their protective measures and risk levels. "We do not think they can all be relied upon to share it voluntarily," reads the letter, which says that it is up to current and former employees to speak out.

So long as there is no effective government oversight of these corporations, current and former employees are among the few people who can hold them accountable to the public. Yet broad confidentiality agreements block us from voicing our concerns, except to the very companies that may be failing to address these issues. Ordinary whistleblower protections are insufficient because they focus on illegal activity, whereas many of the risks we are concerned about are not yet regulated.

Employees are ultimately calling on AI companies to offer solid whistleblower protections for speaking out about the risks of AI.

  • Avoid creating or enforcing agreements that prevent criticism for risk-related concerns.
  • Offer a verifiably anonymous process for employees to raise risk-related concerns to the board, regulators, and independent organizations with relevant expertise.
  • Support a culture of open criticism to allow employees to raise risk-related concerns about technologies to the public, the board, regulators, and more, as long as trade secrets are protected.
  • Avoid retaliating against employees who publicly share risk-related confidential information after other processes have failed.

A total of 13 employees signed the letter, including seven former OpenAI employees, four current OpenAI employees, one former Google DeepMind employee, and one current Google DeepMind employee. OpenAI has threatened employees with loss of vested equity for speaking up, and it makes them sign draconian NDA agreements that muzzle criticism.

The letter comes as Apple prepares to announce multiple AI-powered features for iOS 18 and other software updates on Monday. Apple is working on its own AI functionality that will be baked into apps across the operating system, plus it has signed a deal with OpenAI to integrate ChatGPT features into ‌iOS 18‌.

Popular Stories

iPhone 16 Pro Sizes Feature

iPhone 16 Series Is Just Two Months Away: Everything We Know

Monday July 15, 2024 4:44 am PDT by
Apple typically releases its new iPhone series around mid-September, which means we are about two months out from the launch of the iPhone 16. Like the iPhone 15 series, this year's lineup is expected to stick with four models – iPhone 16, iPhone 16 Plus, iPhone 16 Pro, and iPhone 16 Pro Max – although there are plenty of design differences and new features to take into account. To bring ...
maxresdefault

Apple's AirPods Pro 2 vs. Samsung's Galaxy Buds3 Pro

Saturday July 13, 2024 8:00 am PDT by
Samsung this week introduced its latest earbuds, the Galaxy Buds3 Pro, which look quite a bit like Apple's AirPods Pro 2. Given the similarities, we thought we'd compare Samsung's new earbuds to the AirPods Pro. Subscribe to the MacRumors YouTube channel for more videos. Design wise, you could potentially mistake Samsung's Galaxy Buds3 Pro for the AirPods Pro. The Buds3 Pro have the same...
iPhone 15 Pro Cameras

iPhone 17 Pro Max Will Be First Model to Feature Three 48MP Cameras

Thursday July 11, 2024 12:20 am PDT by
Next year's iPhone 17 Pro Max will feature an upgraded 48-megapixel Tetraprism camera for enhanced photo quality and zoom functionality, according to Apple analyst Ming-Chi Kuo. In his n-iphone-tetraprism-upgrade-ca62dd37e364">latest investor note published to Medium, Kuo said the key specification change would be a 1/2.6" 48MP CIS sensor, up from the 1/3.1" 12MP sensor expected to be used...
Beyond iPhone 13 Better Blue Face ID Single Camera Hole

10 Reasons to Wait for Next Year's iPhone 17

Monday July 8, 2024 5:00 am PDT by
Apple's iPhone development roadmap runs several years into the future and the company is continually working with suppliers on several successive iPhone models simultaneously, which is why we sometimes get rumored feature leaks so far ahead of launch. The iPhone 17 series is no different – already we have some idea of what to expect from Apple's 2025 smartphone lineup. If you plan to skip...
primeday2020 feature3

The Best Early Prime Day Deals on Apple Products

Saturday July 13, 2024 6:23 am PDT by
Amazon is soon to be back with its annual summertime Prime Day event, lasting for just two days from July 16-17. As it does every year, Prime Day offers shoppers a huge selection of deals across Amazon's storefront, and there are already many deals you can get on sale ahead of the event. Note: MacRumors is an affiliate partner with Amazon. When you click a link and make a purchase, we may...

Top Rated Comments

iBreatheApple Avatar
6 weeks ago
I really can’t handle all the doom and gloom we have to face on a daily basis. The sky is falling media headlines, the election, protests, our country’s border disintegrating (USA), people being hateful and violent in general, the comment sections online, knowing about every injustice that ever happens, every tragedy, every disaster…
Where is the internet kill switch.
Score: 43 Votes (Like | Disagree)
goobot Avatar
6 weeks ago
Who cares about human extinction when we can increase our profits from 80 billion to 81 billion
Score: 38 Votes (Like | Disagree)
GoosePoops Avatar
6 weeks ago
I, for one, welcome our new AI overlords.
Score: 34 Votes (Like | Disagree)
icanhazmac Avatar
6 weeks ago
I applaud their efforts but I fear this cat is out of the bag and even if civilized countries and/or entities behave, others won't.
Score: 32 Votes (Like | Disagree)
subjonas Avatar
6 weeks ago

Uhmm, if a potential whistle-blower is witnessing a threat as serious as human extinction, why is he or she worried about potential retaliation from the corporation? In a situation like that, you blow the whistle no matter the personal consequences, unless, of course, you're just being a bit dramatic.
Because no one really knows exactly how likely or big the risk is, there are too many variables. And it’s really easy to tell someone else to put their livelihood on the line. What they’ve done already takes more courage than most people have.
Score: 26 Votes (Like | Disagree)
123jmail Avatar
6 weeks ago
Uhmm, if a potential whistle-blower is witnessing a threat as serious as human extinction, why is he or she worried about potential retaliation from the corporation? In a situation like that, you blow the whistle no matter the personal consequences, unless, of course, you're just being a bit dramatic.
Score: 14 Votes (Like | Disagree)