OpenAI Employees Warn of Advanced AI Dangers

Several current and former employees of OpenAI and Google DeepMind today shared an open letter warning of the dangers of advanced AI and the current lack of oversight of companies working on AI technology.

open ai logo
The employees suggest there are a number of risks that we are facing from AI development, including further entrenchment of existing inequalities, manipulation and misinformation, and loss of control of autonomous AI systems, which the letter says could lead to human extinction.

AI companies have "strong financial incentives" to forge ahead with development and to avoid sharing information about their protective measures and risk levels. "We do not think they can all be relied upon to share it voluntarily," reads the letter, which says that it is up to current and former employees to speak out.

So long as there is no effective government oversight of these corporations, current and former employees are among the few people who can hold them accountable to the public. Yet broad confidentiality agreements block us from voicing our concerns, except to the very companies that may be failing to address these issues. Ordinary whistleblower protections are insufficient because they focus on illegal activity, whereas many of the risks we are concerned about are not yet regulated.

Employees are ultimately calling on AI companies to offer solid whistleblower protections for speaking out about the risks of AI.

  • Avoid creating or enforcing agreements that prevent criticism for risk-related concerns.
  • Offer a verifiably anonymous process for employees to raise risk-related concerns to the board, regulators, and independent organizations with relevant expertise.
  • Support a culture of open criticism to allow employees to raise risk-related concerns about technologies to the public, the board, regulators, and more, as long as trade secrets are protected.
  • Avoid retaliating against employees who publicly share risk-related confidential information after other processes have failed.

A total of 13 employees signed the letter, including seven former OpenAI employees, four current OpenAI employees, one former Google DeepMind employee, and one current Google DeepMind employee. OpenAI has threatened employees with loss of vested equity for speaking up, and it makes them sign draconian NDA agreements that muzzle criticism.

The letter comes as Apple prepares to announce multiple AI-powered features for iOS 18 and other software updates on Monday. Apple is working on its own AI functionality that will be baked into apps across the operating system, plus it has signed a deal with OpenAI to integrate ChatGPT features into ‌iOS 18‌.

Popular Stories

Apple Vision Pro 2 Feature 2

Apple Reportedly Suspends Work on Vision Pro 2

Tuesday June 18, 2024 8:17 am PDT by
Apple has suspended work on the second-generation Vision Pro headset to singularly focus on a cheaper model, The Information reports. Apple was widely believed to have plans to divide its Vision product line into two models, with one "Pro" model and one lower-cost standard model. The company is said to have been deprioritizing the next Vision Pro headset over the past year, gradually...
apple watch series 9 display

Kuo: Apple Watch Series 10 to Get Larger Screen and Thinner Design

Monday June 17, 2024 1:20 am PDT by
This year's Apple Watch Series 10 will be thinner and come in larger screen sizes than previous models, according to Apple analyst Ming-Chi Kuo. In his latest industry note -10-and-98075c44ce92">shared on Medium, Kuo said the screen size options on the next-generation Apple Watch will increase from 41mm to 45mm, and from 45mm to 49mm, while being encased in a thinner design. For reference,...
2022 back to school apple feature

Apple's 2024 Back to School Sale Launching This Week

Monday June 17, 2024 12:27 pm PDT by
Apple will launch its annual Back to School promotion for university students in the United States and Canada this week, according to Bloomberg's Mark Gurman. Apple's back to school sales provide students with a free Apple gift card when purchasing a Mac or an iPad, and this year's promotion could help Apple push the new M2 iPad Air and M4 iPad Pro models. Last year, Apple offered U.S....
Apple Pay Later feature 1

Apple Discontinuing Apple Pay Later

Monday June 17, 2024 11:44 am PDT by
Apple is discontinuing Apple Pay Later, the buy now, pay later feature that it just launched last October. Apple Pay Later is being discontinued as of today, but people who have existing Apple Pay Later loans will be able to continue to pay them off and manage them through the Wallet app. Apple announced plans to end the feature in a statement provided to 9to5Mac, which also notes that...
iOS 18 CarPlay Feature

iOS 18 Adds These 5 New Features to CarPlay

Thursday June 13, 2024 7:44 am PDT by
Apple did not mention CarPlay during its WWDC keynote this week, but iOS 18 includes a handful of new features for the in-car software. Overall, there is not a whole lot new for CarPlay on iOS 18, with changes seemingly limited to the Messages and Settings apps so far. Below, we recap everything new for CarPlay on iOS 18. New for CarPlay on iOS 18 1. Contact Photos in Messages App...
iPod Nano vs iPod Pro Ad Feature 1

Apple Developing Thinner MacBook Pro, Apple Watch, and iPhone

Monday June 17, 2024 2:22 am PDT by
Apple intends to slim down the MacBook Pro, Apple Watch, and iPhone, with the new ultra-thin M4 iPad Pro a sign of the company's new design trajectory, according to Bloomberg's Mark Gurman. When the M4 iPad Pro was unveiled last month, Apple touted it as the company's thinnest product ever, and even compared it to the 2012 iPod nano to emphasize its slim dimensions. Writing in the latest ...
watchOS 11 Thumb 2 1

watchOS 11 Supports Automatic Nap Detection

Monday June 17, 2024 4:05 pm PDT by
watchOS 11 appears to include a new feature that allows an Apple Watch to automatically detect and record when you're taking a nap. As shared on Reddit, an Apple Watch owner took a nap and was able to see the sleep data recorded in the Health app, despite not putting the device in Sleep Mode. Right now, the Apple Watch only tracks and records sleep when it is in Sleep Mode, and there is no...

Top Rated Comments

iBreatheApple Avatar
2 weeks ago
I really can’t handle all the doom and gloom we have to face on a daily basis. The sky is falling media headlines, the election, protests, our country’s border disintegrating (USA), people being hateful and violent in general, the comment sections online, knowing about every injustice that ever happens, every tragedy, every disaster…
Where is the internet kill switch.
Score: 43 Votes (Like | Disagree)
goobot Avatar
2 weeks ago
Who cares about human extinction when we can increase our profits from 80 billion to 81 billion
Score: 38 Votes (Like | Disagree)
GoosePoops Avatar
2 weeks ago
I, for one, welcome our new AI overlords.
Score: 34 Votes (Like | Disagree)
icanhazmac Avatar
2 weeks ago
I applaud their efforts but I fear this cat is out of the bag and even if civilized countries and/or entities behave, others won't.
Score: 32 Votes (Like | Disagree)
subjonas Avatar
2 weeks ago

Uhmm, if a potential whistle-blower is witnessing a threat as serious as human extinction, why is he or she worried about potential retaliation from the corporation? In a situation like that, you blow the whistle no matter the personal consequences, unless, of course, you're just being a bit dramatic.
Because no one really knows exactly how likely or big the risk is, there are too many variables. And it’s really easy to tell someone else to put their livelihood on the line. What they’ve done already takes more courage than most people have.
Score: 26 Votes (Like | Disagree)
123jmail Avatar
2 weeks ago
Uhmm, if a potential whistle-blower is witnessing a threat as serious as human extinction, why is he or she worried about potential retaliation from the corporation? In a situation like that, you blow the whistle no matter the personal consequences, unless, of course, you're just being a bit dramatic.
Score: 14 Votes (Like | Disagree)