Apple's Latest AI Tool Can Animate an Image Based on Your Description

Apple has made another addition to its growing AI repertoire with the creation of a tool that leverages large language models (LLMs) to animate static images based on a user's text prompts.

apple AI research dall e

MacRumors image made with DALL·E

Apple describes the innovation in a new research paper titled "Keyframer: Empowering Animation Design Using Large Language Models."

"While one-shot prompting interfaces are common in commercial text-to-image systems like Dall·E and Midjourney, we argue that animations require a more complex set of user considerations, such as timing and coordination, that are difficult to fully specify in a single prompt—thus, alternative approaches that enable users to iteratively construct and refine generated designs may be needed especially for animations.

"We combined emerging design principles for language-based prompting of design artifacts with code-generation capabilities of LLMs to build a new AI-powered animation tool called Keyframer. With Keyframer, users can create animated illustrations from static 2D images via natural language prompting. Using GPT-4 3, Keyframer generates CSS animation code to animate an input Scalable Vector Graphic (SVG)."

To create an animation, the user uploads an SVG image – of a space rocket, say – then types in a prompt like "generate three designs where the sky fades into different colors and the stars twinkle." Keyframer then generates CSS code for the animation, and the user can then refine it by editing the code directly or by entering additional text prompts.

"Keyframer enabled users to iteratively refine their designs through sequential prompting, rather than having to consider their entire design upfront," explain the authors. "Through this work, we hope to inspire future animation design tools that combine the powerful generative capabilities of LLMs to expedite design prototyping with dynamic editors that enable creators to maintain creative control."

According to the paper, the research was informed by interviews with professional animation designers and engineers. "I think this was much faster than a lot of things I've done," said one of the study participants quoted in the paper. "I think doing something like this before would have just taken hours to do."

ai model animates images 1
The innovation is just the latest in a series of AI breakthroughs by Apple. Last week, Apple researchers released an AI model that harnesses the power of multimodal LLMs to perform pixel-level edits on images.

In late December, Apple also revealed that it had made strides in deploying LLMs on iPhones and other Apple devices with limited memory by inventing an innovative flash memory utilization technique.

Both The Information and analyst Jeff Pu have said that Apple will have some kind of generative AI feature available on the ‌iPhone‌ and iPad later in the year, when iOS 18 is released. The next version of Apple's mobile software is said to include an enhanced version of Siri with ChatGPT-like generative AI functionality, and has the potential to be the "biggest" update in the ‌iPhone‌'s history, according to Bloomberg reporter Mark Gurman.

(Via VentureBeat.)

Top Rated Comments

jayryco Avatar
8 weeks ago
I think it's cool but the implications of these tools on the creative industry will be devastating once brands and corporations find the feasibility of an AI far cheaper than creative professionals. Especially in the next 5-10 years.
Score: 19 Votes (Like | Disagree)
purplerainpurplerain Avatar
8 weeks ago

I think it's cool but the implications of these tools on the creative industry will be devastating once brands and corporations find the feasibility of an AI far cheaper than creative professionals. Especially in the next 5-10 years.
Incorrect and badly ignorant. Don’t listen to stupid Wall Street AI bros.

Companies employ people to use the tools. They can’t just have some executive sitting there asking AI. The executives and managers have other things to do.

Companies require their creative departments to use the tools.

The tools like this are very imperfect and unpredictable. They always will be. You cannot replace all traditional workflows with ‘talk to AI’. That can only happen if you want everything to be really sht.

The output of AI tools is combined with other materials that are all made normally. The creative professionals do this.
Score: 16 Votes (Like | Disagree)
swiftapplefan Avatar
8 weeks ago
That’s actually really cool, can’t wait to see how they’ll implement it in their products.
Score: 10 Votes (Like | Disagree)
victorvictoria Avatar
8 weeks ago
I have seen the future, and am happy I won't be around to witness it.
Score: 8 Votes (Like | Disagree)
Wanted797 Avatar
8 weeks ago

I think it's cool but the implications of these tools on the creative industry will be devastating once brands and corporations find the feasibility of an AI far cheaper than creative professionals. Especially in the next 5-10 years.
AI won’t take our jobs. People who know how to use AI will.
Score: 7 Votes (Like | Disagree)
HeinoM Avatar
8 weeks ago

I think it's cool but the implications of these tools on the creative industry will be devastating once brands and corporations find the feasibility of an AI far cheaper than creative professionals. Especially in the next 5-10 years.
I had the exact same thought, only I fear it may happen even sooner than that. Major publications are already laying off writers in droves as they transition to AI generated content. Creative careers of all types are going to be devastated.
Score: 6 Votes (Like | Disagree)

Popular Stories

iPhone 16 Camera Lozenge 2 Colors

iPhone 16 Plus Rumored to Come in These 7 Colors

Wednesday April 10, 2024 3:52 am PDT by
Apple's iPhone 16 Plus may come in seven colors that either build upon the existing five colors in the standard iPhone 15 lineup or recast them in a new finish, based on a new rumor out of China. According to the Weibo-based leaker Fixed focus digital, Apple's upcoming larger 6.7-inch iPhone 16 Plus model will come in the following colors, compared to the colors currently available for the...
apple tv 4k yellow bg feature

When to Expect a New Apple TV to Launch

Tuesday April 9, 2024 8:30 am PDT by
It has been nearly a year and a half since the current Apple TV was released, so the device is becoming due for a hardware upgrade. Below, we recap rumors about the next Apple TV, including potential features and launch timing. The current model is the third-generation Apple TV 4K, announced in October 2022. Key new features compared to the previous model from 2021 include a faster A15...
apple silicon feature joeblue

Macs to Get AI-Focused M4 Chips Starting in Late 2024

Thursday April 11, 2024 10:10 am PDT by
Apple will begin updating its Mac lineup with M4 chips in late 2024, according to Bloomberg's Mark Gurman. The M4 chip will be focused on improving performance for artificial intelligence capabilities. Last year, Apple introduced the M3, M3 Pro, and M3 Max chips all at once in October, so it's possible we could see the M4 lineup come during the same time frame. Gurman says that the entire...
iOS 18 WWDC 24 Feature 2

iOS 18 May Feature All-New 'Safari Browsing Assistant'

Wednesday April 10, 2024 6:11 am PDT by
iOS 18 will apparently feature a new Safari browsing assistant, according to backend code on Apple's servers discovered by Nicolás Álvarez. MacRumors contributor Aaron Perris confirmed that the code exists, but not many details are known at this time. Álvarez said it seems like the browsing assistant will use iCloud Private Relay's infrastructure to send relevant data to Apple in a...
maxresdefault

Review: Six Months With the iPhone 15 Pro

Wednesday April 10, 2024 10:53 am PDT by
It's been a bit over six months since the iPhone 15 lineup came out in September, and MacRumors videographer Dan Barbera has been using an iPhone 15 Pro Max sans case since launch. Over on our YouTube channel, Dan did a long term review to demo how his phone has held up and his thoughts on the Action button, battery life, and camera features. Subscribe to the MacRumors YouTube channel for more ...
iPhone 16 Pro Sizes Feature

Alleged iPhone 16 Battery Details Show Smaller Capacity for One Model

Tuesday April 9, 2024 3:46 am PDT by
Apple's upcoming iPhone 16 lineup will feature bigger battery capacities compared to previous-generation models with the exception of the iPhone 16 Plus, which will have a smaller battery than its predecessor. That's according to the Chinese Weibo-based leaker OvO Baby Sauce OvO, a relatively new source of supply chain leaks with an as-yet unproven track record for accuracy. The iPhone 16 ...